Tech bro prompt engineers would not be able to apply their text prompts to other contexts.

Disagree. Prompt engineers can go find a human artist in the wild and use their text prompts in the same way to generate a piece of art. No need for any fancy tech.