Scaling Properties of Text Conditioning in Visual Generation

We study empirical scaling properties for text conditioning in visual generation.

We study empirical scaling properties for text conditioning in visual generation. Such properties have rarely been measured because diffusion loss does not scale with the number of tokens in natural-language prompts. Surprisingly, we find that the converged diffusion loss scales…