GEAR: Guided End-to-End AutoRegression for Image Synthesis

Visual generative models are typically trained in two stages.

Visual generative models are typically trained in two stages. A tokenizer is first trained for reconstruction and then frozen, after which a generator is trained on its discrete indices or continuous latents. This decoupling leaves the tokenizer unaware of what the generator…