Split the Labor: Separating Evidence Interpretation from Decision Aggregation

Systems that ask a language model to reach a conclusion from many sources usually concatenate them into one prompt.

Systems that ask a language model to reach a conclusion from many sources usually concatenate them into one prompt. This conflates two operations with different requirements. Interpreting a source rewards capacity and context. Combining interpretations rewards fixed arithmetic,…