Characterizing Bias in Post-Bandit Inference under Index Algorithms

Bandit algorithms generate data for downstream inference, but adaptive sampling biases post-bandit sample means.

Bandit algorithms generate data for downstream inference, but adaptive sampling biases post-bandit sample means. We analyze this bias for stable index algorithms, including UCB1 and its generalizations, and derive sharp leading-order expressions for the sample-mean bias and…