Background estimation is the first step in quantitative analysis of images. It has an impact on all subsequent analyses, in particular for segmentation and calculation of ratiometric quantities. Most methods recover only a single value such as the median or yield a biased estimation in non-trivial cases. We introduce, to our knowledge, the first method to recover an unbiased estimation of background distribution. It leverages the lack of local spatial correlation in background pixels to robustly select a subset that accurately represents the background. The resulting background distribution can be used to test for foreground membership of individual pixels or estimate confidence intervals in derived quantities.