Pairwise maximum entropy models for studying large biological systems: when they can and when they cant work

One of the most critical problems we face in the study of biological systems is building accurate statistical descriptions of them. This problem has been particularly challenging because biological systems typically contain large numbers of interacting elements, which precludes the use of standard brute force approaches. Recently, though, several groups have reported that there may be an alternate strategy. The reports show that reliable statistical models can be built without knowledge of all the interactions in a system; instead, pairwise interactions can suffice. These findings, however, are based on the analysis of small subsystems. Here we ask whether the observations will generalize to systems of realistic size, that is, whether pairwise models will provide reliable descriptions of true biological systems. Our results show that, in most cases, they will not. The reason is that there is a crossover in the predictive power of pairwise models: If the size of the subsystem is below the crossover point, then the results have no predictive power for large systems. If the size is above the crossover point, the results do have predictive power. This work thus provides a general framework for determining the extent to which pairwise models can be used to predict the behavior of whole biological systems. Applied to neural data, the size of most systems studied so far is below the crossover point.

💡 Research Summary

The paper tackles a fundamental challenge in quantitative biology: how to construct accurate statistical descriptions of systems that contain a very large number of interacting components while only having access to limited data. Recent work has suggested that “pairwise” models—maximum‑entropy distributions constrained only by the observed single‑neuron firing rates and pairwise correlations—can capture the full joint statistics of a system, at least for small subsystems where the true distribution can be measured directly. The authors ask whether this success can be extrapolated to realistic, large‑scale biological networks.

To address this, they focus on neural spike‑train data, converting continuous spike times into binary activity in discrete time bins. For a population of N neurons they denote the true joint distribution as p_true(r₁,…,r_N) and the pairwise maximum‑entropy approximation as p_pair, which matches the first‑ and second‑order moments of p_true. They introduce a quantitative measure of model quality, \