Partition function loop series for a general graphical model: free energy corrections and message-passing equations

A loop series expansion for the partition function of a general statistical model on a graph is carried out. If the auxiliary probability distributions of the expansion are chosen to be a fixed point of the belief-propagation equation, the first term of the loop series gives the Bethe-Peierls free energy functional at the replica-symmetric level of the mean-field spin glass theory, and corrections are contributed only by subgraphs that are free of dangling edges. This result generalize the early work of Chertkov and Chernyak on binary statistical models. If the belief-propagation equation has multiple fixed points, a loop series expansion is performed for the grand partition function. The first term of this series gives the Bethe-Peierls free energy functional at the first-step replica-symmetry-breaking (RSB) level of the mean-field spin-glass theory, and corrections again come only from subgraphs that are free of dangling edges, provided that the auxiliary probability distributions of the expansion are chosen to be a fixed point of the survey-propagation equation. The same loop series expansion can be performed for higher-level partition functions, obtaining the higher-level RSB Bethe-Peierls free energy functionals (and the correction terms) and message-passing equations without using the Bethe-Peierls approximation.

💡 Research Summary

The paper presents a unified framework for expressing the partition function of a very general statistical model defined on an arbitrary graph as a loop series. Unlike earlier works that were limited to binary Ising‑type variables, the authors make no assumptions about the nature of the microscopic state attached to each edge (or vertex): it may be discrete, continuous, vector‑valued, or even a function. Starting from the exact definition of the partition function, they introduce for every edge two auxiliary probability distributions, (q_{i\rightarrow j}(x_{ij})) and (q_{j\rightarrow i}(x_{ij})). By inserting these distributions together with delta‑functions that enforce edge consistency, the partition function is rewritten in a form that naturally separates a product of “1 + Δ” factors, where each Δ encodes the deviation from the auxiliary distributions.

The key step is to choose the auxiliary distributions as fixed points of the belief‑propagation (BP) equations. The BP update rule, \