Probabilistic Graphical Models on English AI Terms Dictionary

Product of experts

Sat, 18 Jul 2026 10:11:46 +0000

Definition

The Product of Experts (PoE) is a method for constructing complex probability distributions by combining simpler ones. Unlike the ‘Mixture of Experts,’ which averages probabilities, PoE multiplies them, resulting in a distribution that is zero wherever any single expert assigns zero probability. This creates a more peaked and constrained distribution, effectively requiring all experts to agree on a valid configuration. It is particularly useful in energy-based models and deep learning architectures for capturing intricate dependencies in data, such as image textures or natural language structures.

Conditional Random Field

Sat, 18 Jul 2026 09:51:20 +0000

Definition

Conditional Random Fields (CRFs) are a class of discriminative models commonly used in natural language processing and bioinformatics. Unlike generative models, CRFs directly model the conditional probability of labels given observations, making them effective for tasks where label dependencies are crucial. They are widely employed in part-of-speech tagging, named entity recognition, and gene prediction. CRFs leverage global normalization to consider the entire sequence of labels, improving accuracy over local classification methods.