Relative Entropy, Probabilistic Inference and AI

📝 Original Info

• Title: Relative Entropy, Probabilistic Inference and AI
• ArXiv ID: 1304.3423
• Date: 2013-04-15
• Authors: Researchers from original ArXiv paper

📝 Abstract

Various properties of relative entropy have led to its widespread use in information theory. These properties suggest that relative entropy has a role to play in systems that attempt to perform inference in terms of probability distributions. In this paper, I will review some basic properties of relative entropy as well as its role in probabilistic inference. I will also mention briefly a few existing and potential applications of relative entropy to so-called artificial intelligence (AI).

💡 Deep Analysis

Deep Dive into Relative Entropy, Probabilistic Inference and AI.

Various properties of relative entropy have led to its widespread use in information theory. These properties suggest that relative entropy has a role to play in systems that attempt to perform inference in terms of probability distributions. In this paper, I will review some basic properties of relative entropy as well as its role in probabilistic inference. I will also mention briefly a few existing and potential applications of relative entropy to so-called artificial intelligence (AI).

📄 Full Content

Reference