Ivethium
  • Physics
  • Signal Processing
  • Information Theory
  • AI
  • About
Sign in Subscribe

Information Theory

A collection of 1 post
The Profound "Why" Behind Entropy and Logarithms
Information Theory

The Profound "Why" Behind Entropy and Logarithms

I've been staring at this formula for weeks: H(p) = -∑ pᵢ log pᵢ This deceptively simple equation is everywhere—powering the algorithms that compress your Netflix streams, training the AI models that recognize your voice, and measuring how much information you gain from each DNA base pair
23 Jul 2025 4 min read
Page 1 of 1
Ivethium © 2025
  • Signal Processing
  • Physics
  • AI
Powered by Ghost