I’ve recently learned about neuromorphic computing while thinking about the core inefficiencies of current deep learning. Today AI relies heavily on super-dense layers, continuous computation of all layers and neurons at all times, and global backpropagation to find optimal weight updates. But when you look at the human brain, none of that happens. The brain operates on principles that stand in contrast to modern LLMs: - Local Evolution: Neurons are largely independent, evolving based on their l...