Mixture Of Experts
MoEs Adding Mixture of Experts support to Karpathy’s NanoGPT, MoE interpretability In progress: July 14, 2025-?
Welcome!
Hi, I’m Henry! Below are some of the things I’ve been up to.
Recent Posts
Open Concept Steering
Open Concept Steering: Building Open-Source SAE Feature Steering for OLMo 2 7B