Welcome!

Hi, I’m Henry! Below are some of the things I’ve been up to. Mostly ML, some other stuff.

Projects

• Variable FlexOlmo
• Variable Sized MoEs
• Open Concept Steering: Building Open-Source SAE Feature Steering for OLMo 2 7B

Work in Progress

• Does the Teacher Matter?
• Pruning OLMo 3 7B
• High Performance Whole Wheat Bread

Notes

• Mixture of Experts
• Width, Depth, Latency, and You