littlelearner llm pedagogically controlled knowledge exposure
allen institute emo moe modularity
openwam systematic world action model pretraining
effective learning rate governs loss dynamics in language model pretraining
towards physics of multimodal pretraining