JittalSLM
In developmentEducational Small Language Model
A small language model built to learn how language models work.
JittalSLM was built for education — mine first. Building a small model end to end is the best way to understand what the big ones are doing.
It's the groundwork behind Lite.