Luke Steuber · language model research

Drummer

I trained a small language model from scratch and documented what it learned, where it failed, and what I could measure.

Read the research

The writeup covers the experiments and results. The model card records the architecture, training data, evaluations and limitations.

Read the writeup

Read the model card

Download the weights

The published releases and their documentation remain available on Hugging Face.