Fit a 68M model in the space of a 17M one
Two packing rules, a 4-bit token table and int8 matrices with one scale per column, cut small transformers to a fifth or a sixth of their size with no measured accuracy loss. Code, numbers, and the cuts that went too far.
