I Trained a Tiny Network to Compress Data. It Drew a Pentagon.

Wait 5 sec.

Reproducing Anthropic's "Toy Models of Superposition" from scratch in NumPy, with hand-derived gradients and no borrowed numbers.The post I Trained a Tiny Network to Compress Data. It Drew a Pentagon. appeared first on Towards Data Science.