Sorting With Tiny Transformers

See the writeup here. Code in this repo hasn't been cleaned up, but it should be readable.

Requirements

Python 3.9

Name		Name	Last commit message	Last commit date
Latest commit History 11 Commits
.gitattributes		.gitattributes
1300steps.zip		1300steps.zip
LICENSE		LICENSE
README.md		README.md
model_bidirectional.pt		model_bidirectional.pt
model_fixedlength_causal_clipped.pt		model_fixedlength_causal_clipped.pt
model_fixedlength_causal_easy.pt		model_fixedlength_causal_easy.pt
model_fixedlength_causal_hooked.pt		model_fixedlength_causal_hooked.pt
model_fixedlength_causal_normal.pt		model_fixedlength_causal_normal.pt
requirements.txt		requirements.txt
w4--animation.ipynb		w4--animation.ipynb
w4-causal.ipynb		w4-causal.ipynb
w4-clippedcausal.ipynb		w4-clippedcausal.ipynb
w4-easy.ipynb		w4-easy.ipynb
w4-hooked.ipynb		w4-hooked.ipynb
w4_bidirectional.ipynb		w4_bidirectional.ipynb