Let's reproduce GPT-2 (124M)
7 experts are actively discussing the implications.
“Honestly, the easiest thing is to fire up Clade Code in a directory, and tell it you want a gpt-2 size model to train. It will walk you through the whole thing Also Karpathy 🙌 has a video here that walks through it www.youtube.com/watch?v=l8pR...”