Training my first language model on a GTX 1650
A 4 GB GPU, a small corpus and a lot of things that went wrong in instructive ways. The story around AI.001, with a few examples of what the model actually produced.
Archive
A 4 GB GPU, a small corpus and a lot of things that went wrong in instructive ways. The story around AI.001, with a few examples of what the model actually produced.
For personal experimental systems I want the first working loop under my control. The cloud comes in after I understand what it's for.
Storing every conversation is easy. Deciding what should still be believed, where it came from and when it should stop mattering is the hard part.