Nellow AI

This project was made for pure learning purposes. I used Microsoft Phi 2 and cleaned Instagram data to train an AI on my laptop (around 30 epochs).

I trained it on a laptop GPU (Nvidia RTX 3050) for around 2 hours. The first few results were not great, it kept repeating a single word. But as I improved the distillation process, it learned to speak basic words.

Here we can see the early results. The AI is still bad:

After improvements, the AI starts performing better:

It still is nowhere close to being my personal replacement, but in the future maybe it could?