Tech
** I built a small language model from scratch. Here's how it works.**
I've been building Orin AI (AE-Assistant), a small language-model project designed to run locally on ordinary laptop hardware without a dedicated GPU.
The project explores a decoder-only Transformer, custom BPE tokenization, and experiments with recurrent-depth architectures and retrieval-based grounding.
I made a video walking through the project and showing the model running.
YouTube breakdown:
https://www.youtube.com/watch?v=zraZKknc7LQ
GitHub repository:
https://github...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to