Tech
Janas: Run LLMs larger than RAM by streaming experts from SSD
Article URL: https://github.com/prabanta-dev/janas
Comments URL: https://news.ycombinator.com/item?id=50063717
Points: 163
# Comments: 55
Read the full discussion on HackerNews
This article was aggregated from HackerNews. Click to join the conversation.
View on HackerNews
Related Trends in Tech
348 Blog Posts To Learn About Facebook
AI Coding Tip 040 - Ask the AI to List Where Your Prompts and Skills Contradict Each Other
How to Avoid Recruitment Crypto Scams
The Bybit $1.46 Billion Hack Shows Why Tracing Stolen Crypto Is Only Half the Battle
I Built an End-to-End Enterprise Intelligence Simulation to Answer One Question
Your CRM Is Feeding AI Agents Mutually Exclusive Truths