Tech
Janas: Run LLMs larger than RAM by streaming experts from SSD
Article URL: https://github.com/prabanta-dev/janas
Comments URL: https://news.ycombinator.com/item?id=50063717
Points: 163
# Comments: 55
Read the full discussion on HackerNews
This article was aggregated from HackerNews. Click to join the conversation.
View on HackerNews