LocalLLaMA
What are ultra-tiny llms used for?
On huggingface i see numerous sub 100m models like SupraLabs/Supra-50M-Instruct and finnianx/michel-tiny , but i really cant imagine a usecase for them. Does anyone here have experience with such tiny llms, or knows of a use case? submitted by /u/Commercial-Okra-8475 [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit
Related Trends in LocalLLaMA
Building an open-source control plane for self-hosted vLLM, what would you want in it?
5090: Windows or Linux for Qwen3.8.27b
RTX Pro 4500 vs. A100 (x4) - purchase being made today
Best llm at understaning middle eastern languages? Arabic/Persian etc
Qwen3.8-27B abliterated FP8: refusal 64β99% β 0β6%, and MMLU/GSM8K move less than 1.3 points
llama.cpp Windows Manager