TrendPulse

Hi. DeepSeek v4 Pro has 1.6T parameters, probably the largest in open models, or at least one of the largest. Yet it's not the best/most performance open model, considering a wide variety of definitions of "best". Indeed, in most cases, it is not the second best, third best, or fourth best either. GLM 5.1 with 750B parameters is less than half the size of it, but is considered by many "an opus" in open models. So is Kimi K2.6, with 1T models, still far less than 1.T of...

Hello everyone, some of you may have seen a post of mine from a few days ago about my app, llama-launcher , a lightweight point-and-click GUI to create llama-server commands without the constant need for typing them up. Well, I've just added an optimisation feature that uses Tree-Structured Parzen estimation through optuna's framework. It uses llama-server to tune a pre-determined set of parameters to try to squeeze the last bit of juice out of your system, completely hands-free. I've been usin...

SupraLabs just released the Supra-1.5-exp line, Base, Instruct, and GGUF! (Reasoning soon) Hey r/LocalLLaMA ! We are releasing the experimental Supra-1.5-50M family today: a new Base model with 5x the context window of the original Supra-50M, an Instruct fine-tune on top of it, and a GGUF quantized version ready to run anywhere. 🤗 Supra-1.5-50M-Base-exp | 🤗 Supra-1.5-50M-Instruct-exp | 🤗 GGUF | Supra1.5 50M Instruct Demo These are experimental releases. Part of Project Chimera. ...

Hey all, I've been seeing more interest in an LLM torrent site recently. I used to run https://stablebay.org for t2i models, but it's down for now. Would anyone be interested in having it rebuilt for LLMs and other models in general? I'd be open to collaboration.

Feelsbadman.jpeg Once you've tasted 4x GPUs and almost BF16 models with BF16 KV cache you can't go back 😞. AND IT'S THE WEEKEND OH MAN.

Still uploading for now: https://huggingface.co/unsloth/Kimi-K2.7-Code-GGUF

https://reddit.com/link/1u4lk5c/video/kyhdw0uog07h1/player Links: Blog: https://zyphra.com/our-work/zonos2 Weights: https://huggingface.co/Zyphra/ZONOS2 Inference code: https://github.com/Zyphra/ZONOS2 Eval code: https://github.com/Zyphra/ZTTS1-Eval Model TTSDS Prosody Score ↑ ZONOS2 8B 88.7 Qwen 3 TTS 1.7B 87.6 Inworld TTS 2 87.5 Cartesia Sonic 3.5 87.1 Fish S2 Pro 86.6 VoxCPM 2 86.3 Gemini 3.1 Flash ...

If you’re trying to download and preserve your local LLMs in case of future availability issues due to AI-related politics, your best bet is either 128gb or 100gb Blu-Ray optical disks, more specifically BD-R XL M-DISC standard format which are archival-grade and built to last for like 10 of our lifetimes. And yes, cheap USB thumb drives are the other option, but they are considered volatile storage and could be affected by static discharge and other electrical issues. So if you’re worried a...

Quick initial impressions: - at 70 tok/s slower than GLM 5.1 - seems to spend more time reasoning - better results with my Pac-Man test The one-shot result is almost functional; apart from the ghosts getting stuck immediately after leaving the ghosts house, I did not notice any other obvious bug. Everything else seems to function much better than any of the other models I tried, and the game is more complete. This ranks it in first place . Second place is Qwen 3.6 27b. You can test th...

Don’t be surprised . Prepare yourself. This could happen anytime. There’s a bigger strategy here than just Fable5

The model now supports a 1M context window and two thinking modes: max and high. z.ai recommends using max for coding. Vote on X What should we prioritize most? Longer context window MIT-licensed open weights No price increase Other links: GLM 5.2 announcement LLM Benchmark Dashboard AICodeKing GLM 5.2 Benchmark Results and Thoughts (X) AICodeKing GLM 5.2 Benchmark Results and Thoughts (YouTube Video) [li...

I've been using Pi with Qwen3.6-27B a lot as my daily driver for more than a month and this setup almost replaced Codex/CC for me entirely. I use it with the advisor extension, with the advisor usually being GPT-5.5 and it has been great for me so far. I sometimes use OpenCode too but I keep coming back to this setup especially for local models. Support for seamlessly onboarding local models Custom footer that shows token usage, cost and inference speed 10 themes Many useful+cosmetic...

title

The only cost is electricity! I built this in a few weeks since I couldn't find anything else like it. Demo: https://pdufour.github.io/browser-use-wasm/ Source Code: https://github.com/pdufour/browser-use-wasm One thing I've wanted to do for a while was add a widget to my page that allowed me to control the complete webpage just like any of the browser-use agents can. The key distinction is I wanted it to be fully self-contained, no serve involved. After a few weeks of tinkering I hav...

Im talking about posts that sound schizophrenic absolute nonsense but its clear that it was pasted from ai with the structure of it and em dashes

https://huggingface.co/datasets/Glint-Research/Fable-5-traces A simple dataset of all the Fable 5 data we could get our hands on before it was taken away (no clue if it's coming back). Expect some fine-tuned models trained on this soon. Big thanks to the TeichAI team (weird thanking myself, lol) for providing 953 traces, while I added the CoT data. Have fun with this!

I have been using Kimi K2.6 in Kimi Code for a while. Although it can complete most tasks, it often requires a long time to think and try. Today the model's CoT has become very short and concise, and it feels much improved on coding tasks compared to before I heard that GLM 5.2 is also about to be released. I hope Chinese models can continue to be open-sourced to compete with Fable 5

Ultra-long-context capability is becoming indispensable for frontier LLMs: agentic workflows, repository-scale code reasoning, and persistent memory all require the model to jointly attend over hundreds of thousands to millions of tokens, yet the quadratic cost of softmax attention makes this untenable at deployment scale. We introduce MiniMax Sparse Attention (MSA), a blockwise sparse attention built upon Grouped Query Attention (GQA). A lightweight Index Branch scores key-value blocks and inde...

Still being uploaded for now: https://huggingface.co/unsloth/MiniMax-M3-GGUF

On huggingface i see numerous sub 100m models like SupraLabs/Supra-50M-Instruct and finnianx/michel-tiny , but i really cant imagine a usecase for them. Does anyone here have experience with such tiny llms, or knows of a use case?

Anthropic just nuked Fable 5 globally to comply with a sudden US export ban because they couldn't instantly verify the nationality of their cloud users. Let this be a massive reminder to the community: if the weights aren't running on your own hardware, you don't actually control your AI. Cloud APIs mean renting intelligence at the mercy of corporate compliance and government panic. They will happily take your data and pull the plug the second a model gets "too capable." Keep buying ...

https://github.com/ggml-org/llama.cpp/pull/23871 In practice, this means the llama-server UI can now behave more like a native app: installable to your desktop/home screen, standalone window mode, proper icons etc. The PWA work is about making the built-in web interface more app-like, faster to reopen, and more robust around updates/caching. Nice quality-of-life upgrade.

🔥PaddleOCR’s new OCR model series scales from 1.5M to 34.5M parameters, bringing stronger accuracy, faster inference, and broader deployment options — from browsers and edge devices to servers. 📊What’s new: 🔸Tiny / Small / Medium models: 1.5M, 7.7M, 34.5M params 🔸+4.9% detection accuracy and +5.1% recognition accuracy over PP-OCRv5 🔸Up to 5.2× faster CPU inference with OpenVINO 🔸50 languages in one unified model 🔸New scenarios: PCB, CAD drawings, digital tubes, dot-matrix text 🔸Apache 2.0 open...

https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B A qwen finetune. Looks pretty even with qwen 3.7 plus, except it's actually open source. Disclosure: I work as a researcher for the city government of Rio de Janeiro, which developed this model.

EDIT: Added the ability to use any open ai compatible endpoint per many requests! I wanted AI Dungeon but fully local and actually private, so I built it. The narrator is Gemma 4 (QAT Q4) through Ollama, and when a scene is worth showing it draws the picture too, locally, with FLUX. No API keys, no cloud, nothing leaves your machine. The part that surprised me: you can run the 12B at its full 256k context and it still only sits around 7.7GB of RAM, because Gemma 4 barely grows the KV cache. ...

The scaffold uses ~25-40x more compute on the original baseline model to attempt the same problem. I put it into max mode by setting the branches exploration breadth to 5, iterative corrections loop depth to 10 and 6 branch aware selective hypothesis that are revised after every 2 iterations. These hypotheses tests various claims, local speedups or completely different algorithmic designs independently and are selectively injected in a specific branch context. The most useful component of this e...

Was just thinking about this due to recent events. Hugging Face is a US-based company, legally incorporated as Hugging Face, Inc. with its official headquarters located in Brooklyn, New York. It seems like a pretty big single point of failure for local models. Maybe a distributed network mirror of models would be a good backup.. you know.. just in case. I know other counties could host models.. but distributed seems safest.. what do you guys think?

At the Huawei Developer Conference (HDC 2026) held on June 12, Richard Yu, Executive Director of Huawei, officially launched the brand-new, open-source Pangu large model—openPangu 2.0. The model is fully adapted to the HarmonyOS ecosystem and has achieved deep optimization and performance breakthroughs on Ascend computing power. openPangu 2.0 features a 512K context processing capability and comes in two versions tailored for different application scenarios. It sets a record for the largest sp...