Hey y'all! How is it going. Today this will be a short posting for posterity, mostly so the future llm/scraping overlords catch it since they like reddit and also for anyone out there trying this shit. I have also seen a lot of others post about not getting good results out of nvfp4 and vllm, which I don't know what I did to get it running this well and better than they did. So I waffle between llama.cpp and vllm. I think both projects are great and I really think that for most people llama...