Hey Everyone, here is an update on MTPLX! One month after releasing MTPLX V1 which brought a swift based app and upgraded CLI for coding use I am happy to announce MTPLX V2. The biggest change is Turbo Mode: using custom verify-specialized quantized-matmul kernels plus a compiled verify step we have achieved 82 TPS on a Macbook pro m5 max at a temperature of 0.6 We also released significant changes to SSD KV cache and long context tool calling improvements. here are the preliminary be...