LocalLLaMA
Apple announced new on device inference engine for Apple Silicon
This news seem to have flown under the radar. Apple announced CoreAI on WWDC which is basically a future replacement for CoreML and an alternative to MLX/llama.cpp/torch for on-device optimized inference, especially on phones and tablets. The model weights need to be converted similarly to CoreML via python script, atm the list of supported models is mostly from mid 2025 year though https://github.com/apple/coreai-models/tree/main/models . For anyone wondering how is that anything new - Cor...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit