
LocalLLaMA
pi 0.81.0 adds support for llama.cpp
pi 0.81.0 now has integrated support for llama.cpp (llama-server router). https://pi.dev/docs/latest/llama-cpp This seems to be able to replace the huggingface/pi-llama extension and/or manually managing models in the config. submitted by /u/popoppypoppylovelove [link] [comments]
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit