Tech
I Tried Needle2 for Local Tool Calling. I Ended Up With llama.cpp + Granite
I’ve been working on a small experiment around a semantic shell.
The basic idea is that the user types something like:
copy report.pdf to backup
and a small local model maps that to a known tool:
filesystem.copy
The shell then takes over. It validates arguments, asks for missing ones, shows confirmation UI when needed, and finally executes the operation.
The model is not supposed to generate shell commands. It only needs to understand intent.
That sou...
Read the full discussion on Dev.to
This article was aggregated from Dev.to. Click to join the conversation.
View on Dev.to