Notifications
Clear all
Topic starter
Is the Tool Agent in AI Agent not yet compatible with Ollama? When I try to force a connection to Ollama Chat Mode, it throws an error: Tools Agent requires a Chat Model that supports Tools calling.
Node type
@callin.io/callin.io-nodes-langchain.agent
Node version
1.5 (Latest version: 1.6)
callin.io version
1.44.0 (Self Hosted)
Posted : 20/06/2024 7:46 am
It appears your topic is missing some crucial details. Could you please provide the following information, if relevant?
- callin.io version:
- Database (default: SQLite):
- callin.io EXECUTIONS_PROCESS setting (default: own, main):
- Running callin.io via (Docker, npm, callin.io cloud, desktop app):
- Operating system:
Posted : 20/06/2024 7:46 am
At present, AI tools are compatible with a limited selection of models.
Posted : 20/06/2024 8:33 am
Topic starter
This seems unusual. The conversation/React agent supports ollama, but the tool agent does not, even though they are within the same AI Agent node.
Posted : 21/06/2024 1:54 am
A few months back, I believe ollama introduced an OpenAI API compatible endpoint to their localhost server.
Have you experimented with using an OpenAI Chat Model node, but modified the base URL to point to the ollama local host URL?
Posted : 21/06/2024 3:22 am
Topic starter
No, this is a different situation. It's unable to connect to the Ollama chat mode node; the connection is unresolvable.
Posted : 27/06/2024 1:42 am
This discussion was automatically closed 90 days following the last response. New responses are no longer permitted.
Posted : 25/09/2024 1:43 am