Skip to content
Custom tool for emb...
 
Notifications
Clear all

Custom tool for embedding and models

1 Posts
1 Users
0 Reactions
6 Views
hakanai
(@hakanai)
Posts: 1
New Member
Topic starter
 

The concept is:

Simply enable the connection of the code tool to the embed and model inputs of AI nodes.

My use case:

This would unlock significantly more functionality. We could invoke any API endpoint, allowing the use of services like together.ai, or other local models beyond Ollama. It would also facilitate result processing, such as reranking.

I believe adding this would be beneficial because:

It would essentially cover all requests for utilizing different services and endpoints. This would allow the development team to concentrate on creating nodes solely for the most popular services.

Any resources to support this?

Are you willing to work on this?

As far as I can tell, all that's needed is to permit the existing code tool to connect to the AI node ports, and provide some documentation detailing the required data format.

 
Posted : 14/12/2024 1:30 am
Share: