Notifications

Clear all

How to integrate PDFs with OpenAI (Solution!)

Mit · 2024-06-28T13:23:16Z

Update Jan 2025: Just a quick note to say, I do not have the time to troubleshoot queries, I do not work for callin.io. I created this post for general assistance. I manage my own businesses, which occupies my time. Furthermore, I know there are some excellent community members who are very helpful, and I'm sure they will assist. So if you tag me, I might not respond. Please don't take this personally. I've also stopped using this scenario as my use case has evolved, so I cannot actively test or monitor it. OpenAI and callin.io also implement changes periodically, so things might break or deviate from the instructions below. Please keep this in mind. Original: Okay, after considerable effort, I managed to figure it out, as searching wasn't providing the answers I needed. Hopefully, this guide helps others. In summary: use the OpenAI upload module, but ensure the file name has the correct extension. Then, you need to move this file into a Vector Store that you've already created (you could create one via an API call if you preferred). Then, when you use the OpenAI assistant module, utilize the file search feature. It only functions with GPT-4, and file search specifically works with vector stores.(Accurate as of 28/06/2024) There are a few specific points I learned along the way. The main missing step that took me a while was realizing that when you upload a file, you cannot select which store to save it in. Perhaps this is a feature request for the callin.io team. And if the file isn't in a store, you cannot search within it! image1680×320 55.8 KB In my example, I am looking for new PDF files in a folder on OneDrive. I'm sure this also works for Google Drive and other sources. Step 1: Use HTTP to retrieve the file information. I passed the Download URL in my case. image950×313 39.2 KB Step 2: Use the OpenAI upload module. Set the purpose to Assistants (as this is what we will use later). image649×834 65.7 KB But this is where I made a mistake. Ensure you use mapping and the file name has the correct extension, such as .pdf. You can verify if this works by logging into your storage settings in the OpenAI playgroundFile extensions supported:image810×406 16.4 KB I made this mistake early on and didn't realize it was an issue until later. As you can see if you used the HTTP file name, it ends up like the bottom file in the screenshot above. This causes a problem later when you want to move it, as the file extension is not allowed, i.e., it's 'none'. Step 3: Create JSON to assist with moving the file. This can be skipped as you can input this directly later. image626×380 28.2 KB Step 4: If you don't already have one, create a vector store in OpenAI. [Edit: If you set an expiry date, OpenAI will expire the store and your automation will fail! Therefore, set it to never expire. This also means that as the storage grows, it will cost you more, so ensure you remove files you no longer need!] Copy the ID; you will need it later. image982×229 10.7 KB Step 5: Update Jan 2025: Since writing the below, callin.io has introduced a new module called “Add Files to a Vector Store” which should now eliminate the need for the API call. I will leave the below for reference. Personally, I no longer require this feature, so I cannot effectively test it. Move the file into the vector store by making an OpenAI API call. For the URL, follow this format:Which in callin.io would be: v1/vectorstores/{vectorstoreid}/files So, in the URL, replace the vector store ID with the ID you pasted. (The part in bold). image454×1250 45.7 KB You will need to add the extra header as well. Then, for the body, add the JSON output, or simply paste the code. Which should be the mapped file ID from the OpenAI upload module. json { "file_id":"FILE ID" } You can check if this part works after running by going into your playground store and verifying if the file is present. Step 6: Now you can run your OpenAI assistant. Ensure you have file search enabled (I'm unsure if this step is necessary as there's an option in the OpenAI module, but I had it enabled). image944×521 11.9 KB If you encounter a 404 error, double-check your URL. Step 7: Specify your assistant. In your message, reference the PDF you want it to use. Since your store can accommodate multiple files, you need to indicate which one. In the tools section, ensure file search is enabled. Then, make sure you point to your vector database, either by pasting the ID or manually selecting it by the name you assigned earlier. This will instruct your assistant to search within a specific file and also indicate where this file can be found, i.e., which vector database. image454×1086 57 KB Note: Repeating again: If you set an expiry date for your vector store, OpenAI will expire the store, and your automation will fail! Therefore, set it to never expire. However, this also means that as the storage size increases, the cost will also increase, so make sure to remove files you no longer need! Of course, don't ...

Page 2 / 2 Prev

How To

Last Post by Mit 11 months ago

20 Posts

9 Users

0 Reactions

9 Views

RSS

samliew

(@samliew)

Posts: 293

Reputable Member

No, the file is not generated in step 6. The initial “red line” indicates the assistant ID, which has been redacted. The subsequent “red line” likely represents a private instruction within the prompt that can be excluded.

The file is referenced in step 7 by the vector store it was uploaded to:

Screenshot_2024-07-29_130717

If you have a new question in the future, please start a new thread.

While it might seem convenient to continue an existing thread, creating a new topic is a more effective approach. This helps other community members respond to your query and keeps our forum organized for everyone. Starting a new conversation also increases the likelihood of receiving assistance from others. You can direct others to a related topic by including its link in your question. Thank you for your understanding and for helping maintain our community's tidiness.

The “New Topic” link is located in the top-right corner of the header:

samliew – request private consultation

Join the callin.io Fans Discord server to chat with other makers!

Posted : 29/07/2024 5:14 am

Mit

(@mit)

Posts: 10

Active Member

Topic starter

Samliew's reply is accurate. I've just removed some specific details.

My request was for a client, and I preferred not to share those specifics publicly.

Additionally, as mentioned previously, you'll need to utilize the OpenAI API call to delete the file. The OpenAI platform should offer more details beyond what's already been discussed.

Posted : 29/07/2024 8:18 am

Joost.7AM

(@joost-7am)

Posts: 1

New Member

you can even do it like this:

Schermafbeelding 2024-08-10 om 11.24.38

Use the body id, of the uploaded file.

Posted : 10/08/2024 9:27 am

Attila

(@attila)

Posts: 1

New Member

Thanks a lot for sharing this scenario!

I was able to read PDFs in my callin.io scenarios. Now I am facing a problem: It seems that previous PDFs are getting analyzed, and therefore the output is completely wrong.
How can I ensure only the newest uploaded files are analyzed??

Could it be that I would have to delete all previous files? So, adding the Delete File node mentioned above at the end of my scenario?!

Thanks in advance!

Posted : 16/09/2024 7:19 am

Mit

(@mit)

Posts: 10

Active Member

Topic starter

Glad it helped.

I guess you make it so you specifically reference and name just that file.

In your vector storage, just store that one file. So every time your scenario is completed, it deletes the file. So start with an empty storage, and as part of your scenario, you upload, read, etc., then delete it afterward. This will also mean you don’t end up paying for storage you don’t really need.

Posted : 16/09/2024 8:39 am

Page 2 / 2 Prev

8 Forums
1,441 Topics
8,083 Posts
0 Online
2,387 Members

Forum Icons: Forum contains no unread posts Forum contains unread posts

Topic Icons: Not Replied Replied Active Hot Sticky Unapproved Solved Private Closed