Talking with your PDFs locally with Blablador and GPT4all
Learn how to use GPT4All to privately chat with your documents locally by integrating Blablador models, ensuring your PDFs never leave your computer.
How to use GPT4ALL to talk privately with your documents and Blablador¶
GPT4All is your private and local Chatbot app. You can use it to talk models running on your own hardware, plus models running on Blablador!
This allows you to have Blablador talk to your PDF files, securely and privately, since the documents never leave your computer.
Prerequisites¶
Download GPT4All
A Blablador Token
Steps¶
Install GPT4all and run it.
Choose "models" on the right side of the screen.
Click in "Add Model"
Choose "OpenAI Compatible"
In API KEY, add Blablador's token as specified above.
In Base URL, add https://api.blablador.fz-juelich.de/v1
In Model Name, add alias-fast, or choose one of the models described in the Blablador's API Access page
That's it! Now you can talk to Blablador directly via GPT4all, and add your documents at the localdocs session on the right side of the screen.