Unable to use Ollama models - Adding chat/completions to URL #436

Activity

1. clickbrain

   changed the title [-]Unable to use Ollama models - Affing chat/completions to URL[/-] [+]Unable to use Ollama models - Adding chat/completions to URL[/+] on Nov 7, 2024
2. jaimedevelop commented on Nov 29, 2024

   

   jaimedevelop

   on Nov 29, 2024

   More actions

   It happens the same to me. Ollama runs but somehow srcbook cannot get the models. I have srcbook running through WSL on windows.
3. clickbrain commented on Jan 2, 2025

   

   clickbrain

   on Jan 2, 2025

   Author

   More actions

   Thought I would check in on this again to see if there is a workaround.
4. nichochar commented on Jan 19, 2025

   

   nichochar

   on Jan 19, 2025

   Contributor

   More actions

   We're using the ai SDK for ollama so I'm surprised this is happening. Can you share more about the configuration in settings and the logs you're seeing?
5. abraganu-ryestrategy commented on Feb 24, 2025

   

   abraganu-ryestrategy

   on Feb 24, 2025

   Last edited by abraganu-ryestrategy

   More actions

   I'm having the same problem and it seems that the error is trying to reach this endpoint http://127.0.0.1:11434/api/chat/completions instead of this http://127.0.0.1:11434/api/chat my configuration is next

   

   But srcbook keep adding the completions word at the end of the url

   This is the error in the console

   APICallError [AI_APICallError]: Not Found
       {
     cause: undefined,
     url: 'http://127.0.0.1:11434/api/chat/completions',
     requestBodyValues: {
       model: 'mistral-nemo',
       logit_bias: undefined,
       logprobs: undefined,
       top_logprobs: undefined,
       user: undefined,
       parallel_tool_calls: undefined,
       max_tokens: undefined,
       temperature: 0,
       top_p: undefined,
       frequency_penalty: undefined,
       presence_penalty: undefined,
       stop: undefined,
       seed: undefined,
       response_format: undefined,
       messages: [ [Object], [Object] ],
       tools: undefined,
       tool_choice: undefined
     },
     statusCode: 404,
     responseHeaders: {
       'content-length': '18',
       'content-type': 'text/plain',
       date: 'Mon, 24 Feb 2025 00:38:02 GMT'
     },
     responseBody: '404 page not found',
     isRetryable: false,
     data: undefined,
     [Symbol(vercel.ai.error)]: true,
     [Symbol(vercel.ai.error.AI_APICallError)]: true
   }