Cannot interact twice with llm after using tool

[dcavadia]

I can't seem to get a response from the brave search. I added a debug to take a look at the payload use in the URL as a String and i get to see that there is the retrieval information from the tool, however when interacting thought the LLM to return the result it trows an error in the second fetch task:

`Enter your prompt (or 'list-tools' or 'quit'): brave web search about venezuela
22:30:14 INFO: LLMBridge - Processing user input...
22:30:14 DEBUG: LLMBridge - Detected tool brave_web_search via keyword: brave web search
22:30:14 INFO: LLMBridge - Detected tool: brave_web_search
22:30:14 DEBUG: LLMBridge - Using tool-specific instructions:
22:30:14 INFO: LLMBridge - Sending message to LLM...
22:30:14 DEBUG: LLMBridge - Starting new Ollama instance...
22:30:14 DEBUG: LLMBridge - Waiting for Ollama to start (attempt 1/10)...
22:30:14 DEBUG: LLMBridge - Ollama stderr:
22:30:14 DEBUG: LLMBridge - Ollama stderr:
22:30:14 DEBUG: LLMBridge - Ollama stderr:
22:30:14 DEBUG: LLMBridge - Ollama stderr:
22:30:14 DEBUG: LLMBridge - Ollama stderr:
22:30:14 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Testing connection to Ollama...
22:30:15 DEBUG: LLMBridge - Ollama stdout:
22:30:15 DEBUG: LLMBridge - Ollama connection test successful:
22:30:15 DEBUG: LLMBridge - Ollama is ready and responding
22:30:15 DEBUG: LLMBridge - Detected tool brave_web_search via keyword: brave web search
22:30:15 DEBUG: LLMBridge - Detected tool from registry: brave_web_search
22:30:15 DEBUG: LLMBridge - Preparing to send prompt: brave web search about venezuela
22:30:15 DEBUG: LLMBridge - Added format schema for tool:
22:30:15 DEBUG: LLMBridge - Schema:
22:30:15 DEBUG: LLMBridge - Preparing Ollama request with payload2:
22:30:15 DEBUG: LLMBridge - Sending request to Ollama...
22:30:15 DEBUG: LLMBridge - USING URL: http://127.0.0.1:11434/api/chat with {"model":"qwen2.5-coder:7b-instruct","messages":[{"role":"system","content":"When using the brave_web_search tool, respond with ONLY this JSON format:\n{\n "name": "brave_web_search",\n "arguments": {\n "query": "search query",\n "count": 1,\n "offset": 1\n},\n "thoughts": "Explanation of why you're using this tool"\n}"},{"role":"user","content":"brave web search about venezuela"}],"stream":false,"options":{"temperature":0.7,"num_predict":1000},"format":{"type":"object","properties":{"name":{"type":"string","const":"brave_web_search"},"arguments":{"type":"object","properties":{"query":{"type":"string","description":"Search query (max 400 chars, 50 words)"},"count":{"type":"number","minimum":1,"maximum":20,"default":10}},"required":["query"]},"thoughts":{"type":"string","description":"Your thoughts about using this tool"}},"required":["name","arguments","thoughts"]}}
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:15 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:16 DEBUG: LLMBridge - Ollama stderr:
22:30:17 DEBUG: LLMBridge - Ollama stderr:
22:30:17 DEBUG: LLMBridge - Ollama stderr:
22:30:17 DEBUG: LLMBridge - Ollama stderr:
22:30:17 DEBUG: LLMBridge - Ollama stderr:
22:30:18 DEBUG: LLMBridge - Ollama stderr:
22:30:20 DEBUG: LLMBridge - Ollama stdout:
22:30:20 DEBUG: LLMBridge - Response received from Ollama, parsing...
22:30:20 DEBUG: LLMBridge - Parsed response:
22:30:20 DEBUG: LLMBridge - Parsed structured tool call:
22:30:20 DEBUG: LLMBridge - Cleaning up Ollama process...
22:30:20 DEBUG: LLMBridge - Starting Ollama cleanup process...
22:30:20 DEBUG: LLMBridge - Attempting to kill Ollama by process name...
22:30:20 DEBUG: LLMBridge - Taskkill output:
22:30:20 DEBUG: LLMBridge - Checking for processes on port 11434...
22:30:20 DEBUG: LLMBridge - Killing process with PID 31796...
22:30:20 DEBUG: LLMBridge - No processes found on port 11434
22:30:22 DEBUG: LLMBridge - Ollama cleanup process completed
22:30:22 INFO: LLMBridge - LLM response received, isToolCall: true
22:30:22 DEBUG: LLMBridge - Raw LLM response:
22:30:22 INFO: LLMBridge - Processing 1 tool calls
22:30:22 DEBUG: LLMBridge - [MCP] Looking up tool name: brave_web_search
22:30:22 INFO: LLMBridge - [MCP] About to call MCP tool: brave_web_search
22:30:22 INFO: LLMBridge - [MCP] Tool arguments prepared: {"query":"information about Venezuela","count":10}
22:30:22 DEBUG: LLMBridge - [MCP Client] Calling tool 'brave_web_search' with args: {"query":"information about Venezuela","count":10}
22:30:22 DEBUG: LLMBridge - [MCP Client] Sending tool call request...
22:30:22 DEBUG: LLMBridge - [MCP Client] Sending message: {"jsonrpc":"2.0","method":"tools/call","params":{"name":"brave_web_search","arguments":{"query":"information about Venezuela","count":10}},"id":4}
22:30:22 INFO: LLMBridge - [MCP] Sending call to MCP...
22:30:23 DEBUG: LLMBridge - [MCP Client] Received raw data: {"result":{"content":[{"type":"text","text":"Title: Venezuela | Economy, Map, Capital, Collapse, & Facts | Britannica\nDescription: Venezuela, country located at the northern end of South America, occupying a roughly triangular area. Venezuela is bounded by the Caribbean Sea and the Atlantic Ocean to the north, Guyana to the east, Brazil to the south, and Colombia to the southwest and west. The national capital is Caracas.\nURL: https://www.britannica.com/place/Venezuela\n\nTitle: Venezuela: Introduction\nDescription: In Venezuela, a meteorological phenomenon where lightning repeatedly strikes, occurs where Catatumbo River and Lake Maracaibo meet. ... How Do I... Locate a variety of international business resources? ... Due to political unrest, the information on these pages may not reflect current conditions ...\nURL: https://globaledge.msu.edu/countries/venezuela\n\nTitle: Venezuela - Wikipedia\nDescription: Venezuela is among the top 20 countries in terms of endemism. Among its animals, 23% of reptilian and 50% of amphibian species, including the Trinidad poison frog, are endemic. Although the available information is still very small, a first effort has been made to estimate the number of fungal ...\nURL: https://en.wikipedia.org/wiki/Venezuela\n\nTitle: Venezuela General Information | Country Profile | Legal Advice | Proelium Law LLP\nDescription: Learn about the country profile of Venezuela, including its capital city Caracas, official language Spanish, religion and currency.\nURL: https://proeliumlaw.com/venezuela-general-information/\n\nTitle: Venezuela - Kids | Britannica Kids | Homework Help\nDescription: Venezuela is a country on the northern coast of South America. In the 1800s Venezuela led the fight for South America’s independence from Spain. The capital of Venezuela is…\nURL: https://kids.britannica.com/kids/article/Venezuela/345816\n\nTitle: Venezuela - United States Department of State\nDescription: In November 2021, during the regional ... users from accessing information about the elections. In January, VE Sin Filtro documented a significant increase in internet blockings targeting media outlets Efecto Cocuyo, Cronica Uno, and EVTV Miami. Venezuela sin Filtro also registered ...\nURL: https://www.state.gov/reports/2022-country-reports-on-human-rights-practices/venezuela/\n\nTitle: MetLink - Royal Meteorological Society Country Background Information: Venezuela -\nDescription: Country Background Information: Venezuela for Climate Negotiations\nURL: https://www.metlink.org/resource/country-background-information-venezuela/\n\nTitle: Venezuela, RB - Summary | Climate Change Knowledge Portal\nDescription: This page presents high-level information for Venezuela, RB's climate zones and its seasonal cycle for mean temperature and precipitation for the latest climatology, 1991-2020. Climate zone classifications are derived from the Köppen-Geiger climate classification system, which divides climates ...\nURL: https://climateknowledgeportal.worldbank.org/country/venezuela-rb\n\nTitle: Venezuela | Culture, Facts & Travel | - CountryReports\nDescription: Venezuela in depth country profile. Unique hard to find content on Venezuela. Includes customs, culture, history, geography, economy current events, photos, video, and more.\nURL: https://www.countryreports.org/country/Venezuela.htm\n\nTitle: Venezuela: the Council's response to the crisis - Consilium\nDescription: To get more information about these cookies, how and why we use them and how you can change your settings, check our cookies policy page. Read more I accept cookies I refuse cookies ... Apart from the sanctions it has introduced since November 2017, the EU also provides humanitarian assistance to support the citizens of Venezuela...\nURL: https://www.consilium.europa.eu/en/policies/venezuela/"}],"isError":false},"jsonrpc":"2.0","id":4}
22:30:23 DEBUG: LLMBridge - [MCP Client] Parsed message: {"result":{"content":[{"type":"text","text":"Title: Venezuela | Economy, Map, Capital, Collapse, & Facts | Britannica\nDescription: Venezuela, country located at the northern end of South America, occupying a roughly triangular area. Venezuela is bounded by the Caribbean Sea and the Atlantic Ocean to the north, Guyana to the east, Brazil to the south, and Colombia to the southwest and west. The national capital is Caracas.\nURL: https://www.britannica.com/place/Venezuela\n\nTitle: Venezuela: Introduction\nDescription: In Venezuela, a meteorological phenomenon where lightning repeatedly strikes, occurs where Catatumbo River and Lake Maracaibo meet. ... How Do I... Locate a variety of international business resources? ... Due to political unrest, the information on these pages may not reflect current conditions ...\nURL: https://globaledge.msu.edu/countries/venezuela\n\nTitle: Venezuela - Wikipedia\nDescription: Venezuela is among the top 20 countries in terms of endemism. Among its animals, 23% of reptilian and 50% of amphibian species, including the Trinidad poison frog, are endemic. Although the available information is still very small, a first effort has been made to estimate the number of fungal ...\nURL: https://en.wikipedia.org/wiki/Venezuela\n\nTitle: Venezuela General Information | Country Profile | Legal Advice | Proelium Law LLP\nDescription: Learn about the country profile of Venezuela, including its capital city Caracas, official language Spanish, religion and currency.\nURL: https://proeliumlaw.com/venezuela-general-information/\n\nTitle: Venezuela - Kids | Britannica Kids | Homework Help\nDescription: Venezuela is a country on the northern coast of South America. In the 1800s Venezuela led the fight for South America’s independence from Spain. The capital of Venezuela is…\nURL: https://kids.britannica.com/kids/article/Venezuela/345816\n\nTitle: Venezuela - United States Department of State\nDescription: In November 2021, during the regional ... users from accessing information about the elections. In January, VE Sin Filtro documented a significant increase in internet blockings targeting media outlets Efecto Cocuyo, Cronica Uno, and EVTV Miami. Venezuela sin Filtro also registered ...\nURL: https://www.state.gov/reports/2022-country-reports-on-human-rights-practices/venezuela/\n\nTitle: MetLink - Royal Meteorological Society Country Background Information: Venezuela -\nDescription: Country Background Information: Venezuela for Climate Negotiations\nURL: https://www.metlink.org/resource/country-background-information-venezuela/\n\nTitle: Venezuela, RB - Summary | Climate Change Knowledge Portal\nDescription: This page presents high-level information for Venezuela, RB's climate zones and its seasonal cycle for mean temperature and precipitation for the latest climatology, 1991-2020. Climate zone classifications are derived from the Köppen-Geiger climate classification system, which divides climates ...\nURL: https://climateknowledgeportal.worldbank.org/country/venezuela-rb\n\nTitle: Venezuela | Culture, Facts & Travel | - CountryReports\nDescription: Venezuela in depth country profile. Unique hard to find content on Venezuela. Includes customs, culture, history, geography, economy current events, photos, video, and more.\nURL: https://www.countryreports.org/country/Venezuela.htm\n\nTitle: Venezuela: the Council's response to the crisis - Consilium\nDescription: To get more information about these cookies, how and why we use them and how you can change your settings, check our cookies policy page. Read more I accept cookies I refuse cookies ... Apart from the sanctions it has introduced since November 2017, the EU also provides humanitarian assistance to support the citizens of Venezuela...\nURL: https://www.consilium.europa.eu/en/policies/venezuela/"}],"isError":false},"jsonrpc":"2.0","id":4}
22:30:23 DEBUG: LLMBridge - [MCP Client] Message success: {"content":[{"type":"text","text":"Title: Venezuela | Economy, Map, Capital, Collapse, & Facts | Britannica\nDescription: Venezuela, country located at the northern end of South America, occupying a roughly triangular area. Venezuela is bounded by the Caribbean Sea and the Atlantic Ocean to the north, Guyana to the east, Brazil to the south, and Colombia to the southwest and west. The national capital is Caracas.\nURL: https://www.britannica.com/place/Venezuela\n\nTitle: Venezuela: Introduction\nDescription: In Venezuela, a meteorological phenomenon where lightning repeatedly strikes, occurs where Catatumbo River and Lake Maracaibo meet. ... How Do I... Locate a variety of international business resources? ... Due to political unrest, the information on these pages may not reflect current conditions ...\nURL: https://globaledge.msu.edu/countries/venezuela\n\nTitle: Venezuela - Wikipedia\nDescription: Venezuela is among the top 20 countries in terms of endemism. Among its animals, 23% of reptilian and 50% of amphibian species, including the Trinidad poison frog, are endemic. Although the available information is still very small, a first effort has been made to estimate the number of fungal ...\nURL: https://en.wikipedia.org/wiki/Venezuela\n\nTitle: Venezuela General Information | Country Profile | Legal Advice | Proelium Law LLP\nDescription: Learn about the country profile of Venezuela, including its capital city Caracas, official language Spanish, religion and currency.\nURL: https://proeliumlaw.com/venezuela-general-information/\n\nTitle: Venezuela - Kids | Britannica Kids | Homework Help\nDescription: Venezuela is a country on the northern coast of South America. In the 1800s Venezuela led the fight for South America’s independence from Spain. The capital of Venezuela is…\nURL: https://kids.britannica.com/kids/article/Venezuela/345816\n\nTitle: Venezuela - United States Department of State\nDescription: In November 2021, during the regional ... users from accessing information about the elections. In January, VE Sin Filtro documented a significant increase in internet blockings targeting media outlets Efecto Cocuyo, Cronica Uno, and EVTV Miami. Venezuela sin Filtro also registered ...\nURL: https://www.state.gov/reports/2022-country-reports-on-human-rights-practices/venezuela/\n\nTitle: MetLink - Royal Meteorological Society Country Background Information: Venezuela -\nDescription: Country Background Information: Venezuela for Climate Negotiations\nURL: https://www.metlink.org/resource/country-background-information-venezuela/\n\nTitle: Venezuela, RB - Summary | Climate Change Knowledge Portal\nDescription: This page presents high-level information for Venezuela, RB's climate zones and its seasonal cycle for mean temperature and precipitation for the latest climatology, 1991-2020. Climate zone classifications are derived from the Köppen-Geiger climate classification system, which divides climates ...\nURL: https://climateknowledgeportal.worldbank.org/country/venezuela-rb\n\nTitle: Venezuela | Culture, Facts & Travel | - CountryReports\nDescription: Venezuela in depth country profile. Unique hard to find content on Venezuela. Includes customs, culture, history, geography, economy current events, photos, video, and more.\nURL: https://www.countryreports.org/country/Venezuela.htm\n\nTitle: Venezuela: the Council's response to the crisis - Consilium\nDescription: To get more information about these cookies, how and why we use them and how you can change your settings, check our cookies policy page. Read more I accept cookies I refuse cookies ... Apart from the sanctions it has introduced since November 2017, the EU also provides humanitarian assistance to support the citizens of Venezuela...\nURL: https://www.consilium.europa.eu/en/policies/venezuela/"}],"isError":false}
22:30:23 DEBUG: LLMBridge - [MCP Client] Tool call response: {"content":[{"type":"text","text":"Title: Venezuela | Economy, Map, Capital, Collapse, & Facts | Britannica\nDescription: Venezuela, country located at the northern end of South America, occupying a roughly triangular area. Venezuela is bounded by the Caribbean Sea and the Atlantic Ocean to the north, Guyana to the east, Brazil to the south, and Colombia to the southwest and west. The national capital is Caracas.\nURL: https://www.britannica.com/place/Venezuela\n\nTitle: Venezuela: Introduction\nDescription: In Venezuela, a meteorological phenomenon where lightning repeatedly strikes, occurs where Catatumbo River and Lake Maracaibo meet. ... How Do I... Locate a variety of international business resources? ... Due to political unrest, the information on these pages may not reflect current conditions ...\nURL: https://globaledge.msu.edu/countries/venezuela\n\nTitle: Venezuela - Wikipedia\nDescription: Venezuela is among the top 20 countries in terms of endemism. Among its animals, 23% of reptilian and 50% of amphibian species, including the Trinidad poison frog, are endemic. Although the available information is still very small, a first effort has been made to estimate the number of fungal ...\nURL: https://en.wikipedia.org/wiki/Venezuela\n\nTitle: Venezuela General Information | Country Profile | Legal Advice | Proelium Law LLP\nDescription: Learn about the country profile of Venezuela, including its capital city Caracas, official language Spanish, religion and currency.\nURL: https://proeliumlaw.com/venezuela-general-information/\n\nTitle: Venezuela - Kids | Britannica Kids | Homework Help\nDescription: Venezuela is a country on the northern coast of South America. In the 1800s Venezuela led the fight for South America’s independence from Spain. The capital of Venezuela is…\nURL: https://kids.britannica.com/kids/article/Venezuela/345816\n\nTitle: Venezuela - United States Department of State\nDescription: In November 2021, during the regional ... users from accessing information about the elections. In January, VE Sin Filtro documented a significant increase in internet blockings targeting media outlets Efecto Cocuyo, Cronica Uno, and EVTV Miami. Venezuela sin Filtro also registered ...\nURL: https://www.state.gov/reports/2022-country-reports-on-human-rights-practices/venezuela/\n\nTitle: MetLink - Royal Meteorological Society Country Background Information: Venezuela -\nDescription: Country Background Information: Venezuela for Climate Negotiations\nURL: https://www.metlink.org/resource/country-background-information-venezuela/\n\nTitle: Venezuela, RB - Summary | Climate Change Knowledge Portal\nDescription: This page presents high-level information for Venezuela, RB's climate zones and its seasonal cycle for mean temperature and precipitation for the latest climatology, 1991-2020. Climate zone classifications are derived from the Köppen-Geiger climate classification system, which divides climates ...\nURL: https://climateknowledgeportal.worldbank.org/country/venezuela-rb\n\nTitle: Venezuela | Culture, Facts & Travel | - CountryReports\nDescription: Venezuela in depth country profile. Unique hard to find content on Venezuela. Includes customs, culture, history, geography, economy current events, photos, video, and more.\nURL: https://www.countryreports.org/country/Venezuela.htm\n\nTitle: Venezuela: the Council's response to the crisis - Consilium\nDescription: To get more information about these cookies, how and why we use them and how you can change your settings, check our cookies policy page. Read more I accept cookies I refuse cookies ... Apart from the sanctions it has introduced since November 2017, the EU also provides humanitarian assistance to support the citizens of Venezuela...\nURL: https://www.consilium.europa.eu/en/policies/venezuela/"}],"isError":false}
22:30:23 INFO: LLMBridge - [MCP] Received response from MCP
22:30:23 DEBUG: LLMBridge - [MCP] Tool result:
22:30:23 INFO: LLMBridge - Tool calls completed, sending results back to LLM
22:30:23 DEBUG: LLMBridge - Added format schema for tool:
22:30:23 DEBUG: LLMBridge - Schema:
22:30:23 DEBUG: LLMBridge - Preparing Ollama request with payload2:
22:30:23 DEBUG: LLMBridge - Sending request to Ollama...
22:30:23 DEBUG: LLMBridge - USING URL: http://127.0.0.1:11434/api/chat with {"model":"qwen2.5-coder:7b-instruct","messages":[{"role":"system","content":"When using the brave_web_search tool, respond with ONLY this JSON format:\n{\n "name": "brave_web_search",\n "arguments": {\n "query": "search query",\n "count": 1,\n "offset": 1\n},\n "thoughts": "Explanation of why you're using this tool"\n}"},{"role":"user","content":"brave web search about venezuela"},{"role":"assistant","content":"I'm using this tool to gather comprehensive information about Venezuela, including its history, current state, economy, and social issues. The count is set to 10 to ensure a variety of sources are considered."},{"role":"tool","content":"Title: Venezuela | Economy, Map, Capital, Collapse, & Facts | Britannica\nDescription: Venezuela, country located at the northern end of South America, occupying a roughly triangular area. Venezuela is bounded by the Caribbean Sea and the Atlantic Ocean to the north, Guyana to the east, Brazil to the south, and Colombia to the southwest and west. The national capital is Caracas.\nURL: https://www.britannica.com/place/Venezuela\n\nTitle: Venezuela: Introduction\nDescription: In Venezuela, a meteorological phenomenon where lightning repeatedly strikes, occurs where Catatumbo River and Lake Maracaibo meet. ... How Do I... Locate a variety of international business resources? ... Due to political unrest, the information on these pages may not reflect current conditions ...\nURL: https://globaledge.msu.edu/countries/venezuela\n\nTitle: Venezuela - Wikipedia\nDescription: Venezuela is among the top 20 countries in terms of endemism. Among its animals, 23% of reptilian and 50% of amphibian species, including the Trinidad poison frog, are endemic. Although the available information is still very small, a first effort has been made to estimate the number of fungal ...\nURL: https://en.wikipedia.org/wiki/Venezuela\n\nTitle: Venezuela General Information | Country Profile | Legal Advice | Proelium Law LLP\nDescription: Learn about the country profile of Venezuela, including its capital city Caracas, official language Spanish, religion and currency.\nURL: https://proeliumlaw.com/venezuela-general-information/\n\nTitle: Venezuela - Kids | Britannica Kids | Homework Help\nDescription: Venezuela is a country on the northern coast of South America. In the 1800s Venezuela led the fight for South America’s independence from Spain. The capital of Venezuela is…\nURL: https://kids.britannica.com/kids/article/Venezuela/345816\n\nTitle: Venezuela - United States Department of State\nDescription: In November 2021, during the regional ... users from accessing information about the elections. In January, VE Sin Filtro documented a significant increase in internet blockings targeting media outlets Efecto Cocuyo, Cronica Uno, and EVTV Miami. Venezuela sin Filtro also registered ...\nURL: https://www.state.gov/reports/2022-country-reports-on-human-rights-practices/venezuela/\n\nTitle: MetLink - Royal Meteorological Society Country Background Information: Venezuela -\nDescription: Country Background Information: Venezuela for Climate Negotiations\nURL: https://www.metlink.org/resource/country-background-information-venezuela/\n\nTitle: Venezuela, RB - Summary | Climate Change Knowledge Portal\nDescription: This page presents high-level information for Venezuela, RB's climate zones and its seasonal cycle for mean temperature and precipitation for the latest climatology, 1991-2020. Climate zone classifications are derived from the Köppen-Geiger climate classification system, which divides climates ...\nURL: https://climateknowledgeportal.worldbank.org/country/venezuela-rb\n\nTitle: Venezuela | Culture, Facts & Travel | - CountryReports\nDescription: Venezuela in depth country profile. Unique hard to find content on Venezuela. Includes customs, culture, history, geography, economy current events, photos, video, and more.\nURL: https://www.countryreports.org/country/Venezuela.htm\n\nTitle: Venezuela: the Council's response to the crisis - Consilium\nDescription: To get more information about these cookies, how and why we use them and how you can change your settings, check our cookies policy page. Read more I accept cookies I refuse cookies ... Apart from the sanctions it has introduced since November 2017, the EU also provides humanitarian assistance to support the citizens of Venezuela...\nURL: https://www.consilium.europa.eu/en/policies/venezuela/","tool_call_id":"call-1742178620176"}],"stream":false,"options":{"temperature":0.7,"num_predict":1000},"format":{"type":"object","properties":{"name":{"type":"string","const":"brave_web_search"},"arguments":{"type":"object","properties":{"query":{"type":"string","description":"Search query (max 400 chars, 50 words)"},"count":{"type":"number","minimum":1,"maximum":20,"default":10}},"required":["query"]},"thoughts":{"type":"string","description":"Your thoughts about using this tool"}},"required":["name","arguments","thoughts"]}}
22:30:23 ERROR: LLMBridge - LLM invocation failed: fetch failed
22:30:23 DEBUG: LLMBridge - Cleaning up Ollama process...
22:30:23 DEBUG: LLMBridge - Starting Ollama cleanup process...
22:30:23 DEBUG: LLMBridge - Attempting to kill Ollama by process name...
22:30:24 DEBUG: LLMBridge - No Ollama process found to kill
22:30:24 DEBUG: LLMBridge - Checking for processes on port 11434...
22:30:24 DEBUG: LLMBridge - Killing process with PID 0...
22:30:24 DEBUG: LLMBridge - No processes found on port 11434
22:30:26 DEBUG: LLMBridge - Ollama cleanup process completed
22:30:26 ERROR: LLMBridge - Error processing message: fetch failed
22:30:26 INFO: LLMBridge - Received response from bridge

Response: Error processing message: fetch failed`

[mfrederico]

• What version of OLLAMA are you running?
• Can you run OLLAMA in debug mode and splat the results here?

HOWTO:

1. Terminate any currently running ollama service.

2. Set the ENV vars (I think it's SET on windows instead of export?):

export OLLAMA_DEBUG="1"; 
export OLLAMA_HOST="0.0.0.0"  

3. Then run the ollama service and it should keep the process in foreground for debugging needs
   ollama serve

[dcavadia]

@mfrederico Im using ollama 0.6.2.

Here is the results from the ollama serve console:

E:\>ollama serve
2025/03/19 16:34:15 routes.go:1230: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:2048 OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\Daniel\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES:]"
time=2025-03-19T16:34:15.070-04:00 level=INFO source=images.go:432 msg="total blobs: 11"
time=2025-03-19T16:34:15.070-04:00 level=INFO source=images.go:439 msg="total unused blobs removed: 0"
time=2025-03-19T16:34:15.072-04:00 level=INFO source=routes.go:1297 msg="Listening on 127.0.0.1:11434 (version 0.6.2)"
time=2025-03-19T16:34:15.072-04:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-03-19T16:34:15.072-04:00 level=INFO source=gpu_windows.go:167 msg=packages count=1
time=2025-03-19T16:34:15.072-04:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=6 efficiency=0 threads=12
time=2025-03-19T16:34:15.247-04:00 level=INFO source=gpu.go:319 msg="detected OS VRAM overhead" id=GPU-b6a48cc0-9b87-f6cc-3143-21662de9983b library=cuda compute=7.5 driver=12.4 name="NVIDIA GeForce RTX 2080 with Max-Q Design" overhead="623.7 MiB"
time=2025-03-19T16:34:15.251-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-b6a48cc0-9b87-f6cc-3143-21662de9983b library=cuda variant=v12 compute=7.5 driver=12.4 name="NVIDIA GeForce RTX 2080 with Max-Q Design" total="8.0 GiB" available="6.9 GiB"
[GIN] 2025/03/19 - 16:35:07 | 200 |      2.1959ms |       127.0.0.1 | GET      "/api/tags"
time=2025-03-19T16:35:07.864-04:00 level=WARN source=ggml.go:149 msg="key not found" key=qwen2.vision.block_count default=0
time=2025-03-19T16:35:07.864-04:00 level=WARN source=ggml.go:149 msg="key not found" key=qwen2.attention.key_length default=128
time=2025-03-19T16:35:07.865-04:00 level=WARN source=ggml.go:149 msg="key not found" key=qwen2.attention.value_length default=128
time=2025-03-19T16:35:07.865-04:00 level=INFO source=sched.go:715 msg="new model will fit in available VRAM in single GPU, loading" model=C:\Users\Daniel\.ollama\models\blobs\sha256-60e05f2100071479f596b964f89f510f057ce397ea22f2833a0cfe029bfc2463 gpu=GPU-b6a48cc0-9b87-f6cc-3143-21662de9983b parallel=4 available=7458521088 required="5.6 GiB"
time=2025-03-19T16:35:07.876-04:00 level=INFO source=server.go:105 msg="system memory" total="31.9 GiB" free="18.2 GiB" free_swap="36.3 GiB"
time=2025-03-19T16:35:07.877-04:00 level=WARN source=ggml.go:149 msg="key not found" key=qwen2.vision.block_count default=0
time=2025-03-19T16:35:07.878-04:00 level=WARN source=ggml.go:149 msg="key not found" key=qwen2.attention.key_length default=128
time=2025-03-19T16:35:07.878-04:00 level=WARN source=ggml.go:149 msg="key not found" key=qwen2.attention.value_length default=128
time=2025-03-19T16:35:07.878-04:00 level=INFO source=server.go:138 msg=offload library=cuda layers.requested=-1 layers.model=29 layers.offload=29 layers.split="" memory.available="[6.9 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.6 GiB" memory.required.partial="5.6 GiB" memory.required.kv="448.0 MiB" memory.required.allocations="[5.6 GiB]" memory.weights.total="3.7 GiB" memory.weights.repeating="3.7 GiB" memory.weights.nonrepeating="426.4 MiB" memory.graph.full="478.0 MiB" memory.graph.partial="730.4 MiB"
llama_model_loader: loaded meta data with 34 key-value pairs and 339 tensors from C:\Users\Daniel\.ollama\models\blobs\sha256-60e05f2100071479f596b964f89f510f057ce397ea22f2833a0cfe029bfc2463 (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = qwen2
llama_model_loader: - kv   1:                               general.type str              = model
llama_model_loader: - kv   2:                               general.name str              = Qwen2.5 Coder 7B Instruct
llama_model_loader: - kv   3:                           general.finetune str              = Instruct
llama_model_loader: - kv   4:                           general.basename str              = Qwen2.5-Coder
llama_model_loader: - kv   5:                         general.size_label str              = 7B
llama_model_loader: - kv   6:                            general.license str              = apache-2.0
llama_model_loader: - kv   7:                       general.license.link str              = https://huggingface.co/Qwen/Qwen2.5-C...
llama_model_loader: - kv   8:                   general.base_model.count u32              = 1
llama_model_loader: - kv   9:                  general.base_model.0.name str              = Qwen2.5 Coder 7B
llama_model_loader: - kv  10:          general.base_model.0.organization str              = Qwen
llama_model_loader: - kv  11:              general.base_model.0.repo_url str              = https://huggingface.co/Qwen/Qwen2.5-C...
llama_model_loader: - kv  12:                               general.tags arr[str,6]       = ["code", "codeqwen", "chat", "qwen", ...
llama_model_loader: - kv  13:                          general.languages arr[str,1]       = ["en"]
llama_model_loader: - kv  14:                          qwen2.block_count u32              = 28
llama_model_loader: - kv  15:                       qwen2.context_length u32              = 32768
llama_model_loader: - kv  16:                     qwen2.embedding_length u32              = 3584
llama_model_loader: - kv  17:                  qwen2.feed_forward_length u32              = 18944
llama_model_loader: - kv  18:                 qwen2.attention.head_count u32              = 28
llama_model_loader: - kv  19:              qwen2.attention.head_count_kv u32              = 4
llama_model_loader: - kv  20:                       qwen2.rope.freq_base f32              = 1000000.000000
llama_model_loader: - kv  21:     qwen2.attention.layer_norm_rms_epsilon f32              = 0.000001
llama_model_loader: - kv  22:                          general.file_type u32              = 15
llama_model_loader: - kv  23:                       tokenizer.ggml.model str              = gpt2
llama_model_loader: - kv  24:                         tokenizer.ggml.pre str              = qwen2
llama_model_loader: - kv  25:                      tokenizer.ggml.tokens arr[str,152064]  = ["!", "\"", "#", "$", "%", "&", "'", ...
llama_model_loader: - kv  26:                  tokenizer.ggml.token_type arr[i32,152064]  = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
llama_model_loader: - kv  27:                      tokenizer.ggml.merges arr[str,151387]  = ["Ġ Ġ", "ĠĠ ĠĠ", "i n", "Ġ t",...
llama_model_loader: - kv  28:                tokenizer.ggml.eos_token_id u32              = 151645
llama_model_loader: - kv  29:            tokenizer.ggml.padding_token_id u32              = 151643
llama_model_loader: - kv  30:                tokenizer.ggml.bos_token_id u32              = 151643
llama_model_loader: - kv  31:               tokenizer.ggml.add_bos_token bool             = false
llama_model_loader: - kv  32:                    tokenizer.chat_template str              = {%- if tools %}\n    {{- '<|im_start|>...
llama_model_loader: - kv  33:               general.quantization_version u32              = 2
llama_model_loader: - type  f32:  141 tensors
llama_model_loader: - type q4_K:  169 tensors
llama_model_loader: - type q6_K:   29 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type   = Q4_K - Medium
print_info: file size   = 4.36 GiB (4.91 BPW)
load: special tokens cache size = 22
load: token to piece cache size = 0.9310 MB
print_info: arch             = qwen2
print_info: vocab_only       = 1
print_info: model type       = ?B
print_info: model params     = 7.62 B
print_info: general.name     = Qwen2.5 Coder 7B Instruct
print_info: vocab type       = BPE
print_info: n_vocab          = 152064
print_info: n_merges         = 151387
print_info: BOS token        = 151643 '<|endoftext|>'
print_info: EOS token        = 151645 '<|im_end|>'
print_info: EOT token        = 151645 '<|im_end|>'
print_info: PAD token        = 151643 '<|endoftext|>'
print_info: LF token         = 198 'Ċ'
print_info: FIM PRE token    = 151659 '<|fim_prefix|>'
print_info: FIM SUF token    = 151661 '<|fim_suffix|>'
print_info: FIM MID token    = 151660 '<|fim_middle|>'
print_info: FIM PAD token    = 151662 '<|fim_pad|>'
print_info: FIM REP token    = 151663 '<|repo_name|>'
print_info: FIM SEP token    = 151664 '<|file_sep|>'
print_info: EOG token        = 151643 '<|endoftext|>'
print_info: EOG token        = 151645 '<|im_end|>'
print_info: EOG token        = 151662 '<|fim_pad|>'
print_info: EOG token        = 151663 '<|repo_name|>'
print_info: EOG token        = 151664 '<|file_sep|>'
print_info: max token length = 256
llama_model_load: vocab only - skipping tensors
time=2025-03-19T16:35:08.159-04:00 level=INFO source=server.go:405 msg="starting llama server" cmd="C:\\Users\\Daniel\\AppData\\Local\\Programs\\Ollama\\ollama.exe runner --model C:\\Users\\Daniel\\.ollama\\models\\blobs\\sha256-60e05f2100071479f596b964f89f510f057ce397ea22f2833a0cfe029bfc2463 --ctx-size 8192 --batch-size 512 --n-gpu-layers 29 --threads 6 --no-mmap --parallel 4 --port 49936"
time=2025-03-19T16:35:08.163-04:00 level=INFO source=sched.go:450 msg="loaded runners" count=1
time=2025-03-19T16:35:08.164-04:00 level=INFO source=server.go:580 msg="waiting for llama runner to start responding"
time=2025-03-19T16:35:08.164-04:00 level=INFO source=server.go:614 msg="waiting for server to become available" status="llm server error"
time=2025-03-19T16:35:08.194-04:00 level=INFO source=runner.go:846 msg="starting go runner"
ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
ggml_cuda_init: found 1 CUDA devices:
  Device 0: NVIDIA GeForce RTX 2080 with Max-Q Design, compute capability 7.5, VMM: yes
load_backend: loaded CUDA backend from C:\Users\Daniel\AppData\Local\Programs\Ollama\lib\ollama\cuda_v12\ggml-cuda.dll
load_backend: loaded CPU backend from C:\Users\Daniel\AppData\Local\Programs\Ollama\lib\ollama\ggml-cpu-haswell.dll
time=2025-03-19T16:35:08.308-04:00 level=INFO source=ggml.go:109 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(clang)
time=2025-03-19T16:35:08.309-04:00 level=INFO source=runner.go:906 msg="Server listening on 127.0.0.1:49936"
llama_model_load_from_file_impl: using device CUDA0 (NVIDIA GeForce RTX 2080 with Max-Q Design) - 7113 MiB free
time=2025-03-19T16:35:08.416-04:00 level=INFO source=server.go:614 msg="waiting for server to become available" status="llm server loading model"
llama_model_loader: loaded meta data with 34 key-value pairs and 339 tensors from C:\Users\Daniel\.ollama\models\blobs\sha256-60e05f2100071479f596b964f89f510f057ce397ea22f2833a0cfe029bfc2463 (version GGUF V3 (latest))
llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
llama_model_loader: - kv   0:                       general.architecture str              = qwen2
llama_model_loader: - kv   1:                               general.type str              = model
llama_model_loader: - kv   2:                               general.name str              = Qwen2.5 Coder 7B Instruct
llama_model_loader: - kv   3:                           general.finetune str              = Instruct
llama_model_loader: - kv   4:                           general.basename str              = Qwen2.5-Coder
llama_model_loader: - kv   5:                         general.size_label str              = 7B
llama_model_loader: - kv   6:                            general.license str              = apache-2.0
llama_model_loader: - kv   7:                       general.license.link str              = https://huggingface.co/Qwen/Qwen2.5-C...
llama_model_loader: - kv   8:                   general.base_model.count u32              = 1
llama_model_loader: - kv   9:                  general.base_model.0.name str              = Qwen2.5 Coder 7B
llama_model_loader: - kv  10:          general.base_model.0.organization str              = Qwen
llama_model_loader: - kv  11:              general.base_model.0.repo_url str              = https://huggingface.co/Qwen/Qwen2.5-C...
llama_model_loader: - kv  12:                               general.tags arr[str,6]       = ["code", "codeqwen", "chat", "qwen", ...
llama_model_loader: - kv  13:                          general.languages arr[str,1]       = ["en"]
llama_model_loader: - kv  14:                          qwen2.block_count u32              = 28
llama_model_loader: - kv  15:                       qwen2.context_length u32              = 32768
llama_model_loader: - kv  16:                     qwen2.embedding_length u32              = 3584
llama_model_loader: - kv  17:                  qwen2.feed_forward_length u32              = 18944
llama_model_loader: - kv  18:                 qwen2.attention.head_count u32              = 28
llama_model_loader: - kv  19:              qwen2.attention.head_count_kv u32              = 4
llama_model_loader: - kv  20:                       qwen2.rope.freq_base f32              = 1000000.000000
llama_model_loader: - kv  21:     qwen2.attention.layer_norm_rms_epsilon f32              = 0.000001
llama_model_loader: - kv  22:                          general.file_type u32              = 15
llama_model_loader: - kv  23:                       tokenizer.ggml.model str              = gpt2
llama_model_loader: - kv  24:                         tokenizer.ggml.pre str              = qwen2
llama_model_loader: - kv  25:                      tokenizer.ggml.tokens arr[str,152064]  = ["!", "\"", "#", "$", "%", "&", "'", ...
llama_model_loader: - kv  26:                  tokenizer.ggml.token_type arr[i32,152064]  = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
llama_model_loader: - kv  27:                      tokenizer.ggml.merges arr[str,151387]  = ["Ġ Ġ", "ĠĠ ĠĠ", "i n", "Ġ t",...
llama_model_loader: - kv  28:                tokenizer.ggml.eos_token_id u32              = 151645
llama_model_loader: - kv  29:            tokenizer.ggml.padding_token_id u32              = 151643
llama_model_loader: - kv  30:                tokenizer.ggml.bos_token_id u32              = 151643
llama_model_loader: - kv  31:               tokenizer.ggml.add_bos_token bool             = false
llama_model_loader: - kv  32:                    tokenizer.chat_template str              = {%- if tools %}\n    {{- '<|im_start|>...
llama_model_loader: - kv  33:               general.quantization_version u32              = 2
llama_model_loader: - type  f32:  141 tensors
llama_model_loader: - type q4_K:  169 tensors
llama_model_loader: - type q6_K:   29 tensors
print_info: file format = GGUF V3 (latest)
print_info: file type   = Q4_K - Medium
print_info: file size   = 4.36 GiB (4.91 BPW)
load: special tokens cache size = 22
load: token to piece cache size = 0.9310 MB
print_info: arch             = qwen2
print_info: vocab_only       = 0
print_info: n_ctx_train      = 32768
print_info: n_embd           = 3584
print_info: n_layer          = 28
print_info: n_head           = 28
print_info: n_head_kv        = 4
print_info: n_rot            = 128
print_info: n_swa            = 0
print_info: n_embd_head_k    = 128
print_info: n_embd_head_v    = 128
print_info: n_gqa            = 7
print_info: n_embd_k_gqa     = 512
print_info: n_embd_v_gqa     = 512
print_info: f_norm_eps       = 0.0e+00
print_info: f_norm_rms_eps   = 1.0e-06
print_info: f_clamp_kqv      = 0.0e+00
print_info: f_max_alibi_bias = 0.0e+00
print_info: f_logit_scale    = 0.0e+00
print_info: n_ff             = 18944
print_info: n_expert         = 0
print_info: n_expert_used    = 0
print_info: causal attn      = 1
print_info: pooling type     = 0
print_info: rope type        = 2
print_info: rope scaling     = linear
print_info: freq_base_train  = 1000000.0
print_info: freq_scale_train = 1
print_info: n_ctx_orig_yarn  = 32768
print_info: rope_finetuned   = unknown
print_info: ssm_d_conv       = 0
print_info: ssm_d_inner      = 0
print_info: ssm_d_state      = 0
print_info: ssm_dt_rank      = 0
print_info: ssm_dt_b_c_rms   = 0
print_info: model type       = 7B
print_info: model params     = 7.62 B
print_info: general.name     = Qwen2.5 Coder 7B Instruct
print_info: vocab type       = BPE
print_info: n_vocab          = 152064
print_info: n_merges         = 151387
print_info: BOS token        = 151643 '<|endoftext|>'
print_info: EOS token        = 151645 '<|im_end|>'
print_info: EOT token        = 151645 '<|im_end|>'
print_info: PAD token        = 151643 '<|endoftext|>'
print_info: LF token         = 198 'Ċ'
print_info: FIM PRE token    = 151659 '<|fim_prefix|>'
print_info: FIM SUF token    = 151661 '<|fim_suffix|>'
print_info: FIM MID token    = 151660 '<|fim_middle|>'
print_info: FIM PAD token    = 151662 '<|fim_pad|>'
print_info: FIM REP token    = 151663 '<|repo_name|>'
print_info: FIM SEP token    = 151664 '<|file_sep|>'
print_info: EOG token        = 151643 '<|endoftext|>'
print_info: EOG token        = 151645 '<|im_end|>'
print_info: EOG token        = 151662 '<|fim_pad|>'
print_info: EOG token        = 151663 '<|repo_name|>'
print_info: EOG token        = 151664 '<|file_sep|>'
print_info: max token length = 256
load_tensors: loading model tensors, this can take a while... (mmap = false)
load_tensors: offloading 28 repeating layers to GPU
load_tensors: offloading output layer to GPU
load_tensors: offloaded 29/29 layers to GPU
load_tensors:          CPU model buffer size =   292.36 MiB
load_tensors:        CUDA0 model buffer size =  4168.09 MiB
llama_init_from_model: n_seq_max     = 4
llama_init_from_model: n_ctx         = 8192
llama_init_from_model: n_ctx_per_seq = 2048
llama_init_from_model: n_batch       = 2048
llama_init_from_model: n_ubatch      = 512
llama_init_from_model: flash_attn    = 0
llama_init_from_model: freq_base     = 1000000.0
llama_init_from_model: freq_scale    = 1
llama_init_from_model: n_ctx_per_seq (2048) < n_ctx_train (32768) -- the full capacity of the model will not be utilized
llama_kv_cache_init: kv_size = 8192, offload = 1, type_k = 'f16', type_v = 'f16', n_layer = 28, can_shift = 1
llama_kv_cache_init:      CUDA0 KV buffer size =   448.00 MiB
llama_init_from_model: KV self size  =  448.00 MiB, K (f16):  224.00 MiB, V (f16):  224.00 MiB
llama_init_from_model:  CUDA_Host  output buffer size =     2.38 MiB
llama_init_from_model:      CUDA0 compute buffer size =   492.00 MiB
llama_init_from_model:  CUDA_Host compute buffer size =    23.01 MiB
llama_init_from_model: graph nodes  = 986
llama_init_from_model: graph splits = 2
time=2025-03-19T16:35:09.919-04:00 level=INFO source=server.go:619 msg="llama runner started in 1.75 seconds"
[GIN] 2025/03/19 - 16:35:11 | 200 |    3.5781591s |       127.0.0.1 | POST     "/api/chat"

[mfrederico]

Ok so that doesn't show ollama crashing, I suppose now keep the ollama console up and see what (if any) error messages pop up. It looks like something posted to the /api/chat endpoint but I don't see anything after that?

Something that I had to do with the latest ollama on a differet project is change the uri from /api/chat to /api/generate