Addressing the Affordability Gap in the GTA.md
1. What happened
Installed a local LLM (phi4-mini:latest) to check how well it performs on vault-related tasks. Prior to testing phi4 in VO, I tested it in CLI, running via ollama. The input document was the same for all 3 tests. It performed passably.
| Model |
Test 2 Input (CLI): "Read the following text. Output only the requested three items: 1. a one-sentence summary, 2. three keywords, 3. one suggested filename in lowercase kebab-case. Do not add commentary or explanation." |
Vault Operator + Phi4 | Prompt (Obsidian): What 3 keywords describe this document? |
Vault Operator + Phi4 (Obsidian): What 3 keywords describe the contents of this document? |
| Phi4 |
1. Proposing rights of first refusal for affordable housing developments in the GTA to non-profit organizations. 2. Affordable housing, rights of first refusal, GTA. 3. rights-first-refusal-gta-affordable-housing. |
The three keywords that describe this document are: 1. Markdown 2. Personal Knowledge Management 3. Project Documentation |
The three keywords that describe the contents of this document are:1. Personal Knowledge Management2. Career Change3. Housing Affordability in the GTA |
| Assessmet |
Decent, though it missed the sub heading "Land Gifts" |
|
|
2. What you expected
A response that resembled the CLI response.
3. Steps to reproduce
- With Ollama and
phi4-mini:latest running locally, open the attached .md document in a new tab.
- Vault Operator should have no custom instructions or agents and the setup should have it pointed to a locally running LLM model (phi4-mini)
- Open the Vault Operator sidebar, type in the prompt "What 3 keywords describe this document?"
- Observe the model/plugin response.
4. Technical setup
- Operating system and version: Windows 11 Pro, 25H2
- Obsidian version: 1.13.7
- Vault Operator version: v3.8.1
- Installer type: regular install
- AI provider in use: Ollama,
phi4-mini:latest
- Local only vault
- Embedding model:
nomic-embed-text, embedding task completed before the above bug
Addressing the Affordability Gap in the GTA.md
1. What happened
Installed a local LLM (
phi4-mini:latest) to check how well it performs on vault-related tasks. Prior to testing phi4 in VO, I tested it in CLI, running via ollama. The input document was the same for all 3 tests. It performed passably.2. What you expected
A response that resembled the CLI response.
3. Steps to reproduce
phi4-mini:latestrunning locally, open the attached .md document in a new tab.4. Technical setup
phi4-mini:latestnomic-embed-text, embedding task completed before the above bug