Skip to content

context/content-selection failure #85

Description

@JMak22

Addressing the Affordability Gap in the GTA.md

1. What happened

Installed a local LLM (phi4-mini:latest) to check how well it performs on vault-related tasks. Prior to testing phi4 in VO, I tested it in CLI, running via ollama. The input document was the same for all 3 tests. It performed passably.

Model Test 2 Input (CLI): "Read the following text. Output only the requested three items: 1. a one-sentence summary, 2. three keywords, 3. one suggested filename in lowercase kebab-case. Do not add commentary or explanation." Vault Operator + Phi4 | Prompt (Obsidian): What 3 keywords describe this document? Vault Operator + Phi4 (Obsidian): What 3 keywords describe the contents of this document?
Phi4 1. Proposing rights of first refusal for affordable housing developments in the GTA to non-profit organizations. 2. Affordable housing, rights of first refusal, GTA. 3. rights-first-refusal-gta-affordable-housing. The three keywords that describe this document are: 1. Markdown 2. Personal Knowledge Management 3. Project Documentation The three keywords that describe the contents of this document are:1. Personal Knowledge Management2. Career Change3. Housing Affordability in the GTA
Assessmet Decent, though it missed the sub heading "Land Gifts"    

2. What you expected

A response that resembled the CLI response.

3. Steps to reproduce

  1. With Ollama and phi4-mini:latest running locally, open the attached .md document in a new tab.
  2. Vault Operator should have no custom instructions or agents and the setup should have it pointed to a locally running LLM model (phi4-mini)
  3. Open the Vault Operator sidebar, type in the prompt "What 3 keywords describe this document?"
  4. Observe the model/plugin response.

4. Technical setup

  • Operating system and version: Windows 11 Pro, 25H2
  • Obsidian version: 1.13.7
  • Vault Operator version: v3.8.1
  • Installer type: regular install
  • AI provider in use: Ollama, phi4-mini:latest
  • Local only vault
  • Embedding model: nomic-embed-text, embedding task completed before the above bug

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions