Skip to content

ai-platform-ollama crashes when it runs into unknown model capability #2019

@vkost

Description

@vkost

Hi all
Firstly, thank you for your efforts. The AI suite for Symfony is a breakthrough for me, in many ways.

I ran into a problem with ai-ollama-platform package. In ModelCatalog.php line 64, the library is trying to parse the capabilities for each available model into an array of enum values. However, in the current implementation, if it runs into an unknown capability, it throws an exception. I accidentally ran into this when I installed qwen2.5-coder:1.5b - it has 'insert' capability which is not a part of the current enum (defined in \Symfony\AI\Platform\Capability).
I temporarily forked the package to be able to use it, and am currently simply ignoring unknown capability values, which works for my use case. However, I believe this should be properly addressed. I can easily push a PR for ai-ollama-platform, however it would not help unless someone adds the new capability in the ai-platform package.

To reproduce this problem, install ollama, install a model with 'insert' capability (e.g. qwen2.5-coder). After you initialize the platform, try executing

$p->getModelCatalog()->getModels()

Where $p is created using Platform::create() from ai-ollama-platform.

I am using version 0.8 of all ai- components, on Symfony 7.4.9, PHP 8.3.

Thank you
Viktor

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions