Skip to content

Text Model Support in Armory Library #180

@deprit

Description

@deprit

We want to extend Armory Library to support the evaluation of text models, particularly LLMs. Supporting text evaluations will require the classes below.

  • Text data set and data loader
  • Text model wrapper
  • Text evaluation metrics

LLM model sources:

Text evaluations and metrics:

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions