Skip to content

Automated evaluation of predicted mappings #7

@cthoyt

Description

@cthoyt

Given a set of mappings, they can be stratified on three axes:

  1. mapping justification (semapv:ManualMappingCuration and maybe semapv:UnspecifiedMatching vs. others like semapv:LexicalMatching, semapv:BackgroundKnowledgeBasedMatching, semapv:MappingInversion, and semapv:MappingChaining)
  2. mapping set
  3. source-target prefix pair

Some ideas on making a comparison in order of increasing complexity

  1. Compare mapping overlap to get a simple precision, recall, and $F_1$
  2. Penalize incorrect 1-many, many-1, and many-to-many mappings
  3. Incorporate ontology hierarchy

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions