Skip to content

Does conditioning on species/clade help? #287

Description

@gonzalobenegas
  • add a species/clade prefix token
  • perhaps drop it with certain probability so the model also works in unconditional setting

TODO: add references

Metadata

Metadata

Assignees

No one assigned

    Labels

    modelingArea: core gLM recipe — architecture, objective, tokenization, loss weighting, contextresearch-questionType: durable, revisitable question pursued across many experiments over time (a north-star)

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions