Skip to content

Tabular Deep Learning parameters #452

Closed

Description

@edgararuiz
  • Transfer tuning parameters from tdl to dials
  • Create needed tuning parameters from brulee in dials

Activity

  1. edgararuiz commented on Jun 12, 2026

    @edgararuiz
    ContributorAuthor

    Parameters that need to be added

    Argument Model Type Why new Existing alternative
    attention_type saint qualitative ("row", "col", "both") No qualitative param for attention mode exists none — genuinely new
    dropout_last saint quantitative, proportion [0,1) No param for final-layer dropout; matches the dropout_attn()/dropout_embedding() precedent of per-location dropout params could reuse dropout(), but precedent favors a new param
    dropout_hidden saint quantitative, proportion [0,1) Saint has no generic dropout arg; this is its hidden-layer dropout could reuse dropout() (most defensible reuse), or new per precedent
  2. topepo commented on Jun 12, 2026

    @topepo
    Member

    For attention type it is "column", "row", or "both

  3. edgararuiz commented on Jun 12, 2026

    @edgararuiz
    ContributorAuthor

    Yes sir, that's what's in the PR:

    values_attention_type <- c("column", "row", "both")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions