Skip to content

Selectable Weight Initialization Model #2

Open
@chuckwolber

Description

@chuckwolber

The current weight initialization model is to randomize weights to be +/- of the inverse of the square root of the fan-in (fan-in is just the number of incoming weights). Create an initialization interface and a token set of initializers.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions