Open
Description
Before implementing the learner. Just build it as a Graph.
The graph consists of:
- Two input nodes (one for tokenization of categoricals, one for numerics). Need to maybe handle what happens when only numerics or only categoricals exist, but ignore for now.
- Apply the Categorical encoder to categorical inputs, numeric encoder to numerical inputs.
- A Merge PipeOp that combines the categoricals and numerics
- A
PipeOpTorchBlock
that takes in thePipeOpTorch
that represents a single transformer block (thePipeOpTorchBlock
is responsible for repeating it multiple times - Build the output head using existing
PipeOpTorch
.
Metadata
Assignees
Labels
No labels