Skip to content

DeText v1.2.0 Release Note

Choose a tag to compare

@StarWang StarWang released this 29 May 21:21
· 61 commits to master since this release
f0ee982

Currently DeText's design for sparse feature has simple modeling power for sparse features.

  1. only linear model is applied on sparse features
  2. there's no interaction between sparse features and dense features (model_score = dense_score + sparse_score)

DeText v1.2.0 resolves the above limitation on sparse feature by

  1. computing dense representation of sparse features
  2. allowing interactions between sparse features and wide features

More specifically, the model architecture changes from

dense_score = dense_ftrs -> MLP
sparse_score = sparse_ftrs -> Linear
final_score = dense_score + sparse_score

to

sparse_emb_ftrs = sparse_ftrs -> Dense(sp_emb_size)
all_ftrs = (dense_ftrs, sparse_emb_ftrs) -> Concatenate
final_score= all_ftrs -> MLP