My name is CHI YU. The repo is my paper reading report.
-
Weak Label Generator: A rule-based parse tree is used to generate weak labels, identifying potential Aspect and Opinion spans within a sentence.
-
Aspect & Opinion Extraction is performed using a two-layer span extraction model.
-
The first layer extracts individual Aspects or Opinions.
-
The second layer extracts Aspect-Opinion pairs.
-
The outputs of the first and second layers are used for cross-validation.
-
Cross-entropy loss is used as the training objective.
-
The model calculates correlation between outputs from different layers.
-
Self-training is applied: only training data predicted correctly by all four models is reused for further training.
The goal of the paper is to augment the verbalizer (label word), because in the traditional prompt learning, it needs manual effort to design the verbalizer(label word).
- Label augmentation: Search multiple label words and select the top-k with high probability for the verbalizer.
- Augmented Prompt Learning: We get multiple training data to help us train the model.
- Prediction in Prompt learning: Input the sentence including a masked sentence, and put it into the model. The predicted token for the [MASK] determines the corresponding category for classification.


