multi-modal-qg

A Multi-Modal Question Generation Model.

Steps to prepare data

First change pwd to dataset/

cd dataset

Assign question ids
```
python assign_question_id.py
```
Get audio files from video files
```
python get_audio.py
```
Samples salient audio clips
```
python get_salient_audioclips.py
```
Samples salient frames
```
python get_salient_frames.py
```
Samples salient text
```
python get_salient_text.py
```
Now change back to project home
```
cd ..
```
Get glove matrix
```
python get_glove_matrix.py
```
Preprocess data
```
python preprocess_text.py
```
Prepare splits and vocab
```
python prepare_data.py
```

Hyperparams

Hyper parameters are read from config.py

Train

python train.py