Text Preprocessing

[someshsingh22]

To implement a common black box we need text loading, extraction of words to be attacked, perturbations, distance metrics, models.

Text Loading needs to be very uniform and universal, it should encapsulate all common practices including embedding, tokenizers, batch_loaders, and should support commonly used libraries like nltk, spacy, BERT etc.

We need to think about how we should design this before our first attack.

[parantak]

@someshsingh22 , I believe we could start by creating a common class for this inside decepticonlp/preprocess, and then start by implementing a class for each of the separate practices. Does that sound good, or do you want to take a different approach to this?

[parantak]

Refer to #75