350+ NLP Models in 1 line of Python code with NLU 0.2.1

We are glad to announce that NLU 0.2.1 has been released!
NLU makes the 350+ models and annotators in Spark NLPs arsenal available in just 1 line of python code and it works with Pandas dataframes!

What is included in NLU 0.2.1

• 350+ pre-trained models
• 100+ of the latest NLP word embeddings ( BERT, ELMO, ALBERT, XLNET, GLOVE, BIOBERT, ELECTRA, COVIDBERT) and different variations of them
• 50+ of the latest NLP sentence embeddings ( BERT, ELECTRA, USE) and different variations of them
• 50+ Classifiers
• 50+ Supported languages
• Named Entity Recognition (NER)
• Part of Speech(POS)
• Labeled and Unlabeled Dependency parsing
• Spell Checking
• Various Text Preprocessing and Cleaning algorithms

NLU References

• NLU Website
• NLU Github
• NLU Install
• Overview of all NLU example notebooks
• Overview of almost every 1-liner in NLU

NLU on Medium

• Introduction to NLU
• One line BERT Word Embeddings and t-SNE plotting with NLU
• BERT, ALBERT, ELECTRA, ELMO, XLNET, GLOVE Word Embeddings in one line and plotting with t-SNE

NLU component examples

The following are Collab examples that showcase each NLU component and some applications.

• Named Entity Recognition (NER) notebooks

  • NER pretrained on ONTO Notes
  • NER pretrained on CONLL

• Part of speech (POS) notebooks

  • POS pretrained on ANC dataset

• Classifiers notebooks

  • Unsupervised Keyword Extraction with YAKE
  • Toxic Text Classifier
  • Twitter Sentiment Classifier
  • Movie Review Sentiment Classifier
  • Sarcasm Classifier
  • 50 Class Questions Classifier
  • 20 Class Languages Classifier
  • Fake News Classifier
  • E2E Classifier
  • Cyberbullying Classifier
  • Spam Classifier
  • Emotion Classifier

• Word Embeddings notebooks

  • BERT Word Embeddings and T-SNE plotting
  • ALBERT Word Embeddings and T-SNE plotting
  • ELMO Word Embeddings and T-SNE plotting
  • XLNET Word Embeddings and T-SNE plotting
  • ELECTRA Word Embeddings and T-SNE plotting
  • COVIDBERT Word Embeddings and T-SNE plotting
  • BIOBERT Word Embeddings and T-SNE plotting
  • GLOVE Word Embeddings and T-SNE plotting

• Sentence Embeddings notebooks

  • BERT Sentence Embeddings and T-SNE plotting
  • ELECTRA Sentence Embeddings and T-SNE plotting
  • USE Sentence Embeddings and T-SNE plotting

• Dependency Parsing notebooks

  • Untyped Dependency Parsing
  • Typed Dependency Parsing

• Text Pre Processing and Cleaning notebooks

  • Tokenization
  • Stopwords removal
  • Stemming
  • Lemmatization
  • Normalizing
  • Spell checking
  • Sentence Detecting

• Chunkers notebooks

  • N Gram
  • Entity Chunking

• Matchers notebooks

  • Date Matcher

Simple NLU Output Level Examples

• NLU different output levels Demo