# NLP

## Resources

* [CMU LTI Low Resource NLP Bootcamp 2020](https://github.com/neubig/lowresource-nlp-bootcamp-2020): This is a page for a low-resource natural language and speech processing bootcamp held by the [Carnegie Mellon University Language Technologies Institute](http://lti.cs.cmu.edu) in May 2020.
* [This *pandect* (*πανδέκτης is Ancient Greek for encyclopedia*)](https://github.com/ivan-bilan/The-NLP-Pandect) was created to help you find almost anything related to Natural Language Processing that is available online.
* Website (developed by[@seb\_ruder](https://twitter.com/seb_ruder)) provides useful information and resources for tracking the progress of many different kinds of common NLP tasks. [http://nlpprogress.com](https://t.co/OERWe1ZyVP?amp=1)
* This website provides resources, like paper and code links, about state-of-the-art NLP methods. It also includes methods used in general in ML. You can also find information about tasks where the different methods are being used. [https://paperswithcode.com](https://t.co/eZDrVpSDFq?amp=1)
* [book recommendations for getting started with NLP.](https://elvissaravia.substack.com/p/my-recommendations-for-getting-started) A few books shared in the list provide real-world use cases of different NLP methods and applications.
* Getting an initial high-level understanding of different NLP tasks and applications is key. Survey papers help a lot. This repo contains a list of NLP survey papers for getting a bit more exposure to a wide range of NLP tasks. [https://github.com/NiuTrans/ABigS](https://t.co/J2pbKCjZqK?amp=1)
* This website provides information about different NLP datasets and the tasks for which they are used. [https://datasets.quantumstat.com](https://t.co/YmonIqaM9I?amp=1)

### Transformers

1. Natural Language Processing: the age of Transformers <https://blog.scaleway.com/2019/building-a-machine-reading-comprehension-system-using-the-latest-advances-in-deep-learning-for-nlp/>
2. Transformers from scratch <http://www.peterbloem.nl/blog/transformers>
3. The illustrated transformer, Jay Allamar. <http://jalammar.github.io/illustrated-transformer/>

## **Non-English resources and compendiums**

* [NLP Resources for Bahasa Indonesian](https://github.com/louisowen6/NLP_bahasa_resources) \[GitHub \~100 stars]
* [Indic NLP Catalog](https://github.com/AI4Bharat/indicnlp_catalog) \[GitHub \~150 stars]
* [Pre-trained language models for Vietnamese](https://github.com/VinAIResearch/PhoBERT) \[GitHub \~200 stars]
* [Natural Language Toolkit for Indic Languages (iNLTK)](https://github.com/goru001/inltk) \[GitHub \~600 stars]
* [Indic NLP Library](https://github.com/anoopkunchukuttan/indic_nlp_library) \[GitHub \~300 stars]
* [AI4Bharat-IndicNLP Portal](https://indicnlp.ai4bharat.org)