Machine learning
Models
https://arxiv.org/abs/1907.07355 Probing Neural Network Comprehension of Natural Language Arguments
https://arxiv.org/abs/1902.01007 Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
GPU
What is GPU https://course.fast.ai/gpu_tutorial.html
Cost
https://twitter.com/eturner303/status/1143174828804857856 Holy crap: It costs $245,000 to train the XLNet model (the one that's beating BERT on NLP tasks..512 TPU v3 chips 2.5 days $8 a TPU -see the above thread
The cost of training MT models: https://medium.com/syncedreview/the-staggering-cost-of-training-sota-ai-models-e329e80fa82
Mozilla's struggles with Baidu model training - hardware issues
Ethics
Open AI and their ethical(?) release of model that can create fake news https://openai.com/blog/better-language-models/#task2
Last updated