 |
ML Newsnew | past | best | rss | submit | about |
| The Cost of Training NLP Models: A Concise Overview (arxiv.org) | |
| 3 points by xzvf on Apr 21, 2020 | hide | past | pdf | discuss on HN | |
|
In plain words: A review of what it costs to train large language models and which choices drive the bill, aimed at people planning experiments or trying to understand the economics. It breaks one intimidating price tag into the parts that matter for budgeting. AbstractWe review the cost of training large-scale language models, and the drivers of these costs. The intended audience includes engineers and scientists budgeting their model-training experiments, as well as non-practitioners trying to make sense of the economics of modern-day Natural Language Processing (NLP). | |
| add comment on HN |