NLP Seminar: On the Dangers of Stochastic Parrots: Can Language Models be Too big? – Emily M. Bender
Avsnittsinformation
Avsnittsbeskrivning
Title: On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?đŠ Speaker: Professor Dr. Emily M. Bender, University of Washington Abstract: In this paper, Bender and her co-authors take stock of the recent trend towards ever larger language models (especially for English), which the field of natural language processing has been using to extend the state of the art on a wide array of tasks as measured by leaderboards on specific benchmarks. The authors take a step back and ask: How big is too big? What are the possible risks associated with this technology and what paths are available for mitigating those risks? The NLP Seminar Series at AI Sweden is a bi-weekly forum for people who work with or are interested in Natural Language Processing (NLP). It is organized by AI Sweden and RISE NLP Group. 00:00 - Introduction 02:24 - History and context of this paper 12:23 - Questions to consider I 13:07 - Overview of the presentation 13:24 - Brief history of language models (LMs) 16:59 - What are the risks? Environmental cost & financial inaccessibility 21:04 - What are the risks? Unmanageable training data 27:25 - What are the risks? Research trajectories 28:44 - What are the risks? Potential harms of synthetic language 34:35 - Risk management strategies 36:07 - Risks of backing off from LLMs? 37:05 - Questions to consider II 37:33- The view from 2022 41:39 - Links for the slides and twitter AI Sweden is the Swedish national center for applied artificial intelligence. Our mission is to accelerate the use of AI for the benefit of our society, our competitiveness, and for everyone living in Sweden. Website: https://ai.se Contact: info@ai.se Follow us Newsletter: https://www.ai.se/en/AI-Sweden-newsletter LinkedIn: https://www.linkedin.com/company/aisweden Medium: https://medium.com/ai-sweden