OMX Helsinki — S&P 500 — DAX — NASDAQ 100 — STOXX 600 — EUR/USD — EUR/SEK — BTC/USD — ETH/USD — Euribor 3 mån — Euribor 12 mån —
AI Sweden

AI Sweden

Teknik och AI 3,000 prenumeranter

NLP Seminar: Reading between the lines: a better benchmark for text understanding – Yoav Goldberg

14.10.2022 233 visningar
Publicerad: 14.10.2022 Kategori: Teknik och AI Visningar: 233

Avsnittsinformation

Avsnittsbeskrivning

Titel: Reading between the lines: a better benchmark for text understanding Speaker: Prof. Dr. Yoav Goldberg, Bar Ilan University and Research Director at AI2 Israel Abstract: What does it mean to "understand" a text? Many recent NLP works take a question-answering (QA) perspective to this question, under which understanding a text means the ability to accurately answer questions about it. While this approach is useful, it can also be misleading: some questions are easier than others, some questions can be answered without access to the text at all, and, furthermore, questions often leak information about the answer. Thus, determining understanding based on question-answering ability alone is not sufficient. Indeed, many QA datasets are now considered "solved" by deep learning systems, while it should be clear that these systems do not really understand the text. In this talk I highlight deficiencies of QA for measuring text understanding, and also introduce a new NLP task we devised---together with a large corresponding dataset---which I argue serves as a much stronger indicator of text understanding than QA is. Beyond being a benchmark for text understanding, the task is also linguistically grounded, and is a very useful building block for downstream text processing applications. The NLP Seminar Series at AI Sweden is a bi-weekly forum for people who work with or are interested in Natural Language Processing (NLP). It is organized by AI Sweden and RISE NLP Group. ---- AI Sweden is the Swedish national center for applied artificial intelligence. Our mission is to accelerate the use of AI for the benefit of our society, our competitiveness, and for everyone living in Sweden. Website: https://ai.se Contact: info@ai.se Follow us Newsletter: https://www.ai.se/en/AI-Sweden-newsletter LinkedIn: https://www.linkedin.com/company/aisweden Medium: https://medium.com/ai-sweden

Öppna chatten med AI-assistenten. Chatten laddas först när du öppnar den.