BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Halıcıoğlu Data Science Institute - UC San Diego - ECPv6.16.3//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Halıcıoğlu Data Science Institute - UC San Diego
X-ORIGINAL-URL:https://datascience.ucsd.edu
X-WR-CALDESC:Events for Halıcıoğlu Data Science Institute - UC San Diego
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20220313T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20221106T090000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20230312T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20231105T090000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20240310T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20241103T090000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20230322T140000
DTEND;TZID=America/Los_Angeles:20230322T153000
DTSTAMP:20260716T191421
CREATED:20230323T182317Z
LAST-MODIFIED:20230323T182317Z
UID:10000370-1679493600-1679499000@datascience.ucsd.edu
SUMMARY:Structured Transformer Models for NLP
DESCRIPTION:Abstract: The field of natural language processing has recently unlocked a wide range of new capabilities through the use of large language models\, such as GPT-4. The growing application of these models motivates developing a more thorough understanding of how and why they work\, as well as further improvements in both quality and efficiency. \nIn this talk\, I will present my work on analyzing and improving the Transformer architecture underlying today’s language models through the study of how information is routed between multiple words in an input. I will show that such models can predict the syntactic structure of text in a variety of languages\, and discuss how syntax can inform our understanding of how the networks operate. I will also present my work on structuring information flow to build radically more efficient models\, including models that can process text of up to one million words\, which enables new possibilities for NLP with book-length text. \nBio: Nikita Kitaev is a final-year Ph.D. student in Computer Science at UC Berkeley\, advised by Dan Klein. His research spans natural language processing and machine learning\, with a focus on understanding the structure and operation of large language models\, including leveraging insights from the field of syntax. He is the recipient of an NSF Graduate Research Fellowship and his work has been recognized through a best paper award at ACL. Previously\, Nikita has received a B.S. in Electrical Engineering and Computer Science from UC Berkeley.
URL:https://datascience.ucsd.edu/event/structured-transformer-models-for-nlp/
LOCATION:SDSC\, The Synthesis Center\, 9500 Gilman Drive\, La Jolla\, CA\, 92093\, United States
CATEGORIES:Colloquium
END:VEVENT
END:VCALENDAR