Article | Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017), September 18-20, 2017, Università di Pisa, Italy | Capturing Dependency Syntax with "Deep" Sequential Models
Göm menyn

Title:
Capturing Dependency Syntax with "Deep" Sequential Models
Author:
Yoav Goldberg: Bar Ilan University, Department of Computer Science, Ramat-Gan, Israel
Download:
Full text (pdf)
Year:
2017
Conference:
Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017), September 18-20, 2017, Università di Pisa, Italy
Issue:
139
Article no.:
001
Pages:
1
No. of pages:
1
Publication type:
Abstract and Fulltext
Published:
2017-09-13
ISBN:
978-91-7685-467-9
Series:
Linköping Electronic Conference Proceedings
ISSN (print):
1650-3686
ISSN (online):
1650-3740
Publisher:
Linköping University Electronic Press, Linköpings universitet


Export in BibTex, RIS or text

Neural network (‚Äúdeep learning‚ÄĚ) models are taking over machine learning approaches for language by storm. In particular, recurrent neural networks (RNNs), which are flexible non-markovian models of sequential data, were shown to be effective for a variety of language processing tasks. Somewhat surprisingly, these seemingly purely sequential models are very capable at modeling syntactic phenomena, and using them result in very strong dependency parsers, for a variety of languages. In this talk, I will briefly describe recurrent-networks, and present empirical evidence for their capabilities of learning the subject-verb agreement relation in naturally occuring text, from relatively indirect supervision. This part is based on my joint work with Tal Linzen and Emmanuel Dupoux. I will then describe bi-directional recurrent networks---a simple extension of recurrent networks---and show how they can be used as the basis of state-of-the-art dependency parsers. This is based on my work with Eliyahu Kipperwasser, but will also touch on work by other researchers in that space.

Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017), September 18-20, 2017, Università di Pisa, Italy

Author:
Yoav Goldberg
Title:
Capturing Dependency Syntax with "Deep" Sequential Models
References:
No references available

Proceedings of the Fourth International Conference on Dependency Linguistics (Depling 2017), September 18-20, 2017, Università di Pisa, Italy

Author:
Yoav Goldberg
Title:
Capturing Dependency Syntax with "Deep" Sequential Models
Note: the following are taken directly from CrossRef
Citations:
No citations available at the moment


Responsible for this page: Peter Berkesand
Last updated: 2017-02-21