We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Cross-lingual transfer of knowledge in distributional language models: Experiments in Hungarian.
- Authors
NOVÁK, ATTILA; NOVÁK, BORBÁLA
- Abstract
In this paper, we argue that the very convincing performance of recent deep-neural-model-based NLP applications has demonstrated that the distributionalist approach to language description has proven to be more successful than the earlier subtle rule-based models created by the generative school. The now ubiquitous neural models can naturally handle ambiguity and achieve human-like linguistic performance with most of their training consisting only of noisy raw linguistic data without any multimodal grounding or external supervision refuting Chomsky’s argument that some generic neural architecture cannot arrive at the linguistic performance exhibited by humans given the limited input available to children. In addition, we demonstrate in experiments with Hungarian as the target language that the shared internal representations in multilingually trained versions of these models make them able to transfer specific linguistic skills, including structured annotation skills, from one language to another remarkably efficiently
- Subjects
LANGUAGE models; KNOWLEDGE transfer; LANGUAGE transfer (Language learning)
- Publication
Acta Linguistica Academica, 2022, Vol 69, Issue 4, p405
- ISSN
2559-8201
- Publication type
Article
- DOI
10.1556/2062.2022.00580