1. Paper title

Revisiting the Context Window for Cross-lingual Word Embeddings

2. link

https://www.aclweb.org/anthology/2020.acl-main.94.pdf

3. 摘要

Existing approaches to mapping-based crosslingual word embeddings are based on the assumption that the source and target embedding spaces are structurally similar. The structures of embedding spaces largely depend on the cooccurrence statistics of each word, which the choice of context window determines. Despite this obvious connection between the context window and mapping-based cross-lingual embeddings, their relationship has been underexplored in prior work. In this work, we provide a thorough evaluation, in various languages, domains, and tasks, of bilingual embeddings trained with different context windows. The highlight of our findings is that increasing the size of both the source and target window sizes improves the performance of bilingual lexicon induction, especially the performance on frequent nouns.

4. 要解决什么问题

context window决定了共现统计,共现统计了embedding空间的结构。
context window和embedding的其它关系?

5. 作者的主要贡献

对多个任务、领域、语言的双语embedding做评估

6. 得到了什么结果

增加context window的大小能够提升性能。

7. 关键字

mapping-based

results matching ""

    No results matching ""