Counter-fitting Word Vectors to Linguistic Constraints Counter-fitting Word Vectors to Linguistic Constraints
Paper summary They describe a method for augmenting existing word embeddings with knowledge of semantic constraints. The idea is similar to retrofitting by Faruqui et al. (2015), but using additional constraints and a different optimisation function. https://i.imgur.com/zedR5FV.png Existing word vectors are further optimised to 1) have high similarity for known synonyms, 2) have low similarity for known antonyms, and 3) have high similarity to words that were highly similar in the original space. They evaluate on SimLex-999, showing state-of-the-art performance. Also, they use the method to improve a dialogue tracking system.
arxiv.org
arxiv-sanity.com
scholar.google.com
Counter-fitting Word Vectors to Linguistic Constraints
Nikola Mrkšić and Diarmuid Ó Séaghdha and Blaise Thomson and Milica Gašić and Lina Rojas-Barahona and Pei-Hao Su and David Vandyke and Tsung-Hsien Wen and Steve Young
arXiv e-Print archive - 2016 via Local arXiv
Keywords: cs.CL, cs.LG

more

Summary by Marek Rei 4 months ago
Loading...
Your comment:


ShortScience.org allows researchers to publish paper summaries that are voted on and ranked!
About

Sponsored by: and