We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
An Online Word Vector Generation Method Based on Incremental Huffman Tree Merging.
- Authors
Kui QIAN; Lei TIAN; Xiulan WEN; Zhenzhong SONG
- Abstract
Aiming at high real-time performance processing requirements for large amounts of online text data in natural language processing applications, an online word vector model generation method based on incremental Huffman tree merging is proposed. Maintaining the inherited word Huffman tree in existing word vector model unchanged, a new Huffman tree of incoming words is constructed and ensures that there is no leaf node identical to the inherited Huffman tree. Then the Huffman tree is updated by a method of node merging. Thus based on the existing word vector model, each word still has a unique encoding for the calculation of the hierarchical softmax model. Finally, the generation of incremental word vector model is realized by using neural network on the basis of hierarchical softmax model. The experimental results show that the method could realize the word vector model generation online based on incremental learning with faster time and better performance.
- Subjects
MACHINE learning; COMPUTATIONAL linguistics; NATURAL language processing
- Publication
Technical Gazette / Tehnički Vjesnik, 2021, Vol 28, Issue 1, p52
- ISSN
1330-3651
- Publication type
Article
- DOI
10.17559/TV-20190506102016