목록WT (1)
while (1): study();
[논문 리뷰] Using the Output Embedding to Improve Language Models
출처: https://arxiv.org/abs/1608.05859 Using the Output Embedding to Improve Language Models We study the topmost weight matrix of neural network language models. We show that this matrix constitutes a valid word embedding. When training language models, we recommend tying the input embedding and this output embedding. We analyze the resulting upd arxiv.org * 하단 포스팅의 후속 포스팅입니다. https://jcy1996.tis..
논문 리뷰
2021. 7. 13. 06:43