项目作者: SeonbeomKim

项目描述 :
Character-Aware Neural Language Models (Yoon Kim), lstm-char-cnn
高级语言: Python
项目地址: git://github.com/SeonbeomKim/TensorFlow-lstm-char-cnn.git
创建时间: 2018-12-06T15:36:57Z
项目社区:https://github.com/SeonbeomKim/TensorFlow-lstm-char-cnn

开源协议:

下载


TensorFlow-lstm-char-cnn

Character-Aware Neural Language Models (Yoon Kim), lstm-char-cnn

Paper

Dataset

  • PennTreebank(PTB)


Perplexity

  • Paper large_test_ppl: 78.9
  • Paper small_test_ppl: 92.3
  • My result
    • large_test_ppl: 94.95
    • small_test_ppl: 97.59


      PPL


Nearest neighbor words (based on cosine similarity)

  • paper


    p_cosine_similarity

  • large model


    l_cosine_similarity

  • small model


    s_cosine_similarity