Unsupervised Structured Prediction

Must-read papers for unsupervised structured prediction.

Syntactic Parsing

• Songlin Yang, Yong Jiang, Wenjuan Han and Kewei Tu. 2020. Second-Order Unsupervised Neural Dependency Parsing. In Proceedings of COLING.
• Wenjuan Han, Yong Jiang, Hwee Tou Ng and Kewei Tu. 2020. A Survey of Unsupervised Dependency Parsing. In Proceedings of COLING.
• Zhiyong Wu, Yun Chen, Ben Kao and Qun Liu. 2020. Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERT. In Proceedings of ACL.
• Wenjuan Han, Yong Jiang and Kewei Tu. 2019. Enhancing unsupervised generative dependency parser with contextual information. In Proceedings of ACL.
• Andrew Drozdov, Patrick Verga, Mohit Yadav, Mohit Iyyer and Andrew McCallum. 2019. Unsupervised Latent Tree Induction with Deep Inside-Outside Recursive Auto-Encoders. In Proceedings of NAACL.
• Bowen Li, Jianpeng Cheng, Yang Liu and Frank Keller. 2019. Dependency grammar induction with a neural variational transition-based parser. In Proceedings of AAAI.
• Yoon Kim, Alexander Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer and Gábor Melis. 2019. Unsupervised Recurrent Neural Network Grammars. In Proceedings of NAACL.
• Caio Corro and Ivan Titov. 2018. Differentiable Perturb-and-Parse: Semi-Supervised Parsing with a Structured Variational Autoencoder. In Proceedings of ICLR.
• Yikang Shen, Zhouhan Lin, Chin-wei Huang and Aaron Courville. 2018. Neural Language Modeling by Jointly Learning Syntax and Lexicon. In Proceedings of ICLR.
• Jiong Cai, Yong Jiang and Kewei Tu. 2017. CRF autoencoder for unsupervised dependency parsing. In Proceedings of EMNLP.
• Wenjuan Han, Yong Jiang, and Kewei Tu. 2017. Dependency grammar induction with neural lexicalization and big training data. In Proceedings of EMNLP.
• Yong Jiang, Wenjuan Han and Kewei Tu. 2016. Unsupervised neural dependency parsing. In Proceedings of EMNLP.
• Dan Klein and Christopher D. Manning. 2004. Corpus-Based Induction of Syntactic Structure: Models of Dependency and Constituency. In Proceedings of ACL.

Sequence Labeling

• Taylor Berg-Kirkpatrick, Alexandre Bouchard-Côté, John DeNero and Dan Klein. 2010. Painless Unsupervised Learning with Features. In Proceedings of NAACL.
• Waleed Ammar, Chris Dyer and Noah A. Smith. 2014. Conditional Random Field Autoencoders for Unsupervised Structured Prediction. In Proceedings of NIPS.
• Karl Stratos, Michael Collins and Daniel Hsu. 2016. Unsupervised Part-Of-Speech Tagging with Anchor Hidden Markov Models. In Proceedings of TACL.

Related

• Xiao Zhang, Yong Jiang, Hao Peng, Kewei Tu and Dan Goldwasser. 2017. Semi-supervised Structured Prediction with Neural CRF Autoencoder. In Proceedings of EMNLP.
• Xinlei Chen and Haoqi Fan and Ross Girshick and Kaiming He. 2020. Improved Baselines with Momentum Contrastive Learning
• Chen Ting and Kornblith Simon and Norouzi Mohammad and Hinton Geoffrey. 2020. A Simple Framework for Contrastive Learning of Visual Representations
• Chen Ting and Kornblith Simon and Swersky Kevin and Norouzi Mohammad and Hinton Geoffrey. 2020. Big Self-Supervised Models are Strong Semi-Supervised Learners