[PDF][PDF] Chinese chunking based on maximum entropy markov models
International Journal of Computational Linguistics & Chinese Language …, 2006•aclanthology.org
This paper presents a new Chinese chunking method based on maximum entropy Markov
models. We firstly present two types of Chinese chunking specifications and data sets,
based on which the chunking models are applied. Then we describe the hidden Markov
chunking model and maximum entropy chunking model. Based on our analysis of the two
models, we propose a maximum entropy Markov chunking model that combines the
transition probabilities and conditional probabilities of states. Experimental results for two …
models. We firstly present two types of Chinese chunking specifications and data sets,
based on which the chunking models are applied. Then we describe the hidden Markov
chunking model and maximum entropy chunking model. Based on our analysis of the two
models, we propose a maximum entropy Markov chunking model that combines the
transition probabilities and conditional probabilities of states. Experimental results for two …
Abstract
This paper presents a new Chinese chunking method based on maximum entropy Markov models. We firstly present two types of Chinese chunking specifications and data sets, based on which the chunking models are applied. Then we describe the hidden Markov chunking model and maximum entropy chunking model. Based on our analysis of the two models, we propose a maximum entropy Markov chunking model that combines the transition probabilities and conditional probabilities of states. Experimental results for two types of data sets show that this approach achieves impressive accuracy in terms of the F-score: 91.02% and 92.68%, respectively. Compared with the hidden Markov chunking model and maximum entropy chunking model, based on the same data set, the new chunking model achieves better performance.
aclanthology.org
Showing the best result for this search. See all results