A language model is really a probabilistic model of the pure language.[1] In 1980, the very first substantial statistical language model was proposed, and during the decade IBM carried out ‘Shannon-fashion’ experiments, during which prospective sources for language modeling advancement have been recognized by observing and analyzing the functio