Can text generation be modelled with regression ?Why do we need a language model?

To restate the question:  Given a sentence “I am about to complete this ”, can regression be used to predict the next word in this sentence?  No It cannot be modeled with a regression task. There are multiple reasons : Any form of temporal data(text) will have a dependency or correlation between consecutive and even non-consecutive…

Suppose you are modeling text with a HMM, What is the complexity of finding most the probable sequence of tags or states from a sequence of text using brute force algorithm?

Assume there are total states and let be the length of the largest sequence. Think how we generate text using an hMM. We first have a state sequence and from each state we emit an output. From each state, any word out of possible outcomes can be generated. Since there are states, at each possible…