What can you say about the most frequent and most rare words ? Why are they important or not important ?

Most frequent words are usually stop words like “in”, ,”so”, ”are”, ”this”, ”the”, ”that” ,”a” ,”is” etc.  Rare words could be because of spelling mistakes or due to the word being sparsely used in the data set. Usually most frequent and most rare words are not useful in providing contextual information. Stop words occur in…