Statistically improbable phrases
Calvin and Hobbes has some recurrent themes, like Hobbes pouncing, snow art, polls, letters to Santa, … Over the last 5 years, I’ve transcribed the Calvin and Hobbes comics, and tagged them manually by theme. But can I generate themes automatically? One way is to use Amazon’s statistically improbable phrases. It’s a list of words that occur a lot in a book, but rarely occur in others. It gives you a good feel of what topics the book is about. ...