Monday, September 21, 2009

How many people say "huuuuuuuuuuungry" on Twitter?

Here's a fun example that shows the uniqueness of the Twitter language model. Try typing in the word "hungry", with an arbitrary number of u's. Seriously, try it:

huuuungry - 15 results in the last day
huuuuuuuuuuungry - 8 results in the last 10 days (screenshot below)
huuuuuuuuuuuuuuuuuuuuungry - 1 result in the last 4 days

The publicly available lexicons (like the Subjectivity Lexicon from MPQA) don't work well with Twitter because the language model is so unique.