Hash tag search: How should I filter duplicates?


#1

I would like to perform a search using a hash tag, like “#WorldCup” and have the response contain only statuses that are not duplicates. Is there a way to specify that the text of each status is unique?

For example, a search for “#tech” returns the following statuses:

  • “Special Case Gives Your iPhone Heat Vision http://t.co/yB275WbCpe #Tech #Gadgets” (status id: 492675546891833345)
  • “RT @techtongue: O2’s discounted SIM-only plans offer 4G from £11 per month - #TechTongue #Tech #Mobile http://t.co/ntX0E4M2Er” (status id: 492675544589160448)
  • “RT @techtongue: O2’s discounted SIM-only plans offer 4G from £11 per month - #TechTongue #Tech #Mobile http://t.co/ntX0E4M2Er” (status id: 492675543519604736)
  • “Special Case Gives Your iPhone Heat Vision http://t.co/sNBBnslBn2 #tech” (status id: 492675543133728768)
  • “RT @techtongue: O2’s discounted SIM-only plans offer 4G from £11 per month - #TechTongue #Tech #Mobile http://t.co/ntX0E4M2Er” (status id: 492675542584287232)
  • “RT @techtongue: O2’s discounted SIM-only plans offer 4G from £11 per month - #TechTongue #Tech #Mobile http://t.co/ntX0E4M2Er” (status id: 492675541875429376)

Many of these are manual retweets of the same initial status. It’s okay to show that there was a manual retweet, but I don’t want 100’s of repetitions.