Problem with retrieving tweets for a particular date


#1

Good Evening,

I’m developing an application that permits to extract tweet via Rest API v.1.1 (by hashtag, mention, language, etc.) using Twitter4J. For this scope I want to extract tweet, recursively, in particular days (I know that I can obtain tweets in the range of 8-10 days at maximum since today), but when I go to submit my request, since Wednesday I’m experiencing some troubles because, many times, there is no correspondence between the query and its result. For example: I obtain tweet of yesterday, but I requested the tweets of 3 days ago.

This is a simple output of my issue:

#atac -RT - 2014-04-12 - 2014-04-13
Query{query=’#atac -RT’, lang=‘null’, locale=‘null’, maxId=-1, count=100, since=‘2014-04-12’, sinceId=-1, geocode=‘null’, until=‘2014-04-13’, resultType=‘null’, nextPageQuery=‘null’}
76 - 66 - Fri Apr 18 18:09:06 CEST 2014
Query{query=’#atac -RT’, lang=‘null’, locale=‘null’, maxId=457012074921857024, count=100, since=‘2014-04-12’, sinceId=-1, geocode=‘null’, until=‘2014-04-13’, resultType=‘null’, nextPageQuery=‘null’}
75 - 81 - Mon Apr 14 01:17:07 CEST 2014
Query{query=’#atac -RT’, lang=‘null’, locale=‘null’, maxId=455146622809567232, count=100, since=‘2014-04-12’, sinceId=-1, geocode=‘null’, until=‘2014-04-13’, resultType=‘null’, nextPageQuery=‘null’}

You can see that I asked for the Tweets with the Hashtag ‘atac’, without retweets at the date of 12 April 2014 (query.setSince(“2014-04-12”), query.setUntil(“2014-04-13”); I obtained tweets with the date of 18.04.2014 or 14.04.2014, in this particular case (I’m showing only the date of the first tweet of the list of query provided by the method QueryResult of Twitter4J). I would like to ask if this problem is present in your applications, because I need to know, as soon as possible because I’m working for a dissertation, that there is this kind of difficult only in my application. Any help will be appreciated.

Best regards from Rome (and sorry for my English!),
Stefano


#2

RTFM - Please note that Twitter’s search service and, by extension, the Search API is not meant to be an exhaustive source of Tweets. Not all Tweets will be indexed or made available via the search interface. In API v1.1

Bottom line. Your goal is not achievable. Not even with Firehose.


#3

First of all, thank you for your answer.

Yes, I know that the Search API is not meant to be an exhaustive source of Tweets, but as I explain I’m obtaining tweets that not absolutely match my date criteria (in my example, I asked for only the tweet of 12.04.2012 and I have tweet of today) since wednesday.

About the bottom line (I think that you are referencing at the line ‘Query{query=’#atac -RT’, lang=‘null’, locale=‘null’, maxId=455146622809567232, count=100, since=‘2014-04-12’, sinceId=-1, geocode=‘null’, until=‘2014-04-13’, resultType=‘null’, nextPageQuery=‘null’}’) is my mistake during the copy/paste operation.

Thanks again. Regards,
Stefano