I am fairly new to twitter API’s and just wanted to get some feedback on my planned approach to download a network of tweets before I go ahead and try implement it. Additionally, some of you may have better/alternative ideas which would be good to hear.
I have a list of, say 100 people that I am interested in. I would like to download their recent (3200) tweets along with all of their follower’s tweets. After researching the streaming and search API I have concluded they are not feasible to accomplish this. So I was thinking this may work…
- Get my list of accounts that I am interested in - say 100 accounts
- Create a list of their followers using Get Followers/list
- Create lists using POST lists/members/create- you can have up to 1000 lists with 500 members in each.
- Use the lists in (3) to download the tweets using GET lists/statuses. Using the lists feature should help me get around the rate limit of 180/15 mins as each list would count as one request (please correct me if this is not true!).
My 100 accounts are all from the same country so it would be unlikely that there would be more than 5 million (1000*5000) total accounts in the network.
Can anyone comment on this approach - feasibility, better ways of doing it etc?
Thanks in advance.