I’ve just started to look at extracting data from Twitter using SSIS. The 3rd party Twitter tool allows me to extract data using the Twitter REST API.
As an initial test I want to just download the tweets on my timeline using Statuses/User Timeline. It works beautifully but it only brings down 200 rows at a time. I have more tweets than that on my timeline.
From what I have read I think this is to do with the API having to read through pages of my timeline to retrieve tweets.
Any advice on what I would need to do to pull down all of my tweets?
At some point I will want to pull data down for a certain account, hashtag etc. and I assume I will come across a similar obstacle?
Grateful for any help.