#1

Hi,

My research team wants to look at the tweets for an entire month worth of tweet to look at public opinion of a recent shooting event. How can I scrape tweets for one month? We are exploring different options such as Premium API, and Enterprise API, but we’re not sure which one would be right for us.

We are estimating that there would be about 1 million tweets that we would get.

How should we proceed?
We emailed the enterprise team, but the answers were vague in terms of pricing, and we’re not sure what we would get, or whether it is worth it.

Thanks for all of your insights and suggestions!

Nga Than

#2

What shooting was this? Maybe there’s an already gathered dataset that someone has published the tweet IDs to - eg: https://www.docnow.io/catalog/

Your best bet is probably the Premium search API https://developer.twitter.com/en/docs/tweets/search/overview/premium

If you pay for any level of access you can also use the counts endpoint to estimate more precisely how many tweets your query will require, and plan accordingly (the cheapest fullarchive is $99, which would allow you to retrieve at most 50,000 tweets). You can also optimise your search to retrieve less - eg: ignore retweets, and retrieve them later to save cost.

#3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.