How could I get Twitter data for research?

[RishiRajAnand3]

Guys has anyone used R for collecting tweets?
I am not keen on using the twitteR package as it does not contain functions I need. Has anyone used R to make calls to the twitter API(streaming, REST etc).
I am doing a project that involves predicting events such as riots, natural calamities etc based on twitter activity, thereby mitigating risk.

[archish9]

See [node:6344] and [node:10390]

what do you mean by See [node:6344] and [node:10390] as i am new to this

[andypiper]

These were broken documentation references from our old forums and website. I’ve just updated @episod’s original reply with the correct and current links.

[JaggyPaw]

Hello Dorathy,

Does this code extract data for a given time interval(like from 2010 to 2012).

By looking at this code, I don’t think so it will extract. But still I want to confirm from you.

Thank you,
Jags

[gregorysaxton]

I’m a Communication professor and used to be in the same boat five years ago when I started learning how to download tweets. So I’m trying to give back and have created a series of tutorials for the complete coding beginner. Take a look and let me know if they’re helpful:

http://social-metrics.org/tutorial-list/

Happy coding!

[Nika_Russell]

Hi Gregory! Your link seems to be just great! I have already started my data mining project on R, but it seems that Python is waaaaay preferred going by forums and available material.
I am working on my thesis and it turned out that mining Twitter was the only possible way to answer my research question, so I am bit stuck now as programming is not my strongest point.
Going to dig into your materials and hope I could turn to you in the future!

[Tamang]

Hello everyone, I am also doing some research and basically need this data:

• No of tweets made from India in 2015 (Jan-Dec)
• Among those, I want to know the number of tweets matching certain terms, tags or hashtags

How can I get it, I don’t want to use any paid tools/services.

@gregorysaxton Thanks for creating that blog, will go through it.

[andypiper]

Historic data of this kind is only available via the Gnip APIs - the public API is only able to retrieve up to 7 days of information.

[Tamang]

Thanks Andy. How can I retrieve up to 7 days of information using Gnip? Can’t find anything on their website. Also alternatively how can I start collecting real time data on daily basis. I have some coding background so I can manage it if required.

[andypiper]

OK, some confusion here. There are several families of APIs involved.

Free-to-use, rate-limited public APIs are available for search (with a 7 day window, so it won’t let you get Tweets from 2015 as you requested above), and real-time streaming.

Comprehensive, full-archive capable enterprise paid APIs are available from Gnip.

[Arielizms]

Hi, I am a PhD student in Applied Linguistics and I am trying to find out how to extract Korean language tweets only. I am able to collect random twitter data using R so far, but I don’t know how to extract just Korean tweets. Your help will be much appreciated!

Thanks,
Ariel

[andypiper]

Use lang:kr in your filter or search query.

[joziguyz]

NodeXL is tool that imports twitter data. There is a basic version that retrieves limited twitter API data and a Pro version offering student discounts.

[RGCombat]

Hello anpetre, yeah this gives me my tweets but how can i get the tweets of another person?

[andypiper]

You can use the search API to find Tweets from “any” Twitter user.

[StuartWShulman]

You can try DiscoverText for Search API and Gnip PowerTrack 2.0 Twitter data. The Top 10 Reasons to Use DiscoverText to Study Twitter Data. These are cloud-based tools for gathering data and doing analytics.

For historical Twitter data, try Sifter. Three free estimates per day and self-serve historical Twitter jobs for as little as $50. Any Sifter purchase over $50 includes 14 days of Enterprise DiscoverText access. This enables up to three users to collaborate on the dataset. If you spend more than $500, we will provide the software free for 30 days for up to five users. All purchases over $1500 come with 60 days of gratis access to the full suite of DiscoverText for up to 10 users.

[RECOTAG_TFG]

Hello, could you indicate to me if Gnip’s APIs are free or if it is necessary to pay to using them?. I am going to develop a application and it must be able to recover both old general tweets and the most recent general tweets.

Thanks in advance.

[andypiper]

The Gnip APIs are commercial.

[RECOTAG_TFG]

Hi Andy, thanks for your response. It is want to say that I will have to use to obtain tweets from another person Search API if they are old tweets and Streaming API if they are recent tweets. It is correct?

[lavanya1106996]

i need a java code for downloading tweets