Use an app to download tweets

[BellFergal]

Dear Sir/Madam,

My developer account is not allowing me to gain more tweets. I have so far downloaded 48,000 tweets. However, I need at least 100,000 tweets to complete my project. It’s saying something about too many retires in the URL??

Please help.

Regards,

Fergal Bell.

[Aurelia]

Hi @BellFergal - please could you clarify what product (API /endpoint) you are using? I can then direct you to the most appropriate option.

Please refer to our documentation to find out about rate limits that you should be aware of when using our different products.

You can choose from different levels of usage for each of our different products here.

[BellFergal]

Dear Aurelia,

I’m not sure what an endpoint is. I’m new to using an app to download tweets. However, I took a snapshot of the message I’m getting.

My tutor gave us a script in order to download tweets for sentiment analysis, etc for our projects. The limit set in the script was 1000 tweets. Then, the programme would stop for 15 minutes download another 1000 tweets and so on. However, it wasn’t doing this so I increase the limit from 1000 to 5000 of 50000 tweets per cycle.

But, it basically said something about retries exceeded for this url. I then regenerated the codes but to no effect.

I would be much obliged if you could help me…it’s delaying my project as I need at least 100,000 tweets to complete my project.

Regards,

Fergal Bell.

[bobber205]

I honestly think your professor didn’t set you up well for success and that you should probably talk to him.

This is going to be a real challenge to accomplish without a basic understand of programming and APIs.

You may wanna use a third party service to do this.

[andypiper]

Hi there Fergal @BellFergal

As @bobber205 mentions unfortunately it seems like your tutor unfortunately hasn’t given the best information here, but we can try to help you. However please understand that these forums are for folks that are aware of our APIs and developer platform, and we cannot support applications and scripts that were built by third parties.

The developer platform (API) limits the search API calls to a certain number of calls in a time limited window (we call this the “rate limit”). These limits are typically 15 minutes so that explains the logic in the code you’re seeing. There is unfortunately no way to increase the number of Tweets you can search for within the 15 minute window.

If you “need at least 10,000 Tweets” then you’ll have to understand that your requests are going to take a long time to process. All developers are subject to the same API limits.

[BellFergal]

Dear Andy,

I used spyder to download tweets titled (“wildatlanticway”) – it worked! The limit was 200 tweets. I then changed the query to (“warzone migration”). Now it’s saying permission denied to the directory I created – see attached. It also said before that tweets not defined??

Regards,

Fergal.

[andypiper]

Hey Fergal - we don’t know the app you are using, sorry. You’d have to talk to the developer. We can help with API questions, but tools built on top of our platform are unfortunately not things we can support.

[BellFergal]

Dear Andy,

Who is the app developer??

Regards,

Fergal.

[bobber205]

You should look into posting questions like this on http://stackoverflow.com
You are having issues not specific to the Twitter API but the code that was given to you. SO is a more appropriate place for those kinds of questions.

[system]

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.