Twitter and KNIME

sultanayhan89 · 2014-12-09T17:47:34.475Z

Hello friends my name is ayhan.

i use the twitter workflow for knime, it works very well, everything is right, but there is one problem, i need it that the workflow runs for two weeks, so it must run by itself, i found the way to build in knime, but now the problem is, that twitter kicks me out i get these error message,

“ERROR Twitter Search Execute failed: 429:Returned in API v1.1 when a request cannot be served due to the application’s rate limit having been exhausted for the resource. See Rate Limiting in API v1.1.(https://dev.twitter.com/docs/rate-limiting/1.1)
message - Rate limit exceeded
code - 88”

can u help me please ?

andypiper · 2014-12-09T18:14:40.230Z

sultanayhan89:

Rate Limiting in API v1.1

Did you read the document that was referenced? The Search API is limited to a certain number of calls in each 15 minute time window. Your workflow will need to respect that limit in order to operate over a 2 week period.

sultanayhan89 · 2014-12-09T18:15:23.621Z

I had thought that i can skip that, if i pay some money??

sultanayhan89 · 2014-12-09T20:07:46.301Z

So Andy, did you use Knime with the twitter workflow ?

andypiper · 2014-12-10T11:07:28.391Z

I’m afraid I’ve never used Knime - hopefully another member of the community can help out here, but the rate limits will still apply as described above.

andypiper · 2014-12-10T12:40:08.174Z

(Moving this to the REST API category as the KNIME nodes use REST not Streaming)

I’ve just downloaded KNIME and tried it out with a simple search flow. It is a pretty nice tool! (although really should use the latest logo image in the nodes!).

I see that they have included information about rate limits in the IDE itself, so they should be fairly clear.

KNIME.png1704x662 157 KB

sultanayhan89 · 2014-12-10T13:23:43.087Z

Andy i build it in twitter , but if i want to let it run more than one run, it gives me this error message

Pasted image1600x900 314 KB

andypiper · 2014-12-10T14:16:37.003Z

I think you will just have to have your app run less frequently as you are hitting the rate limit window for Search API and User endpoint requests.

sultanayhan89 · 2014-12-10T14:34:20.248Z

how u mean it ?. i need so much data as possible

andypiper · 2014-12-10T15:23:56.505Z

Well, unfortunately, you can only request a limited number of tweets per 15 minute window. That’s how the API works.