How to following 100k+ users

[cvdweth]

Hi,

I have a database with Twitter users I would like to follow using the streaming API. As far as I know, I can follow up to 5k users using one application. What are best practices to follow 100k user or more?

I guess I could create 20 applications to get 20 access credentials and create 20 streams each following 5k users. But I don’t think this is the preferred way to go, particularly given this:

Also note that the number of simultaneous connections per IP address is still limited, regardless of application.

[rchoi]

Hi cvdweth,

Via public stream/API, only one stream connection is allowed. I might suggest using Gnip if it’s a business-oriented use case, where you can have multiple streams and even get backfill data.

[rchoi]