I am attempting to grab lots of tweets via search in the API using the Python tweepy library. By lots I mean 20000+ tweets. tweepy builds in functionality that handles waiting on rate limits, and that’s all fine and dandy. However, the underlying library is complaining that Twitter is resetting my connection, which kills the application.
Why would Twitter be resetting my connection? Is there a max number of tweets I am allowed to gather at a time via the search API?