I’ve been running a connection to the public streaming API with a small filter / track set (7 accounts, 10 hashtags - the UK General Election). I am recieving ~ 10 TPS right now but every second am seeing limit messages showing up to ~500 tweets being limited.
Why are so few tweets making it through? Is their a procedure for determining what is at fault?
I’m not seeing any stall warnings, and my code is storing tweets in 10ms on average so can’t see how this is an I/O problem at my end.
As a charity we are unable to afford GNIP’s pricing and was hoping to take advantage of the public APIs to their limits.