How did twitter generate the 1% of the Firehose tweets to status/filter endpoint and status/sample endpoint?

[jupiterhyun]

Could someone briefly tell me the algorithm? I have found this Topic is helpful:

Diffence between sample and filter streaming API

Hi, I have one quick question, when you guys said "1% of all Tweets", what is the exactly time period? like every second? every 10 seconds? Thanks,

However, it just answered part of my question. I need more details, especially deal with the time, thanks in advance,

[IgorBrigadir]

As far as I know, 1% Sample Stream is based on Twitter IDs: https://dev.twitter.com/overview/api/twitter-ids-json-and-snowflake

Snowflake IDs are based on a few things other than just a timestamp - and maybe changed over time, but there’s an old post I found useful: http://blog.falcondai.com/2013/06/666-and-how-twitter-samples-tweets-in.html

But remember that this post was from 2013, and things may have changed considerably since then:

Potential adjustments to Streaming API sample volumes

The public Streaming API sample endpoints (aka POST statuses/filter and GET statuses/sample) are intended to be levelled at approximately 1% of the public Tweet volumes at any time. Due to some past inconsistencies in configuration, there have been periods of time where the volumes of Tweets delivered via the Streaming API may have exceeded these parameters. This notice is to indicate that over the next couple of weeks, we will be making changes to the public Streaming API to rebalance the v…

[jupiterhyun]

Thanks for your reply, that somehow help me:grinning: