I’m using a python library called Tweepy and I’m not sure about the IDs since the list is multiple GBs in size. This is a research project that was requested so I have to load in the IDs 100 at a time.
I don’t have the code on this computer I’m using currently, but at a high level, it’s doing the following.
- Open the IDs.txt
- Read each line until you’ve gathered 100 IDs or EOF
- Send the IDs to the API
- Store response in list
- Loop through that list and write each returned user to a file
- Clear both lists
- Rest for X time (since this is looping I’m attempting to be respectful of the rate limiting)