I’m currently storing a users timeline in a database for further analysis. My question is - What is the most efficient method to keep the timeline up to date? My job is running every ten minutes and each time it stores the user_timeline without overlapping tweets.
The issue is that the current retweet count may not be the eventual retweet count so I need to continually update the database. What is the best practice for this type of updating?