Can the .rds files that download when you use the search_tweets and search_fullarchive functions be used to get the tweet data? I messed up how I was writing my data to csv and I want to know if I have to start my query again or can I can get the tweet history from the .rds files.
You mean rds files saved in R? What code / library is saving those?
Generally it should be possible - but if it fails or there’s missing data somehow, as long as you can recover the tweet ids, you can request them directly from the free REST API GET statuses/lookup | Docs | Twitter Developer Platform without much trouble, so making expensive fullarchive searches again should be the very last resort.
when I do a search request using R there is a folder the is created in my working directory that contains and rds file per request made. when I use the readRDS function in R I get whats is called a “large response” in my environment window. I don’t know how to convert this back into the table format that gets pulled across when I originally made my request. Because I and using a loop I and constantly writing over the data after I’ve saved it to csv. But like I said I have messed this csv step up.
also thanks for your response
It would help if you posted a link / sample code that makes the calls - or maybe the rds file itself somewhere? The rds files are R specific, and Twitter returns JSON responses - so it’s already converted somehow, but i suspect it should be possible to extract data from them.
