Using rtweet in R and reach a limit with Premium

[doujouDC]

Hi, I am using rTweet in R to search the archive. I forgot to save my data as a csv when I ran my R script and I am receiving this message when I try to re-run the script I have only used 32 of my 100 quota.

tweets/search/fullarchive/research ***Warning: list(message = “Request exceeds account’s current package request limits. Please upgrade your package and retry or contact Twitter about enterprise access.”, sent = “2021-05-20T14:55:21+00:00”, transactionId = “009e53d100d92a1f”)

This is my script in R

search_fullarchive("#medlib")

rtmedlib <- search_fullarchive(
  "#medlib",
  n = 500,
  fromDate = 201901010000,
  toDate = 202012310000,
  env_name = "research",
  # safedir = NULL,
  # parse = TRUE,
  # token = NULL,
)

Doug

[IgorBrigadir]

Do you have access to the v2 Academic Access endpoint? Or did you pay for Premium? (If you’re looking for academic access, Premium API is not the thing you should be using)

Maybe this will help:

Not authorised to conduct full archive search

This function calls the v1.1 Premium fullarchive endpoint, a different API, not the v2 academic access. (same as here except in R instead of tweepy) You can use this R package to use the v2 Academic Access: GitHub - cjbarrie/academictwitteR: Repo for academictwitteR package to query the Twitter Academic Research Product Track v2 API endpoint.

[doujouDC]

Hey @IgorBrigadir thanks for the help. Yes, I have premium. It appears that I can still access the archive.

[IgorBrigadir]

Ah ok, in that case, if you didn’t save the original responses somehow, there’s no way to recover them and you’ll have to use up more requests to get them back.

Also, be aware that rtweet will cause you to use MORE requests than necessary - it hard codes the number of results per request to 100, sandbox limit instead of 500 for paid Premium.

I recommend using GitHub - twitterdev/search-tweets-python: Python client for the Twitter 'search Tweets' and 'count Tweets' endpoints (v2/Labs/premium/enterprise). Now supports Twitter API v2 /recent and /all search endpoints. for making Premium Calls, so you can import them into R for analysis instead.