Twarc not recognized in the command line

[AbeerAz84396805]

Hi,

I have installed twarc in the command prompt with the command:
pip install twarc (which works).
But, now when I type in the command “twarc configure”, it returns: " ‘twarc’ is not recognized as an internal or external command, operable program or batch file.". I have tried multiple times but still getting the same message.

I am a tiny bit more familiar with the Python environments, but not too comfortable with running the code from the command line. Could someone please suggest a fix?

[IgorBrigadir]

Are you using windows? Maybe this will help Windows 10 - twarc

Also, for Academic Endpoint using v2 API it’s twarc2 configure, unfortunately it’s separate to twarc configure

[AbeerAz84396805]

Yes, I am using windows. I think it has something to do with the path.
I tried twarc2 configure as well, but no luck.

[IgorBrigadir]

Yes, this is a common issue with windows - how did you install Python? This matters to how the PATH is set - did any of the Windows 10 - twarc commands and settings work?

[AbeerAz84396805]

I can’t get past the first command for install. When I run the install command again, it says that the requirement has been satisfied. I attached a screenshot of the message that I get.
I originally downloaded python from its website, for windows. Later I downloaded Anaconda since I had to use some editors on there. Now I use python through Anaconda.

[IgorBrigadir]

If you have anaconda, can you try running all the commands through “Anaconda Prompt” and not the default “Windows Command Line”. you should see (base) in the prompt if it worked. Running the twarc commands in Anaconda Prompt should work (unfortunately i don’t have windows running to make sure right now)

[AbeerAz84396805]

Thank you so much for your help. It worked in Anaconda.prompt… yay!

Is it not prescribed to use twarc as a library? Does it have the same functionality when used as a library, as it does in the command line?
Also, would you suggest using the basic JSON file for big data (consisting of millions of tweets?) or should one use another database to go with it?

[IgorBrigadir]

Sure - twarc can work either way, to use it as a library, this is a good place to start:

Help with full archive search with Tweepy or easy Python alternative

Hopefully not! The twarc API docs are here: twarc.Client2 - twarc The minimal example would be: import datetime from twarc.client2 import Twarc2 from twarc.expansions import ensure_flattened # Your bearer token here t = Twarc2(bearer_token="A...z") # Start and end times must be in UTC start_time = datetime.datetime(2021, 3, 21, 0, 0, 0, 0, datetime.timezone.utc) end_time = datetime.datetime(2021, 3, 22, 0, 0, 0, 0, datetime.timezone.utc) # search_results is a generator, max_results is max…

Functionality it is the same, but command line makes things slightly more convenient

I would recommend keeping the original API responses exactly how twarc stores them: as new line delimited json, 1 response per line. This means that you can process and change to whatever database you need later on. It depends on what your analysis is.

Some useful things may be:

Convert to 1 tweet per line as opposed to 1 response with a set of tweets and metadata:

twarc2 flatten results.jsonl tweets.jsonl

Or install twarc-csv with pip install twarc-csv and convert to a CSV for importing into other tools:

twarc2 csv results.jsonl tweets.csv

[AbeerAz84396805]

Great! Thank you so much for the links and suggestions. You have been a great help.