Tweets/search result contains unwanted tweet which doesnt even contains search keyword

[RajiitGct]

Even i tried without indexing also im getting those tweets.
FYI : I checked search keyword in Twitter “Live” search itself, there itself they shows those tweets which I mentioned above.

[IgorBrigadir]

Yep, you’re right - looking through the “zoho” results, there are a few tweets like https://twitter.com/CouplesRTRM/status/781252692140253184 that have nothing i can make out that matches “zoho” either on profile, tweet or link. It’s definitely something strange going on.

I guess the only thing left to do is maybe report it as a search Issue? https://support.twitter.com/forms/feature_report?feature=search

[RajiitGct]

Thank You so much for this help .

[andypiper]

I agree with @IgorBrigadir that the best way forward on this would be to file a report.

It is important to note that the Search API will return a different result set to the search on the Twitter website for reasons explained in the dev docs, but in this case it seems like some strange results are being seen in both cases.

[RajiitGct]

Yes, I reported via twitter support.

[RajiitGct]

If it API alone , its okay , But in twitter search itself we are getting this view.

[RajiitGct]

Hi , I reported this long time ago. But still its nit resolved. Please do help.

[andypiper]

Can you provide an example of a current issue?

As mentioned previously, the search API is not intended to be a complete index of Tweets, so differences between web search and API search are common. We cannot help with any issues related to search on the web or Twitter apps via the developer forums.

[RajiitGct]

Differences between api search and web search are common , I understood this. But we are getting more offensive/spam content in both the search ( web/api) which are unmatched in our search key.

[hubertdeluxe]

Any update on this issue? I am experiencing the same problem.

[andypiper]

What specific problem are you experiencing? Can you provide examples (code and outputs)?

[hubertdeluxe]

I am searching tweets talking about Personal Protective Equipment (PPE) using this query: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&result_type=recent
I use Standard API to get all tweets for last 7 days, python-twitter library. Among them, I have found tweets from one particular user who’s tweets does not match my keyword. The user’s id is 4831686683. Here are the results:

2018-07-24 11:49:42 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&result_type=recent
2018-07-24 11:49:43 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1021246504525287425&result_type=recent
Hookup with real, sexy older women in your hometown tonight! Completely Free to join:
Create your 100% Free profile to meet hot sexy MILFs in your area or worldwide:

2018-07-24 11:49:43 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1020662248895844352&result_type=recent
Date and Hookup with MILFs and Hot Moms in your area For erotic No Strings Attached Relationships: F
Meet MILFs today for Free and search 1000s of MILFs looking for Casual Sex an Fun in your area:
You are a few mouse clicks away from the sexiest #MILFs in your area! Don’t let them wait: Yeah it’s

2018-07-24 11:49:44 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1020275926855233536&result_type=recent
Chat, date and have fun with hotlocal Milfs & Cougars. Join Completely Free Today!
Join us for Free to View the newest profiles of sexy older women in your hometown:
Meet Hot #MILFs in your Area! Join now for Free and watch naughty video profiles of Hot Milfs:

2018-07-24 11:49:45 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1019912252588265473&result_type=recent
Date a HORNY MILF in your area for sex and fun tonight: Completely Free to join!
Meet Sexually charged women in their prime live online:

2018-07-24 11:49:46 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1019498004464783360&result_type=recent
Local mature hotties are waiting to meet you online! Don’t wait, join us 100% Free right now:
Hook up with real HOT Milfs for adult naughty fun in Your area:
Hookup with real, sexy older women in your hometown tonight! Completely Free to join:

2018-07-24 11:49:47 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1019057227544629248&result_type=recent
Create your 100% Free profile to meet hot sexy MILFs in your area or worldwide:
Real local horny #MILFs r waiting for you here: Join For Free in less than 2
minutes
Date and Hookup with MILFs and Hot Moms in your area For erotic No Strings Attached Relationships:

2018-07-24 11:49:47 - 7556 - TweetSearcher - Query set to: q=PPE%20-filter%3Aretweets%20-filter%3Amedia%20filter%3Alinks&lang=en&count=100&max_id=1018533045719232514&result_type=recent
Meet naughty MILFs today for Free and search 1000s of MILFs looking for Casual Sex in Your city:
Meet MILFs today for Free and search 1000s of MILFs looking for Casual Sex an Fun in your area:
Chat, date and have fun with hotlocal Milfs & Cougars. Join Completely Free Today!
Hot #MILFs for sex, love, and romance are waiting here to meet you Oh yeah, it’s Free
to join!

[andypiper]

What’s one of the Tweet IDs for the matched Tweets? could there be anything in that user’s profile that matches? If it is just one user, you can exclude the user using a negative operator e.g. -from:username

[hubertdeluxe]

It is not just one user. That one was what I discovered. There are multiple users. I have run it again and here is the result:
336 tweets out of 789 total tweets do not match search keyword.
Roughly 50% of 336 tweets are talking about MILF.

[andypiper]

Can you provide a specific individual Tweet ID that you do not expect to match the search term?

[hubertdeluxe]

Here are the first 20 of them:
1021701630507581441
1021693539535736833
1021693342126628867
1021676968121643009
1021676748629569536
1021661322503696384
1021659141985783808
1021654729561133056
1021639972410073088
1021633768967294976
1021595563232514048
1021586130473373696
1021583823153377280
1021581075175354368
1021577503884894208
1021552269710376960
1021540825724084227
1021540644278427648
1021536995296927748
1021535704889913345

[andypiper]

I took the first of these, and fetched the complete JSON body.

It contains a t.co link that points to a shortened URL. That URL expands to another URL, that contains the string “PPE”.

So, the search in this case is matching on the full target expanded URL. Your search is specifically requesting Tweets that contain links (filter:links). Unfortunately the API does not have a way to prevent that parameter in the target URL from being picked up. You’ll need to filter out the URLs in your query using the -term syntax. I’ve just run the same query using the target URL name in my negative query alongside the PPE as the main keyword, and it seems to come out cleaner.

[hubertdeluxe]

Do you mean -url:PPE parameter? I also receive tweets without a match even in the most unrolled URL. Search by the same query with -url:PPE returns also this tweet 1021852756372582400 where only the username and screen_name contain the substring “PPE”. I assume that the Standard API search does the keyword search against the JSON string of a tweet, correct?

[LeBraat]

That operator should do the trick.

I would also suggest that you negate the specific username that you picked up with that latest Tweet example that you provided.

And you are correct with your last statement.

I suggest you apply for a developer account to try out some of our new, Premium APIs, specifically Premium Search. We do have a free Sandbox version that you can play around with that might help make these searches easier.

[andypiper]