Video Entities are empty in search result

video
api

#1

Hello, one of the user of Tweetinvi has recently encountered an issue that I am able to reproduce.

It is similar to a very old one : https://twittercommunity.com/t/tweet-entities-in-search-api-are-inconsistent/7669. video_info node for media entities is empty when performing a search. Please correct me if this is specified anywhere within the documentation.

https://api.twitter.com/1.1/statuses/show.json?id=694047635326414848

Returns the video_info node correctly.

https://api.twitter.com/1.1/search/tweets.json?q=Thanks%20for%20being%20the%20be
st%20sport.%20&result_type=mixed&count=50&include_entities=1

The video_info node of the same tweet (694047635326414848)does not exist.

Here are the json received :

WITH VIDEO_INFO :

{“created_at”:“Mon Feb 01 06:40:25 +0000 2016”,“id”:694047635326414848,“id_str”:“694047635326414848”,“text”:“They say Singh is King! \n.@RanveerOfficial is it!! Thanks for being the best sport. Epic Dubsmash!! #Loveshhuda19feb https://t.co/LQaZeS6EYa",“source”:"\u003ca href=“http://twitter.com/download/iphone” rel=“nofollow”\u003eTwitter for iPhone\u003c/a\u003e”,“truncated”:false,“in_reply_to_status_id”:null,“in_reply_to_status_id_str”:null,“in_reply_to_user_id”:null,“in_reply_to_user_id_str”:null,“in_reply_to_screen_name”:null,“user”:{“id”:509813128,“id_str”:“509813128”,“name”:“Girish Kumar”,“screen_name”:“girishkumart”,“location”:“Mumbai”,“description”:“an actor in search of the light. Ramaiya Vastavaiya (2013), Loveshhuda (19th Feb 2016). Instagram: @girishkumart”,“url”:“https://t.co/5IiCEpCba1",“entities”:{“url”:{“urls”:[{“url”:“https://t.co/5IiCEpCba1”,“expanded_url”:“http://youtu.be/dqX6OwCHvzQ”,“display_url”:“youtu.be/dqX6OwCHvzQ”,“indices”:[0,23]}]},“description”:{“urls”:[]}},“protected”:false,“followers_count”:71959,“friends_count”:161,“listed_count”:105,“created_at”:"Thu Mar 01 06:35:37 +0000 2012”,“favourites_count”:26,“utc_offset”:19800,“time_zone”:“Mumbai”,“geo_enabled”:true,“verified”:true,“statuses_count”:2751,“lang”:“en”,“contributors_enabled”:false,“is_translator”:false,“is_translation_enabled”:false,“profile_background_color”:“FFF04D”,“profile_background_image_url”:“http://pbs.twimg.com/profile_background_images/378800000157607194/KCU-WfUS.jpeg",“profile_background_image_url_https”:“https://pbs.twimg.com/profile_background_images/378800000157607194/KCU-WfUS.jpeg”,“profile_background_tile”:true,“profile_image_url”:“http://pbs.twimg.com/profile_images/677191513705705472/0zJKoUhL_normal.jpg”,“profile_image_url_https”:“https://pbs.twimg.com/profile_images/677191513705705472/0zJKoUhL_normal.jpg”,“profile_banner_url”:“https://pbs.twimg.com/profile_banners/509813128/1454327252”,“profile_link_color”:“4A913C”,“profile_sidebar_border_color”:“000000”,“profile_sidebar_fill_color”:“C0DFEC”,“profile_text_color”:“333333”,“profile_use_background_image”:true,“has_extended_profile”:true,“default_profile”:false,“default_profile_image”:false,“following”:false,“follow_request_sent”:false,“notifications”:false},“geo”:null,“coordinates”:null,“place”:{“id”:“5c0761bdffa0cb64”,“url”:“https://api.twitter.com/1.1/geo/id/5c0761bdffa0cb64.json”,“place_type”:“city”,“name”:“Pune”,“full_name”:"Pune, Maharashtra”,“country_code”:“IN”,“country”:“India”,“contained_within”:[],“bounding_box”:{“type”:“Polygon”,“coordinates”:[[[73.8031065,18.4571648],[73.9656571,18.4571648],[73.9656571,18.5843633],[73.8031065,18.5843633]]]},“attributes”:{}},“contributors”:null,“is_quote_status”:false,“retweet_count”:110,“favorite_count”:166,“entities”:{“hashtags”:[{“text”:“Loveshhuda19feb”,“indices”:[100,116]}],“symbols”:[],“user_mentions”:[{“screen_name”:“RanveerOfficial”,“name”:“Ranveer Singh”,“id”:68497896,“id_str”:“68497896”,“indices”:[26,42]}],“urls”:[],“media”:[{“id”:694047360154927105,“id_str”:“694047360154927105”,“indices”:[117,140],“media_url”:“http://pbs.twimg.com/ext_tw_video_thumb/694047360154927105/pu/img/tor-V70Qziq38kUl.jpg",“media_url_https”:“https://pbs.twimg.com/ext_tw_video_thumb/694047360154927105/pu/img/tor-V70Qziq38kUl.jpg”,“url”:“https://t.co/LQaZeS6EYa”,“display_url”:“pic.twitter.com/LQaZeS6EYa”,“expanded_url”:“http://twitter.com/girishkumart/status/694047635326414848/video/1”,“type”:“photo”,“sizes”:{“large”:{“w”:480,“h”:480,“resize”:“fit”},“small”:{“w”:340,“h”:340,“resize”:“fit”},“thumb”:{“w”:150,“h”:150,“resize”:“crop”},“medium”:{“w”:480,“h”:480,“resize”:“fit”}}}]},“extended_entities”:{“media”:[{“id”:694047360154927105,“id_str”:“694047360154927105”,“indices”:[117,140],“media_url”:“http://pbs.twimg.com/ext_tw_video_thumb/694047360154927105/pu/img/tor-V70Qziq38kUl.jpg”,“media_url_https”:“https://pbs.twimg.com/ext_tw_video_thumb/694047360154927105/pu/img/tor-V70Qziq38kUl.jpg”,“url”:“https://t.co/LQaZeS6EYa”,“display_url”:“pic.twitter.com/LQaZeS6EYa”,“expanded_url”:“http://twitter.com/girishkumart/status/694047635326414848/video/1”,“type”:“video”,“sizes”:{“large”:{“w”:480,“h”:480,“resize”:“fit”},“small”:{“w”:340,“h”:340,“resize”:“fit”},“thumb”:{“w”:150,“h”:150,“resize”:“crop”},“medium”:{“w”:480,“h”:480,“resize”:“fit”}},“video_info”:{“aspect_ratio”:[1,1],“duration_millis”:9933,“variants”:[{“content_type”:“application/x-mpegURL”,“url”:“https://video.twimg.com/ext_tw_video/694047360154927105/pu/pl/SI0TJEwhjhpvrTEg.m3u8”},{“bitrate”:320000,“content_type”:“video/mp4”,“url”:“https://video.twimg.com/ext_tw_video/694047360154927105/pu/vid/240x240/tJpb_LNMbb0Pj-48.mp4”},{“bitrate”:832000,“content_type”:“video/mp4”,“url”:“https://video.twimg.com/ext_tw_video/694047360154927105/pu/vid/480x480/SO5riADXvafynPcr.mp4”},{“content_type”:“application/dash+xml”,“url”:“https://video.twimg.com/ext_tw_video/694047360154927105/pu/pl/SI0TJEwhjhpvrTEg.mpd”},{“bitrate”:832000,“content_type”:“video/webm”,“url”:“https://video.twimg.com/ext_tw_video/694047360154927105/pu/vid/480x480/SO5riADXvafynPcr.webm”}]}}]},“favorited”:false,“retweeted”:false,“possibly_sensitive”:false,“possibly_sensitive_appealable”:false,“lang”:"en”}

WITHOUT VIDEO_INFO (SEARCH)

{“statuses”:[{“metadata”:{“result_type”:“popular”,“iso_language_code”:“en”},“created_at”:“Mon Feb 01 06:40:25 +0000 2016”,“id”:694047635326414848,“id_str”:“694047635326414848”,“text”:“They say Singh is King! \n.@RanveerOfficial is it!! Thanks for being the best sport. Epic Dubsmash!! #Loveshhuda19feb https://t.co/LQaZeS6EYa",“source”:"\u003ca href=“http://twitter.com/download/iphone” rel=“nofollow”\u003eTwitter for iPhone\u003c/a\u003e”,“truncated”:false,“in_reply_to_status_id”:null,“in_reply_to_status_id_str”:null,“in_reply_to_user_id”:null,“in_reply_to_user_id_str”:null,“in_reply_to_screen_name”:null,“user”:{“id”:509813128,“id_str”:“509813128”,“name”:“Girish Kumar”,“screen_name”:“girishkumart”,“location”:“Mumbai”,“description”:“an actor in search of the light. Ramaiya Vastavaiya (2013), Loveshhuda (19th Feb 2016). Instagram: @girishkumart”,“url”:“https://t.co/5IiCEpCba1",“entities”:{“url”:{“urls”:[{“url”:“https://t.co/5IiCEpCba1”,“expanded_url”:“http://youtu.be/dqX6OwCHvzQ”,“display_url”:“youtu.be/dqX6OwCHvzQ”,“indices”:[0,23]}]},“description”:{“urls”:[]}},“protected”:false,“followers_count”:71984,“friends_count”:161,“listed_count”:105,“created_at”:"Thu Mar 01 06:35:37 +0000 2012”,“favourites_count”:26,“utc_offset”:19800,“time_zone”:“Mumbai”,“geo_enabled”:true,“verified”:true,“statuses_count”:2751,“lang”:“en”,“contributors_enabled”:false,“is_translator”:false,“is_translation_enabled”:false,“profile_background_color”:“FFF04D”,“profile_background_image_url”:“http://pbs.twimg.com/profile_background_images/378800000157607194/KCU-WfUS.jpeg",“profile_background_image_url_https”:“https://pbs.twimg.com/profile_background_images/378800000157607194/KCU-WfUS.jpeg”,“profile_background_tile”:true,“profile_image_url”:“http://pbs.twimg.com/profile_images/677191513705705472/0zJKoUhL_normal.jpg”,“profile_image_url_https”:“https://pbs.twimg.com/profile_images/677191513705705472/0zJKoUhL_normal.jpg”,“profile_banner_url”:“https://pbs.twimg.com/profile_banners/509813128/1454327252”,“profile_link_color”:“4A913C”,“profile_sidebar_border_color”:“000000”,“profile_sidebar_fill_color”:“C0DFEC”,“profile_text_color”:“333333”,“profile_use_background_image”:true,“has_extended_profile”:true,“default_profile”:false,“default_profile_image”:false,“following”:false,“follow_request_sent”:false,“notifications”:false},“geo”:null,“coordinates”:null,“place”:{“id”:“5c0761bdffa0cb64”,“url”:“https://api.twitter.com/1.1/geo/id/5c0761bdffa0cb64.json”,“place_type”:“city”,“name”:“Pune”,“full_name”:"Pune, Maharashtra”,“country_code”:“IN”,“country”:“India”,“contained_within”:[],“bounding_box”:{“type”:“Polygon”,“coordinates”:[[[73.8031065,18.4571648],[73.9656571,18.4571648],[73.9656571,18.5843633],[73.8031065,18.5843633]]]},“attributes”:{}},“contributors”:null,“is_quote_status”:false,“retweet_count”:110,“favorite_count”:166,“entities”:{“hashtags”:[{“text”:“Loveshhuda19feb”,“indices”:[100,116]}],“symbols”:[],“user_mentions”:[{“screen_name”:“RanveerOfficial”,“name”:“Ranveer Singh”,“id”:68497896,“id_str”:“68497896”,“indices”:[26,42]}],“urls”:[],“media”:[{“id”:694047360154927105,“id_str”:“694047360154927105”,“indices”:[117,140],“media_url”:“http://pbs.twimg.com/ext_tw_video_thumb/694047360154927105/pu/img/tor-V70Qziq38kUl.jpg",“media_url_https”:“https://pbs.twimg.com/ext_tw_video_thumb/694047360154927105/pu/img/tor-V70Qziq38kUl.jpg”,“url”:“https://t.co/LQaZeS6EYa”,“display_url”:“pic.twitter.com/LQaZeS6EYa”,“expanded_url”:“http://twitter.com/girishkumart/status/694047635326414848/video/1”,“type”:“photo”,“sizes”:{“large”:{“w”:480,“h”:480,“resize”:“fit”},“small”:{“w”:340,“h”:340,“resize”:“fit”},“thumb”:{“w”:150,“h”:150,“resize”:“crop”},“medium”:{“w”:480,“h”:480,“resize”:“fit”}}}]},“favorited”:false,“retweeted”:false,“possibly_sensitive”:false,“lang”:“en”}],“search_metadata”:{“completed_in”:0.045,“max_id”:694153860290473984,“max_id_str”:“694153860290473984”,“next_results”:"?max_id=694047635326414847&q=Thanks%20for%20being%20the%20best%20sport.&count=1&include_entities=1&result_type=mixed",“query”:“Thanks+for+being+the+best+sport.”,“refresh_url”:"?since_id=694153860290473984&q=Thanks%20for%20being%20the%20best%20sport.&result_type=mixed&include_entities=1",“count”:1,“since_id”:0,“since_id_str”:"0”}}

Thanks for your help.
Linvi


#2

BTW I read the Twitter Video support in REST and Streaming API thread but it was closed in Dec 2015 without any update regarding the search issue.


#3

There hasn’t been any change in the search API to return data for extended entities (video etc) so I’m afraid at the moment the only (very imperfect) solution is to retrieve Tweets with those entities directly using the REST API.


#4

Thanks andy for your prompt reply. I look forward to have this issue fixed.