Empty Media entities on tweets containing media

[juam]

Is it possible that streaming API is not sending the media entities nor the urls?
For example the tweet https://twitter.com/JuanTrino1980/status/560247258093211648 was delivered
using:

curl https://stream.twitter.com/1.1/statuses/filter.json' --data 'track=%23f00b4r' ... :

   {
     "timestamp_ms": "1422408329877",
     "lang": "und",
     "filter_level": "low",
     "possibly_sensitive": false,
     "retweeted": false,
     "favorited": false,
     "entities": {
       "symbols": [],
       "user_mentions": [],
       "urls": [],
       "trends": [],
       "hashtags": [
         {
           "indices": [
             0,
             7
           ],
           "text": "f00b4r"
         }
       ]
     },
     "favorite_count": 0,
     "retweet_count": 0,
     "in_reply_to_status_id_str": null,
     "in_reply_to_status_id": null,
     "truncated": false,
     "source": "Twitter Web Client",
     "text": "#f00b4r http://t.co/dWngZu4wEe",
     "id_str": "560247258093211648",
     "id": 560247258093211650,
     "created_at": "Wed Jan 28 01:25:29 +0000 2015",
     "in_reply_to_user_id": null,
     "in_reply_to_user_id_str": null,
     "in_reply_to_screen_name": null,
     "user": {
       "notifications": null,
       "follow_request_sent": null,
       "following": null,
       "default_profile_image": false,
       "default_profile": true,
       "utc_offset": -10800,
       "created_at": "Mon Aug 04 13:13:37 +0000 2014",
       "statuses_count": 93,
       "favourites_count": 0,
       "listed_count": 0,
       "friends_count": 3,
       "followers_count": 2,
       "verified": false,
       "id": 2706522510,
       "id_str": "2706522510",
       "name": "Juan trino",
       "screen_name": "JuanTrino1980",
       "location": "Buenos Aires, Argentina",
       "url": null,
       "description": null,
       "protected": false,
       "time_zone": "Buenos Aires",
       "geo_enabled": false,
       "lang": "en",
       "contributors_enabled": false,
       "is_translator": false,
       "profile_background_color": "C0DEED",
       "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png",
       "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png",
       "profile_background_tile": false,
       "profile_link_color": "0084B4",
       "profile_sidebar_border_color": "C0DEED",
       "profile_sidebar_fill_color": "DDEEF6",
       "profile_text_color": "333333",
       "profile_use_background_image": true,
       "profile_image_url": "http://pbs.twimg.com/profile_images/496283495279247360/BIw_Q1fP_normal.jpeg",
       "profile_image_url_https": "https://pbs.twimg.com/profile_images/496283495279247360/BIw_Q1fP_normal.jpeg"
     },
     "geo": null,
     "coordinates": null,
     "place": null,
     "contributors": null
   }

[juam]

Rest API returns more data:

{
  "lang": "und",
  "possibly_sensitive": false,
  "retweeted": false,
  "favorited": false,
  "extended_entities": {
    "media": [
      {
        "sizes": {
          "small": {
            "resize": "fit",
            "h": 212,
            "w": 340
          },
          "medium": {
            "resize": "fit",
            "h": 375,
            "w": 600
          },
          "large": {
            "resize": "fit",
            "h": 400,
            "w": 640
          },
          "thumb": {
            "resize": "crop",
            "h": 150,
            "w": 150
          }
        },
        "type": "photo",
        "id": 560247255534682100,
        "id_str": "560247255534682112",
        "indices": [
          8,
          30
        ],
        "media_url": "http://pbs.twimg.com/media/B8Zl6RyIQAAre-g.png",
        "media_url_https": "https://pbs.twimg.com/media/B8Zl6RyIQAAre-g.png",
        "url": "http://t.co/dWngZu4wEe",
        "display_url": "pic.twitter.com/dWngZu4wEe",
        "expanded_url": "http://twitter.com/JuanTrino1980/status/560247258093211648/photo/1"
      }
    ]
  },
  "entities": {
    "media": [
      {
        "sizes": {
          "small": {
            "resize": "fit",
            "h": 212,
            "w": 340
          },
          "medium": {
            "resize": "fit",
            "h": 375,
            "w": 600
          },
          "large": {
            "resize": "fit",
            "h": 400,
            "w": 640
          },
          "thumb": {
            "resize": "crop",
            "h": 150,
            "w": 150
          }
        },
        "type": "photo",
        "id": 560247255534682100,
        "id_str": "560247255534682112",
        "indices": [
          8,
          30
        ],
        "media_url": "http://pbs.twimg.com/media/B8Zl6RyIQAAre-g.png",
        "media_url_https": "https://pbs.twimg.com/media/B8Zl6RyIQAAre-g.png",
        "url": "http://t.co/dWngZu4wEe",
        "display_url": "pic.twitter.com/dWngZu4wEe",
        "expanded_url": "http://twitter.com/JuanTrino1980/status/560247258093211648/photo/1"
      }
    ],
    "urls": [],
    "user_mentions": [],
    "symbols": [],
    "hashtags": [
      {
        "indices": [
          0,
          7
        ],
        "text": "f00b4r"
      }
    ]
  },
  "favorite_count": 0,
  "retweet_count": 0,
  "in_reply_to_status_id_str": null,
  "in_reply_to_status_id": null,
  "truncated": false,
  "source": "Twitter Web Client",
  "text": "#f00b4r http://t.co/dWngZu4wEe",
  "id_str": "560247258093211648",
  "id": 560247258093211650,
  "created_at": "Wed Jan 28 01:25:29 +0000 2015",
  "in_reply_to_user_id": null,
  "in_reply_to_user_id_str": null,
  "in_reply_to_screen_name": null,
  "user": {
    "notifications": false,
    "follow_request_sent": false,
    "following": true,
    "default_profile_image": false,
    "default_profile": true,
    "profile_use_background_image": true,
    "profile_text_color": "333333",
    "profile_sidebar_fill_color": "DDEEF6",
    "utc_offset": -10800,
    "favourites_count": 0,
    "created_at": "Mon Aug 04 13:13:37 +0000 2014",
    "listed_count": 0,
    "friends_count": 3,
    "followers_count": 2,
    "protected": false,
    "entities": {
      "description": {
        "urls": []
      }
    },
    "id": 2706522510,
    "id_str": "2706522510",
    "name": "Juan trino",
    "screen_name": "JuanTrino1980",
    "location": "Buenos Aires, Argentina",
    "profile_location": null,
    "description": "",
    "url": null,
    "time_zone": "Buenos Aires",
    "geo_enabled": false,
    "verified": false,
    "statuses_count": 94,
    "lang": "en",
    "contributors_enabled": false,
    "is_translator": false,
    "is_translation_enabled": false,
    "profile_background_color": "C0DEED",
    "profile_background_image_url": "http://abs.twimg.com/images/themes/theme1/bg.png",
    "profile_background_image_url_https": "https://abs.twimg.com/images/themes/theme1/bg.png",
    "profile_background_tile": false,
    "profile_image_url": "http://pbs.twimg.com/profile_images/496283495279247360/BIw_Q1fP_normal.jpeg",
    "profile_image_url_https": "https://pbs.twimg.com/profile_images/496283495279247360/BIw_Q1fP_normal.jpeg",
    "profile_link_color": "0084B4",
    "profile_sidebar_border_color": "C0DEED"
  },
  "geo": null,
  "coordinates": null,
  "place": null,
  "contributors": null
}

[johnbarratt]

We are seeing the same thing from about 7.5 hours ago (about 21:30UTC on the 27th), along with other strangeness in the entities.

Random example I just picked gives media entities via the rest API for ‘560291409522335746’ but when it came through on the streaming API the media key was missing altogether :

"entities":{
  "hashtags":[],
  "trends":[],
  "urls":[],
  "user_mentions":[{"screen_name":"MelissaGeise","name":"Melissa Geise","id":56539140,"id_str":"56539140","indices":[15,28]}],
  "symbols":[]
}

Also note that user @libbydink is missing from the above entities, but does appear in the REST API output, and there appears to be new, undocumented entities here ‘trends’, and ‘symbols’.

JB.

[macinux]

same issue here. no media even it has photos posted.

[bentinata]

Maybe it’s because new video support. On other post I see they got extended_entities field.

[macinux]

extended_entities

maybe. but I can not see extended_entities in the jsonString. It’s just frustrating.

[yunwei]

Yea, especially with tweets with media entity.

[zorrobiwan]

Problem still there

[andypiper]

Thanks for all the reports. We will investigate. Per the announcement forum, extended entities for GIFs and Video should be populated in early Feb, but this shouldn’t affect existing image / media support.

[bentinata]

Thanks, right now my services is calling REST API everytime Stream API trigger.

[andypiper]

The team is looking into this issue as a priority. Thanks for your patience.

[emisiona]

Just let you know we are having the same problem here. Media entities come empty even if the tweet has images attached.

[kohner86]

We’re experiencing the same issue. The ‘media’ property on the ‘entities’ object is completely missing.

[zorrobiwan]

Thx Andy.

Any ETA ?

[thebryza]

We are also experiencing this issue on the streaming API.

[andypiper]

We believe the issue that caused this has been resolved - are media entities no visible to others?

[thebryza]

I just did a test post, and received the correct data. I will keep testing but initial report would be that this looks fixed.

[basthebuilder]

Fixed for me too!

[juam]

Seems to work for me! Thanks

[bentinata]

Thanks.