Card vallidations problems: "Failed to crawl url"

magnetis_com_br · 2014-03-17T15:05:18.000Z

I’m trying to validate the card for our blog post, but I’m getting the following error: “Failed to crawl url, debugId: 17527669706581-721171”.

The URL I’m trying to validate is http://blog.magnetis.com.br/apresentando-o-blog-de-investimentos-do-magnetis/.

We are using Wordpress, hosted on WPEngine. I’m adding the meta data via Yoast SEO. The Search Engine Visibility is enabled on WP (Discourage search engines unchecked).

Any reason why the validation tool is unable to crawl?

dttg · 2014-03-17T20:00:25.000Z

same here +1

rchoi · 2014-04-07T06:31:51.000Z

Sorry to hear you’re having trouble.

With regard to CMS systems, have you checked out our CMS Integration guide? It might have helpful pointers:

https://dev.twitter.com/docs/cards/twitter-cards-for-cms-wordpress-blogger-tumblr

AlandaiaSpa · 2014-05-01T11:02:51.000Z

has there been any resolution to the multiple complaints of failed validation ?
This does not look like a serious fact finding from the part of the twitter developers !
Are these twitter cards still up for use ? Or should we just all not bother with it any longer ?

estraschnov · 2014-05-08T15:16:22.000Z

Same here with http://bubble.is Can you check? Thanks

jbulava · 2014-05-09T01:07:00.000Z

Hi Emmanuel,

The S3 Amazon domain does not have a robots.txt which would allow us to crawl your site. You will need to use your bucket name as a subdomain like so: https://BUCKETNAME.s3.amazonaws.com/PATH_TO_IMAGE_WITHOUT_BUCKET_NAME.jpg

Then you can provide a robots.txt of your own on that subdomain to allow our Twitterbot access to your image.

https://BUCKETNAME.s3.amazonaws.com/robots.txt
User-agent: Twitterbot Allow: *

This should solve your issue, but please keep us posted if that is not the case.