"Fetching the page failed due to an internal error" for AngularJs app

u3k · 2014-05-08T15:28:06.000Z

We have an issue with Card Validator tool. Our app is AngularJs-based and static to crawler is served with PhantomJs server.

Facebook Open Graph debugger works for us just fine, but Twitter Card Validator fails with:
“Fetching the page failed due to an internal error, debugId: 2559285950435-374620”

Url is: http://strollaround-stage-136089290.us-east-1.elb.amazonaws.com/#!/

jbulava · 2014-05-09T03:35:01.000Z

I assume you may be having an issue due to the robots.txt file. It does seem like our Twitterbot is able to access your image directory. Please take a look at the link below and if a change to your robots doesn’t work, please let us know.

https://dev.twitter.com/docs/cards/troubleshooting#twitterbot

boibucom · 2014-06-26T09:58:46.000Z

Hi, we are having the same issue and its certainly not a robots.txt issue, we already changed it.
We have migrated to some other hosting provider, and for some reason twitter cards are not working anymore, we get:

Fetching the page failed due to an internal error, debugId: 5657572429548-989412

jbulava · 2014-06-26T15:29:08.000Z

Please provide an example URL on your domain and I’ll look into it further.

hpzwetsloot · 2014-06-26T15:37:28.000Z

My mather is on the behalf of an human error coase of devices unshortcommings.

playbox21 · 2014-09-30T21:48:01.585Z

Hi jbulava,

We’re having the same issue. Twitter can’t see the twitter card that is put on the page by javascript. Here’s the test url that dynamically generates meta tags.
http://www.weather.com/trash/social_share3.html

and going through phantomjs
http://phantomjs.web.weather.com/http://www.weather.com/trash/social_share3.html

Thanks

joncipriano · 2014-09-30T22:42:48.635Z

@u3k, if you omit the last part of the URL (#!/) the URL appears to validate fine.

@playbox2, Twitter will not execute client-side javascript. The meta tags have to be rendered server-side. I am not too familiar with phantomjs, but for you second URL it appears that phantomjs is not rendering the meta tags for the Twitter bot as it is for web browsers.

playbox21 · 2014-09-30T23:25:41.431Z

@joncipriano thx for responding. To my understanding, phantomjs is meant to execute all javascript then render the page to the bot. Facebook is working correctly.

Here’s another variation to of the url to go through phantomjs phantomjs.web.weather.com/weather.com/trash/social_sharing5.html

However it’s still getting no card found (card error)