"Fetching the page failed because it's denied" Error

KeepointLtd · 2013-12-17T10:46:39.000Z

Hi,

Trying to validate Twitter Cards for a client’s site but I’m getting the following error: Fetching the page failed because it’s denied.

The site runs on WordPress with Yoast WordPress SEO.
I have allowed the Twitter Card Metadata via Yoast WordPress SEO and added the Twitter Username.

The site url is: www.private-tuition-liverpool.co.uk

If anyone could help, it would be great!

rchoi · 2013-12-19T07:19:52.000Z

As a starting point, your OG image tag points to http://wp.me/a3SvVk-1u

This is not an image. please have it point to an image and try again.

KeepointLtd · 2013-12-19T10:36:53.000Z

Hi Ryan,

Many thanks for responding.

I’ve tried again with this page: http://www.private-tuition-liverpool.co.uk/pros-cons-investing-private-tutor-new-term/
I’ve ensured the image url was correct but still getting the same message…

rchoi · 2013-12-31T19:39:28.000Z

Thanks for following up. Our systems are having problems with accessing your machine. I’m not sure what the issue is; where are you hosting?

preslavrachev · 2014-01-02T07:14:00.000Z

I am having the exact same problem with: http://ios.discoverpinapp.com

All of our app-related pages has associated twitter card metadata, for instance: http://ios.discoverpinapp.com/app/687888390/

I checked the metadata, and it seems valid to me, but still, I get the “denied” message in the validator

rchoi · 2014-01-03T17:38:16.000Z

I get the error message:

Fetching the page failed because it’s denied by robots.txt.

Please fix your robots.txt:

http://ios.discoverpinapp.com/robots.txt

User-agent: Googlebot
Disallow: /
Allow: /app/

User-agent: *
Disallow: /

MediaSuiteTest · 2014-01-14T04:04:04.000Z

I’m getting the same issue here:

I fixed robots.txt and I’m still getting the same issue. I don’t want to publish the url as a clickable link because it’s a development site that I don’t want indexed, so here it is spelled out.

herbalife dot mercularity.com/demo.php/#!/5563/638966

Any idea why that would be denied?

Notabli · 2014-01-29T21:01:58.000Z

Similar issue. Unable to validate the page where our tags are located, due to page fetch error.

vickyqjx · 2014-08-15T03:08:05.000Z

Same issue.

paulisaac2013 · 2014-08-19T16:10:23.000Z

Yep

andypiper · 2014-08-19T16:32:49.000Z

Please check your robots.txt file allows access for the Twitterbot.
See https://dev.twitter.com/docs/cards/getting-started#crawling for more information on this. If the Twitterbot cannot access your site and URL, you will hit this issue.

FPLassist · 2014-09-02T18:11:08.000Z

How come similar results can be achieved by Facebook without editing robots.txt? I do not have access to robots.txt so cannot make the necessary changes. My Facebook posts look professional, my Tweets look dreadful!

SwiftWiFi_Free · 2015-12-23T08:36:34.482Z

Hello Ryan. I got the same message when I trying to validate my twitter card. ERROR: Fetching the page failed because it’s denied by robots.txt.
I checked our metatags, it looks all valid to me. Could you please check with it. http://www.dotcunited.com/wifitoolbox.html Appreciate it!

andypiper · 2015-12-23T10:33:30.059Z

As I responded on the other thread, it looks like this this is working now that you have fixed your robots.txt