Unable to render Card preview

php
cards
wordpress

#1

Hi Guys,

I am trying to check Card preview but i am getting this ‘ERROR: Fetching the page failed because it’s denied by robots.txt.’ error.

For this i have added some code in robot.txt:

User-Agent: google
User-Agent: googlebot
User-agent: Twitterbot
Crawl-delay: 10

User-agent: *
Disallow: /

But still getting issue. Can any update help me on this


#2

We require a link to the site in order to understand what is happening. Please confirm you’ve been through the troubleshooting post.


#3

Here is link: http://themarketmogul.com/ai-will-not-spell-end-lawyers/


#4
$ curl -A Twitterbot http://themarketmogul.com/robots.txt                             
User-Agent: google
User-Agent: googlebot
Disallow: /wp-content/plugins/
Disallow: /readme.html
Disallow: /wp-admin
Crawl-delay: 10

User-agent: *
Disallow: /

You are explicitly preventing Twitterbot from access to your site.


#5

This is older one. Currently setting is : User-Agent: google
User-Agent: googlebot
User-agent: Twitterbot
Disallow: /wp-content/plugins/
Disallow: /readme.html
Disallow: /wp-admin
Crawl-delay: 10

User-agent: *
Disallow: /


#6

Is i need to change any setting on server.


#7

Your old robots.txt file must be cached somewhere because I cannot see the version you are referring to.


#8

If you hit this url ‘http://themarketmogul.com/robots.txt’ in browser then you will see the latest one.


#9

And i checked this response using curl hit. I am getting latest robot file. So please check what is the issue now.


#10

I’m still seeing the old file - I suspect CloudFlare is caching your older version.


#11

My robot file issue is fixed but in am getting no meta tags found.But in my page source i can see meta tags. here is the url: view-source:http://themarketmogul.com/ai-will-not-spell-end-lawyers/


#12

And i am trying to share this url on twitter http://themarketmogul.com/taming-technology/ but when i check my tweet there is not desciption or image for url


#13

You’re providing a link to a 404 page. I’ve just manually validated your other URL and it shows up fine.


#14

http://themarketmogul.com/ai-will-not-spell-end-lawyers/ check this


#15

Page not found. I cannot help you. Your site’s cards are working fine, but if you’re trying to post a 404 page then it won’t show a card.


#16

Open this : http://themarketmogul.com/ai-will-not-spell-end-lawyers/


#17


#18

I’m unable to help further. Cards on your other pages render just fine when the URLs are shared. Good luck in figuring out what is going on there (your logs may be helpful)


#19

And i am trying to tweet a url and did not get image and description

there


#20

I see cards all the way down your account timeline at the moment. Are you using any ad blockers or other scripting tools that might interfere with Twitter’s web Javascript?