Description of issue:
Can’t get why my card isnt valid. Twitterbot is allowed.
my robots.txt looks like
User-agent: Twitterbot
Allow: *
User-agent: *
Disallow:
You can use
> Blockquote or `` preformatted text to post the link
Can you provide a link to the page that is not working in the validator?
Yep)
http://staging-symfony-noveogroup-ru.noveogroup.com/vacancy/inzhener-infrastruktury-devops-engineer123
http://staging-symfony-noveogroup-ru.noveogroup.com/robots.txt shows
User-agent: *
Disallow:
are you sure you’re not seeing a different version due to caching or incomplete deployment, for example?
Sorry, i’ve tried to fix it, and forget get it back. Now robots.txt looks like in topic start but issue still exists
I am still seeing the same robots file that I posted previously on that URL.
sorry again
and sorry for no answering long time
i fixed it now but it didnt help 
Hmm, it shows that this is disallowing all user-agents to /
can i debug it or make something else ?)
can i debug it or make something else ?)
You need to edit http://staging-symfony-noveogroup-ru.noveogroup.com/robots.txt and make sure it’s not cached and loads properly from the outside - it still shows up the same as before - blocking everything so cards won’t work.

I rly sorry it was my mistake
now it looks like on screenshot but problem is the same
now it looks like on screenshot but problem is the same
no, http://staging-symfony-noveogroup-ru.noveogroup.com/robots.txt is still returning:
User-agent: *
Disallow: /
There may be some caching or maybe it’s being changed back again after you change it, either by some script or manually or it’s auto generated - this depends on how your site is set up. I’d try a different device and network to test this to make sure you’re not accidentally loading a local version or something.
1 Like
system
Closed
#17
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.