Description of issue:
Can’t get why my card isnt valid. Twitterbot is allowed.
my robots.txt looks like

User-agent: Twitterbot
Allow: *

User-agent: *
Disallow:

You can use

> Blockquote or `` preformatted text to post the link

Can you provide a link to the page that is not working in the validator?

Yep)
http://staging-symfony-noveogroup-ru.noveogroup.com/vacancy/inzhener-infrastruktury-devops-engineer123

http://staging-symfony-noveogroup-ru.noveogroup.com/robots.txt shows

User-agent: *
Disallow:

are you sure you’re not seeing a different version due to caching or incomplete deployment, for example?

Sorry, i’ve tried to fix it, and forget get it back. Now robots.txt looks like in topic start but issue still exists

I am still seeing the same robots file that I posted previously on that URL.

sorry again :frowning: and sorry for no answering long time
i fixed it now but it didnt help :anguished:

Hmm, it shows that this is disallowing all user-agents to /

how can i fix it ?)

can i debug it or make something else ?)

can i debug it or make something else ?)

You need to edit http://staging-symfony-noveogroup-ru.noveogroup.com/robots.txt and make sure it’s not cached and loads properly from the outside - it still shows up the same as before - blocking everything so cards won’t work.

Снимок экрана от 2020-05-21 16-11-54
I rly sorry it was my mistake
now it looks like on screenshot but problem is the same

now it looks like on screenshot but problem is the same

no, http://staging-symfony-noveogroup-ru.noveogroup.com/robots.txt is still returning:

User-agent: *

Disallow: /

There may be some caching or maybe it’s being changed back again after you change it, either by some script or manually or it’s auto generated - this depends on how your site is set up. I’d try a different device and network to test this to make sure you’re not accidentally loading a local version or something.

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.