I get always the same error, and meta tags already exist.
For me, that row is absolutely ununderstandable which contains “http://szarkak.hu/robotok.html”.
This file contains “User-agent: * Crawl-delay: 30” but I don’t know how it is generated, I can’t see in the directory my scripts dont generate such a file. 
Following the steps in our FAQ troubleshooting post, I fetched the page using curl:
$ curl -A Twitterbot http://szarkak.hu
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="http://szarkak.hu/robotok.html">here</a>.</p>
</body></html>
$ curl -v -L -A Twitterbot http://szarkak.hu
* Rebuilt URL to: http://szarkak.hu/
* Trying 92.43.203.182...
* Connected to szarkak.hu (92.43.203.182) port 80 (#0)
> GET / HTTP/1.1
> Host: szarkak.hu
> User-Agent: Twitterbot
> Accept: */*
>
< HTTP/1.1 302 Found
< Date: Sat, 27 Aug 2016 18:55:59 GMT
< Server: Apache
< Location: http://szarkak.hu/robotok.html
< Content-Length: 214
< Connection: close
< Content-Type: text/html; charset=iso-8859-1
<
* Closing connection 0
* Issue another request to this URL: 'http://szarkak.hu/robotok.html'
* Hostname szarkak.hu was found in DNS cache
* Trying 92.43.203.182...
* Connected to szarkak.hu (92.43.203.182) port 80 (#1)
> GET /robotok.html HTTP/1.1
> Host: szarkak.hu
> User-Agent: Twitterbot
> Accept: */*
>
< HTTP/1.1 302 Found
< Date: Sat, 27 Aug 2016 18:55:59 GMT
< Server: Apache
< Location: http://szarkak.hu/robotok.html
< Content-Length: 214
< Connection: close
< Content-Type: text/html; charset=iso-8859-1
<
... (endless loop of redirects)
You’ll need to ensure that your page is accessible to Twitterbot.
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.