ERROR: Fetching the page failed because it resulted in too many redirects


#1

I get always the same error, and meta tags already exist.

For me, that row is absolutely ununderstandable which contains “http://szarkak.hu/robotok.html”.
This file contains “User-agent: * Crawl-delay: 30” but I don’t know how it is generated, I can’t see in the directory my scripts dont generate such a file. :frowning:


#2

Following the steps in our FAQ troubleshooting post, I fetched the page using curl:

$ curl -A Twitterbot http://szarkak.hu
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="http://szarkak.hu/robotok.html">here</a>.</p>
</body></html>

$ curl -v -L -A Twitterbot http://szarkak.hu
* Rebuilt URL to: http://szarkak.hu/
*   Trying 92.43.203.182...
* Connected to szarkak.hu (92.43.203.182) port 80 (#0)
> GET / HTTP/1.1
> Host: szarkak.hu
> User-Agent: Twitterbot
> Accept: */*
>
< HTTP/1.1 302 Found
< Date: Sat, 27 Aug 2016 18:55:59 GMT
< Server: Apache
< Location: http://szarkak.hu/robotok.html
< Content-Length: 214
< Connection: close
< Content-Type: text/html; charset=iso-8859-1
<
* Closing connection 0
* Issue another request to this URL: 'http://szarkak.hu/robotok.html'
* Hostname szarkak.hu was found in DNS cache
*   Trying 92.43.203.182...
* Connected to szarkak.hu (92.43.203.182) port 80 (#1)
> GET /robotok.html HTTP/1.1
> Host: szarkak.hu
> User-Agent: Twitterbot
> Accept: */*
>
< HTTP/1.1 302 Found
< Date: Sat, 27 Aug 2016 18:55:59 GMT
< Server: Apache
< Location: http://szarkak.hu/robotok.html
< Content-Length: 214
< Connection: close
< Content-Type: text/html; charset=iso-8859-1
<
... (endless loop of redirects)

You’ll need to ensure that your page is accessible to Twitterbot.


#3

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.