Suddenly no Card available: WARN: No metatags found

BS_Verkehr · 2018-01-28T18:52:07.715Z

URL affected:https://www.verkehrsinfo-braunschweig.de/forum/viewtopic.php?t=9783
(and many others of my forum-sites!)

Sorry for my bad english:

For a long time “Twitter card” worked perfectly with my Website! Suddenly, since a few days ago, tweets from my website to Twitter shows no card/pic and stopped working. So I testet with Card Validator. It shows an error:

INFO: Page fetched successfully
WARN: No metatags found

Next I testet as suggested with “Curl -A Twitterbot (URL)” and all Twitter-metatags are visible. The source code of the website has not been changed, since Twitter Card worked without any problems.

I tried the troubleshooting steps already!

Thanks in advance for your help and suggestions.

Andy

ran5000 · 2018-01-29T07:13:53.694Z

Hello,

I’m trying to access the URL you’ve mentioned (https://www.verkehrsinfo-braunschweig.de/forum/viewtopic.php?t=9783) and getting a 403 error:

image.png2738x1114 304 KB

there seems to be an location based IP filtering

BS_Verkehr · 2018-01-29T08:41:18.404Z

That’s possible. This is temprarily since beginning of 2018. We had brute-force attacks from some IPs/Provider/countries, so we had them to lock up. The Twitter-Server AND Twitterbot are NOT affected! However, the problems with Twitter Cards started last week, Jan.24.

And I see the blocked traffic in the daily error-log. There are no entries from Twitter or Twitterbot.

ran5000 · 2018-01-29T09:04:03.519Z

are you sure the Twitterbot is not blocked, i’ve just tried while changing the user-agent in curl and the call was blocked:

 ~  curl -s -A Twitterbot https://www.verkehrsinfo-braunschweig.de/forum/viewtopic.php\?t\=9783 | grep twitter
 ~

BS_Verkehr · 2018-01-29T09:42:14.249Z

Yes, in your case this is ok. Because your call comes from a blocked IP of “IL” currently. From MY location with the same curl-command I can see the source-code perfectly.

I have canceled the brute-force-lock and you should be able to see the page now, too.

But: Let me tell you again: This has nothing to do with the traffic from “real”-Twitter-ASN/ISP and twitterbot itself! Every access from the real Twitterbot will be passed by! This worked perfectly for years - 'til last week. I still cannot see any blocked traffic from twitter and twitterbot in the server-log. All calls from there are ok.

So I understand the error message by Card Validator:
INFO: Page fetched successfully
WARN: No metatags found

So there can’t be a block or anything else for Twitterbot, because the error message says itself that the page is readable (“Page fetched successfully”) and also the meta-tags for the twitter-cards are available in the “Head”-section! Logically, the Twitterbot can not be blocked by my website!

I think to solve the problem, a “Twitter”-employee would have to do a test directly with the real Twitterbot.

andypiper · 2018-01-29T12:02:19.071Z

Looks like the site is returning HTTP 502 when the crawler tries to hit it.

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>502 Proxy Error</title>
</head><body>
<h1>Proxy Error</h1>
<p>The proxy server received an invalid
response from an upstream server.<br />
The proxy server could not handle the request <em><a href="/forum/viewtopic.php/">GET&nbsp;/forum/viewtopic.php/</a></em>.<p>
Reason: <strong>Error reading from remote server</strong></p></p>
</body></html>

BS_Verkehr · 2018-01-29T19:43:05.871Z

Thanks für your response. But I cant’t understand the 502 Proxy Error.
There is no proxy running. And I see no 502 Errors in my server error-log.
I’ve checked all possibilities!

There are no problems with Googlebot (Checked on Webmastertools), Bingbot or other crawling bots on the website.

My visitors have also reported no access errors on my site, and my own tests shows no errors at all.

This test http://downforeveryoneorjustme.com/verkehrsinfo-braunschweig.de shows, that the site ist up, too.

The problem with Twitter-Cards occurs suddenly between 23th and 24th of January without any changes on my site or the server. So I think it must be a Twitter-problem!

Is it possible that the Twitterbot comes to my site via a “proxy server” which have errors? I think there could’t be another reason for this “proxy”-error.

I’m in touch with my hoster STRATO in Germany and have set up a test-page!

Braunschweiger Verkehrsinfo

Löwen machen �Riesenschritt� in Richtung Klassenerhalt

Braunschweig. Die Basketball Löwen feierten vor 2862 Zuschauer in der heimischen Volkswagen Halle einen wichtigen Sieg gegen die Rockets aus Erfurt. Erst in der Schlussphase entschieden die Braunschweiger das Spiel zu ihren Gunsten mit 82:68 (34:38)....

This site has been testet with no errors, but only Card-Validator shows:
Again:
INFO: Page fetched successfully
WARN: No metatags found

andypiper · 2018-01-29T20:16:36.224Z

Yes, that is possible.

There are a few networking issues that we are internally working on currently and they may be related. If this is the case, we appreciate your patience while we work through our infrastructure teams, and apologize for the temporary inconvenience.

If you would be kind enough to bear with us for a few days, we can revisit whether this continues to be a problem for these sites.

BS_Verkehr · 2018-01-29T20:19:21.546Z

Thank you very much for your help. I will wait a few days and hope, you can fix it.

BS_Verkehr · 2018-01-30T18:15:41.387Z

It seems, that the problem has been solved. Twitter Card-Validator finds the Metatags again, and the card/pic is displayed correct on my timeline again.

Meanwhile I got a response from my provider STRATO, too. They told me, that there was no problems with their servers or my website.

Thanks for your support, @andypiper and thanks to the Twitter-Staff, too, for solving the problem so fast!

system · 2018-02-13T18:15:43.613Z

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.