The validator can get the page, but the bot apparently cannot


#1

Hi,

When the validator tries to fetch the page (example), it succeed, and I get the following:

INFO: Page fetched successfully
INFO: 11 metatags were found
INFO: twitter:card = image tag found
WARN: Not whitelisted

However, when I try the whitelist procedure, it fails with the following error:

The URL you provided for start9.io to use the image card is inaccessible. Please check to make sure the page is available, then reapply for a Twitter card.

I’ve tried twice, just to be sure, but the whitelisting failed both time with the same message - despite the site being clearly functional. The bot even appears in the http logs. Am I missing something?

It is worth noting that the website actually uses a custom rendering for the social bots (since the whole website is angular-based). If you try to get the same page, use the Twitterbot/1.0 user-agent.

Thanks,


#2

Couple of issues here:

  • user agent accepted should just be Twitterbot (well… actually it will work with the version number, but you’re probably best just ignoring that for compatibility, I’d suggest)
  • there is no such card type as “image”