CDN server preventing images on twittercard

wengerball · 2014-03-24T14:38:42.000Z

On MaxCDN I have HTTP Referrer Whitelist set for my domains to prevent hotlinking. However doing this prevents twitter or other sites picking up images from my CDN.

I’ve tried adding *.twitter.com & other variations to my referrer whitelist however that doesn’t help.

Should I completely disable referrer whitelisting on my cdn or am i simply adding the wrong domain to my whitelist?

petermeech · 2014-03-25T18:43:45.000Z

I am having the same issue, cards work fine on the test server but the live server (also MaxCDN) does not show the cards. Any advice would be gratefully received/

rchoi · 2014-03-26T04:11:37.000Z

I would consider these techniques to allow access based on User Agent, if it helps?

https://dev.twitter.com/docs/cards/troubleshooting#robots

petermeech · 2014-03-26T11:23:29.000Z

Thanks for your response @rchoi, it was simple in the end I just didn’t know where to edit the robots.txt file.

@wengerball. Remove your whitelist settings, this will just cause 403’s when twitter tries to read image. Go to your pull zone and manage. There is an SEO tab where you can turn robots.txt on and enter custom values. Just enter these and all should be working again.

User-agent: Twitterbot
Disallow:

rchoi · 2014-04-07T06:22:04.000Z

@petermeech,

Thanks for updating us. It’s a little tricky, and glad you got it working!

(Also really happy you’re sharing back to others; super helpful.)

Let us know how we can be of use moving forward!