Twitterbot crawls website for cards, bot doesn't care UTM parameters


#1

Users of my app shares URLs inside their tweets.
So twitterbot visits my website for these links and create cards.
But when the page has UTM tracking parameters, Twitterbot crawls same page over and over.

Check my website log below. Twitterbot crawls same page in every 5-10 minutes.

199.16.156.124 - - [14/Jan/2014:09:42:29 +0200] "GET /?utm_source=Celikoza&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.42 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:44:50 +0200] "GET /?utm_source=demokrat16&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.44 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:45:11 +0200] "GET /?utm_source=hoyranreklam&utm_medium=twitter&utm_campaign=notif1&utm_content=14.01.2014.09.45 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:46:43 +0200] "GET /?utm_source=cymrt&utm_medium=twitter&utm_campaign=unlock&utm_content=09.12.2013.20.32 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.124 - - [14/Jan/2014:09:47:09 +0200] "GET /?utm_source=OsmanlOsman1AK&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.47 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.125 - - [14/Jan/2014:09:49:24 +0200] "GET /robots.txt HTTP/1.1" 200 933 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:49:24 +0200] "GET /?utm_source=Karizmatik____&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.49 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.59.148.209 - - [14/Jan/2014:09:49:51 +0200] "GET /robots.txt HTTP/1.1" 200 933 "-" "Twitterbot/1.0"
199.59.148.209 - - [14/Jan/2014:09:49:51 +0200] "GET /robots.txt HTTP/1.1" 200 933 "-" "Twitterbot/1.0"
199.59.148.211 - - [14/Jan/2014:09:49:51 +0200] "GET /?utm_source=denizdogan22&utm_medium=twitter&utm_campaign=teasetweet&utm_content=14.01.2014.09.49 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.59.148.209 - - [14/Jan/2014:09:49:51 +0200] "GET /?utm_source=denizdogan22&utm_medium=twitter&utm_campaign=teasetweet&utm_content=14.01.2014.09.49 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.124 - - [14/Jan/2014:09:50:04 +0200] "GET /?utm_source=ibrahim2122&utm_medium=twitter&utm_campaign=notif1&utm_content=14.01.2014.09.50 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.124 - - [14/Jan/2014:09:50:54 +0200] "GET /eng/?utm_source=Brazuqa&utm_medium=twitter&utm_campaign=logs&utm_content=14.01.2014.09.50 HTTP/1.1" 200 8020 "-" "Twitterbot/1.0"
199.16.156.125 - - [14/Jan/2014:09:51:05 +0200] "GET /?utm_source=hazalkaya_news&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.51 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:52:20 +0200] "GET /?utm_source=_bertaraf&utm_medium=twitter&utm_campaign=support&utm_content=15.12.2013.00.43 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.125 - - [14/Jan/2014:09:53:16 +0200] "GET /?utm_source=emine19971905&utm_medium=twitter&utm_campaign=unlock&utm_content=14.12.2013.15.48 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:54:06 +0200] "GET /?utm_source=kotukizcandy&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.53 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.125 - - [14/Jan/2014:09:54:59 +0200] "GET /?utm_source=nsoyat&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.54 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.59.148.211 - - [14/Jan/2014:09:55:06 +0200] "GET /?utm_source=xahsenx&utm_medium=twitter&utm_campaign=notif1&utm_content=14.01.2014.09.55 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.125 - - [14/Jan/2014:09:55:38 +0200] "GET /?utm_source=kadircavgin&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.55 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:56:15 +0200] "GET /?utm_source=mrtozil&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.56 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.125 - - [14/Jan/2014:09:56:42 +0200] "GET /?utm_source=siverekname1&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.56 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.59.148.211 - - [14/Jan/2014:09:57:15 +0200] "GET /robots.txt HTTP/1.1" 200 933 "-" "Twitterbot/1.0"
199.59.148.211 - - [14/Jan/2014:09:57:15 +0200] "GET /eng/?utm_source=denizdogan22&utm_medium=twitter&utm_campaign=teasetweet&utm_content=14.01.2014.09.56&utm_lang=en HTTP/1.1" 200 8020 "-" "Twitterbot/1.0"
199.59.148.209 - - [14/Jan/2014:09:57:16 +0200] "GET /eng/?utm_source=denizdogan22&utm_medium=twitter&utm_campaign=teasetweet&utm_content=14.01.2014.09.56&utm_lang=en HTTP/1.1" 200 8020 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:58:48 +0200] "GET /?utm_source=sezercanbar&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.58 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:09:59:39 +0200] "GET /?utm_source=RTsupermarket&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.09.59 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.124 - - [14/Jan/2014:10:00:04 +0200] "GET /?utm_source=E_EsraG&utm_medium=twitter&utm_campaign=notif1&utm_content=14.01.2014.10.00 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.124 - - [14/Jan/2014:10:01:02 +0200] "GET /?utm_source=AzizoluBerrak&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.10.00 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:10:01:48 +0200] "GET /?utm_source=_ffirst_&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.10.01 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.59.148.210 - - [14/Jan/2014:10:02:28 +0200] "GET /?utm_source=snsz_olmazz&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.10.02 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"
199.16.156.126 - - [14/Jan/2014:10:02:57 +0200] "GET /?utm_source=Hayaller_kenti1&utm_medium=twitter&utm_campaign=unlock&utm_content=14.01.2014.10.02 HTTP/1.1" 200 11255 "-" "Twitterbot/1.0"</code>