My robots.txt had some entries that blocked twitterbot. I have now updated the entries.
However, the cache control for that file was set to forever. Hence the changes are not reflected. Twitter team, can you help force burst the cache on your side, so you can pick the latest version? Right now the cards not working due to robots.txt block as the old file is still being used!