Yes, the tradeoff of using loadTweet is that you may hit rate limits making a request for each Tweet individually in a multi-item context. loadTweet is best for use cases such as detail views in which only one Tweet is needed.
For other cases, especially for multiple items, prefer loadTweets which allows you to load up to 100 Tweets in a single request. It keeps app requests to the Twitter API within limits and keeps network usage reasonable for your users.
For your specific case, consider preloading the ids of the Tweets you will need or making use of Timelines with a custom adapter.