(moving to the Websites category)
As @IgorBrigadir says, this is straightforward to do by creating a widget. Here’s a link to the account settings page where you can configure these.
Note that the search API is limited to 7 days of content, so any Tweets containing the hashtag older than that will not show up in your timeline widget.