I have created a pipeline for receiving tweets using twitter4j. The tweets are being pushed by using Redis push command. Further for processing of tweets i.e for removing “#”, “@” and finding the sentiment, tweets are popped using pop command.
The problem I am facing is that while tweets are streaming, some of the tweets are left incomplete (the long tweets). For Example:
Original Tweet: “Another Silent revolution of Modi govt - Streets lights being replaced with LED bulbs, saving energy consumption & stopping toxic emissions.”
Tweet Shown : “RT @BJP4India: Another Silent revolution of Modi govt - Streets lights being replaced with LED bulbs, saving energy consumption &…”
Not able to understand why its happening. This becomes a problem during sentiment analysis as it also considers “…” as a word.
