Error while fetching tweets to kafka using maven

priyalcss · 2017-09-08T04:58:23.771Z

I am trying to fetch tweets from twitter using kafka. I have created java application using maven. I have installed confluent-3.3.0. i am following these link : https://github.com/heroku/kafka-tweet-producer/blob/master/README.original.md but while executing, ./bin/connect-standalone connect-source-standalone.properties twitter-source.properties

it throw error:
ERROR Failed to create job for ./etc/schema-registry/twitter-source.properties (org.apache.kafka.connect.cli.ConnectStandalone:89) [2017-09-07 14:11:43,901] ERROR Stopping after connector error (org.apache.kafka.connect.cli.ConnectStandalone:100) java.util.concurrent.ExecutionException: org.apache.kafka.connect.errors.ConnectException: Failed to find any class that implements Connector and which name matches org.apache.kafka.connect.twitter.TwitterSourceConnector

i added twitter-source.properties:
name=twitter-source
connector.class=com.github.jcustenborder.kafka.connect.twitter.TwitterSourceConnector
tasks.max=1
topic=test
twitter.consumerkey=xxxxxxxxxxxxxxxxxxxxxxx
twitter.consumersecret=xxxxxxxxxxxxxxxxxxxxxxxxxxxxx
twitter.token=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx
witter.secret=xxxxxxxxxxxxxxxxxxxxxxxx

andypiper · 2017-09-08T11:58:17.248Z

I’m not familiar with the Kafka code you’re using, but based on the error message this looks like a Java classpath issue. I do not believe that this is a Twitter API issue. You may have more success asking the authors of the kafka-tweet-producer project.

priyalcss · 2017-09-11T06:22:31.818Z

I have set Java home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.111-0.b15.el6_8.x86_64/jre in maven and set CLASSPATH in java application directory using these command,
export CLASSPATH="$(find target/kafka-connect-target/usr/share/java -type f -name ‘*.jar’ | tr ‘\n’ ‘:’)"
which contain these jar :
target/kafka-connect-target/usr/share/java/kafka-connect-twitter/freemarker-2.3.25-incubating.jar:target/kafka-connect-target/usr/share/java/kafka-connect-twitter/kafka-connect-twitter-0.2-SNAPSHOT.jar:target/kafka-connect-target/usr/share/java/kafka-connect-twitter/twitter4j-stream-4.0.6.jar:target/kafka-connect-target/usr/share/java/kafka-connect-twitter/twitter4j-core-4.0.6.jar:target/kafka-connect-target/usr/share/java/kafka-connect-twitter/connect-utils-0.2.86.jar: