apache kafka - spark submit failed with spark streaming workdcount python code -

apache kafka - spark submit failed with spark streaming workdcount python code -

i copied spark streaming wodcount python code, , utilize spark-submit run wordcount python code in spark cluster, shows next errors:

py4j.protocol.py4jjavaerror: error occurred while calling o23.loadclass. : java.lang.classnotfoundexception: org.apache.spark.streaming.kafka.kafkautilspythonhelper @ java.net.urlclassloader$1.run(urlclassloader.java:366) @ java.net.urlclassloader$1.run(urlclassloader.java:355) @ java.security.accesscontroller.doprivileged(native method) @ java.net.urlclassloader.findclass(urlclassloader.java:354)

i did build jar spark-streaming-kafka-assembly_2.10-1.4.0-snapshot.jar. , used next script submit: bin/spark-submit /data/spark-1.3.0-bin-hadoop2.4/wordcount.py --master spark://192.168.100.6:7077 --jars /data/spark-1.3.0-bin-hadoop2.4/kafka-assembly/target/spark-streaming-kafka-assembly_*.jar.

thanks in advance!

actually realized have included --jars after script. the jar files not included unless jars specified before script name. utilize spark-submit --jars spark-streaming-kafka-assembly_2.10-1.3.1.jar script.py instead of spark-submit script.py --jars spark-streaming-kafka-assembly_2.10-1.3.1.jar.

apache-spark apache-kafka spark-streaming