Spark Kafka流媒体问题

Spark Kafka流媒体问题

我遇到了同样的问题，我通过用依赖项构建jar解决了这个问题。

1. 在代码中删除“ sc.addJar（）”。

2. 将下面的代码添加到pom.xml

   <build><sourceDirectory>src/main/java</sourceDirectory><testSourceDirectory>src/test/java</testSourceDirectory><plugins>  <!--    Bind the maven-assembly-plugin to the package phase    this will create a jar file without the storm dependencies    suitable for deployment to a cluster.   -->  <plugin>    <artifactId>maven-assembly-plugin</artifactId>    <configuration>      <descriptorRefs>        <descriptorRef>jar-with-dependencies</descriptorRef>      </descriptorRefs>      <archive>        <manifest>          <mainClass></mainClass>        </manifest>      </archive>    </configuration>    <executions>      <execution>        <id>make-assembly</id>        <phase>package</phase>        <goals>          <goal>single</goal>        </goals>      </execution>    </executions>  </plugin></plugins>