分享

如何在java中创建SparkSession对象。。

remarkzhao 发表于 2017-9-13 12:51:59 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 6686
  各位大神:
         我要在java中读取sqlserver里的表,然后对hbase进行循环插入
          这是我的代码 但是一运行就出这种异常  请大神们帮我指点一下原因
          SparkSession spark = SparkSession.builder()        .master("local")
        .appName("SqlToHBase")
        .getOrCreate();
String url = "jdbc:sqlserver://192.168.1.21;username=sa;password=yishidb;database=CDRDB16;useUnicode=true&characterEncoding=UTF-8";
String tableName = "ExamResult";
String driver = "com.microsoft.sqlserver.jdbc.SQLServerDriver";
Dataset dataset = spark.read().format("jdbc").
        option("url",url)
        .option("driver",driver)
        .option("dbtable",tableName).load();
System.out.println("数据:" + dataset);
异常: "C:\Program Files (x86)\Java\jdk1.8.0_131\bin\java" "-javaagent:C:\SoftWare\Idea\IntelliJ IDEA 2017.1.4\lib\idea_rt.jar=51423:C:\SoftWare\Idea\IntelliJ IDEA 2017.1.4\bin" -Dfile.encoding=UTF-8 -classpath "C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\charsets.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\deploy.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\access-bridge-32.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\cldrdata.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\dnsns.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\jaccess.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\jfxrt.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\localedata.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\nashorn.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\sunec.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\sunjce_provider.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\sunmscapi.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\sunpkcs11.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\ext\zipfs.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\javaws.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\jce.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\jfr.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\jfxswt.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\jsse.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\management-agent.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\plugin.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\resources.jar;C:\Program Files (x86)\Java\jdk1.8.0_131\jre\lib\rt.jar;C:\Users\YiShiKeJi-BoZhao\Downloads\spark-2.2.0\SqlToHBaseJ\out\production\SqlToHBaseJ;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\xz-1.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\asm-3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jts-1.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\sqljdbc4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\guice-3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\ivy-2.4.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jna-4.2.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lz4-1.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lz4-1.3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\oro-2.0.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\avro-1.7.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\core-1.1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\gson-2.2.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hppc-0.7.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\joni-2.1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\junit-4.12.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\async-1.4.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\irclib-1.10.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jsch-0.1.42.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\mapdb-0.9.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\opencsv-2.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\py4j-0.10.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\xalan-2.7.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\xmlenc-0.52.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\guava-11.0.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\janino-3.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jets3t-0.9.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-6.1.26.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jline-2.12.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jsr305-1.3.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\log4j-1.2.17.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\minlog-1.3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\securesm-1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\stream-2.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\t-digest-3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\velocity-1.7.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\zkclient-0.7.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\joda-time-2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\log4j-api-2.7.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\objenesis-2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\paranamer-2.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\paranamer-2.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\pyrolite-4.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scalap-2.11.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spatial4j-0.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\zkclient-0.10.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\activation-1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\avro-ipc-1.7.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-el-1.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-io-2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-io-2.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\httpcore-4.1.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javax.inject-1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jaxb-api-2.2.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jcodings-1.0.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jettison-1.3.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jsp-2.1-6.1.14.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\log4j-core-2.7.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\snakeyaml-1.15.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\aopalliance-1.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-cli-1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-net-2.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-net-3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\derby-10.11.1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\disruptor-3.3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-it-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-core-1.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-json-1.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\joda-time-2.9.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jopt-simple-3.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\libthrift-0.9.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\mina-core-2.0.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\servlet-api-2.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\slf4j-api-1.6.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\slf4j-api-1.7.7.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\xml-apis-1.3.04.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\zookeeper-3.4.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\zookeeper-3.4.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\argparse4j-0.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\asynchbase-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\chill-java-0.8.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\chill_2.11-0.8.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-dbcp-1.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-lang-2.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-lang-2.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-math-2.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\httpclient-4.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\httpclient-4.2.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-guice-1.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\rocksdbjni-5.0.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\serializer-2.7.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\slf4j-api-1.7.21.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\xercesImpl-2.9.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-codec-1.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-codec-1.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-lang3-3.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-tools-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\guice-servlet-3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-auth-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-hdfs-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-rest-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hk2-api-2.4.0-b34.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hk2-api-2.5.0-b05.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-xc-1.9.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jaxb-impl-2.2.3-1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-client-1.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-guava-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-server-1.9.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-util-6.1.26.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jopt-simple-5.0.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jopt-simple-5.0.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jtransforms-2.4.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kryo-shaded-3.0.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\log4j-1.2-api-2.7.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-core-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-join-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-misc-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\metrics-jvm-3.1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\netty-3.2.4.Final.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\netty-3.9.4.Final.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\netty-3.9.9.Final.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\pmml-model-1.2.15.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\snappy-java-1.1.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spire_2.11-0.13.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\api-util-1.0.0-M20.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\breeze_2.11-0.13.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-codec-1.10.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-jexl-2.1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-pool-1.5.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\compress-lzf-1.0.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-sdk-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-shell-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\HdrHistogram-2.1.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-core-2.3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-core-2.6.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-core-2.8.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-core-2.8.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-client-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-common-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-server-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jsp-api-2.1-6.1.14.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.10-0.9.0.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\leveldbjni-all-1.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\metrics-core-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\metrics-core-3.1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\metrics-json-3.1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-avro-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\pmml-schema-1.2.15.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\reflections-0.9.10.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-logging-1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-math3-3.1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-math3-3.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\elasticsearch-5.3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-auth-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-core-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-node-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-client-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-common-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-client-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-common-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-server-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-thrift-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hk2-utils-2.4.0-b34.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hk2-utils-2.5.0-b05.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jamon-runtime-2.3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\java-xmlbuilder-0.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javassist-3.18.1-GA.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javassist-3.20.0-GA.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-guava-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jul-to-slf4j-1.7.16.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.11-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-memory-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\protobuf-java-2.5.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\slf4j-log4j12-1.6.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\slf4j-log4j12-1.7.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\snappy-java-1.0.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\snappy-java-1.1.2.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spymemcached-2.11.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\antlr4-runtime-4.5.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-crypto-1.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-digester-1.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\connect-api-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\curator-client-2.6.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-irc-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-jaxrs-1.9.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-client-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-common-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-server-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jruby-complete-1.6.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka-tools-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kite-data-core-1.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kite-data-hive-1.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-queries-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-sandbox-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-spatial-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-suggest-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\machinist_2.11-0.6.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-column-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-column-1.8.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-common-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-common-1.8.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-format-2.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-format-2.3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-hadoop-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-hadoop-1.8.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\RoaringBitmap-0.5.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scala-library-2.10.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scala-library-2.11.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scala-reflect-2.11.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scala-xml_2.11-1.0.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\shapeless_2.11-2.3.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\slf4j-log4j12-1.7.21.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-sql_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\twitter4j-core-3.0.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-daemon-1.0.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-logging-1.1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\connect-file-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\connect-json-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\curator-recipes-2.6.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-hdfs-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-hive-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-yarn-api-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-examples-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-it-1.1.11-tests.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-protocol-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hk2-locator-2.4.0-b34.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hk2-locator-2.5.0-b05.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jasper-runtime-5.5.23.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javax.ws.rs-api-2.0.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jcl-over-slf4j-1.7.16.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka-clients-0.9.0.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kite-data-hbase-1.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-grouping-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-jackson-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-jackson-1.8.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scala-compiler-2.11.8.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-core_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-repl_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-tags_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-yarn_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\xbean-asm5-shaded-4.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\api-asn1-api-1.0.0-M20.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-compiler-3.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-compress-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-httpclient-3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-jms-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-procedure-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-core-asl-1.9.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-databind-2.3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-databind-2.6.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-databind-2.8.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jasper-compiler-5.5.23.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javax.inject-2.4.0-b34.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javax.inject-2.5.0-b05.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-media-jaxb-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-sslengine-6.1.26.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\json4s-ast_2.11-3.2.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka-clients-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka-streams-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-spatial3d-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\metrics-graphite-3.1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\netty-all-4.0.23.Final.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\netty-all-4.0.43.Final.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-encoding-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-encoding-1.8.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\servlet-api-2.5-6.1.14.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-mesos_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-mllib_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\twitter4j-stream-3.0.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\apache-log4j-extras-1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\apacheds-i18n-2.0.0-M15.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\arpack_combined_all-0.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-beanutils-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\curator-framework-2.6.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-avro-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-core-asl-1.9.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javax.servlet-api-3.1.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\json4s-core_2.11-3.2.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\macro-compat_2.11-1.1.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-generator-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-graphx_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-sketch_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-unsafe_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\univocity-parsers-2.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\connect-runtime-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-dataset-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-file-channel-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-jdbc-channel-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-kafka-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-annotations-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-yarn-client-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-yarn-common-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-annotations-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-prefix-tree-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-jaxrs-base-2.8.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-mapper-asl-1.9.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\javax.annotation-api-1.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-media-jaxb-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.11-0.10.2.1-test.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-highlighter-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-queryparser-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\servlet-api-2.5-20110124.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spire-macros_2.11-0.13.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\avro-mapred-1.7.7-hadoop2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\breeze-macros_2.11-0.13.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-collections-3.2.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-configuration-1.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-kafka-channel-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-hbase-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-kafka-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-scribe-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-thrift-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-common-1.1.11-tests.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-server-1.1.11-tests.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-spark-2.0.0-alpha-1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-annotations-2.3.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-annotations-2.6.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-annotations-2.8.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-annotations-2.8.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-mapper-asl-1.9.13.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-io-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\parquet-hive-bundle-1.4.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-catalyst_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-launcher_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-taildir-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-twitter-source-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-hadoop-compat-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\java-version-checker-5.3.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\json4s-jackson_2.11-3.2.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-streaming_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\validation-api-1.1.0.Final.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\connect-transforms-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-hadoop2-compat-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-http-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-util-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.11-0.10.2.1-javadoc.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.11-0.10.2.1-sources.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-spatial-extras-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\mesos-1.0.0-shaded-protobuf.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\osgi-resource-locator-1.0.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\commons-beanutils-core-1.8.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\findbugs-annotations-1.3.9-1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-configuration-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-log4jappender-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-resource-bundle-1.1.11.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\htrace-core-3.1.0-incubating.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.11-0.10.2.1-scaladoc.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-backward-codecs-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-mllib-local_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-embedded-agent-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-dataformat-cbor-2.8.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-dataformat-yaml-2.8.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-container-servlet-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-server-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka-log4j-appender-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\lucene-analyzers-common-6.4.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-core_2.11-1.5.2.logging.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\twitter4j-media-support-3.0.3.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-annotations-1.1.11-tests.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-dataformat-smile-2.8.6.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-module-paranamer-2.6.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-servlet-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-yarn-server-common-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-module-scala_2.11-2.6.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-container-servlet-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-security-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-servlets-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka-streams-examples-0.10.2.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kite-hadoop-compatibility-1.0.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\mysql-connector-java-5.1.42-bin.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-network-common_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\aopalliance-repackaged-2.4.0-b34.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\aopalliance-repackaged-2.5.0-b05.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\kafka_2.11-0.10.2.1-test-sources.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-network-shuffle_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-streaming-flume_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\apacheds-kerberos-codec-2.0.0-M15.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-elasticsearch-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-mapreduce-client-app-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-jaxrs-json-provider-2.8.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-ng-morphline-solr-sink-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-mapreduce-client-core-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-container-servlet-core-2.24.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hbase-spark-2.0.0-20160316.173537-2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jetty-continuation-9.2.15.v20160210.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\scala-parser-combinators_2.11-1.0.4.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\flume-spillable-memory-channel-1.7.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-mapreduce-client-common-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jersey-container-servlet-core-2.22.2.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\spark-streaming-kafka-0-8_2.11-2.2.0.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-mapreduce-client-shuffle-2.5.1.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\jackson-module-jaxb-annotations-2.8.5.jar;C:\Users\YiShiKeJi-BoZhao\Desktop\jars\hadoop-mapreduce-client-jobclient-2.5.1.jar" IndexException in thread "main" java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;        at org.apache.spark.sql.SparkSession$Builder.config(SparkSession.scala:780)        at org.apache.spark.sql.SparkSession$Builder.master(SparkSession.scala:833)        at Index.main(Index.java:39)Process finished with exit code 1


已有(4)人评论

跳转到指定楼层
sstutu 发表于 2017-9-13 14:36:45
感觉版本兼容的问题
回复

使用道具 举报

remarkzhao 发表于 2017-9-13 14:37:38
sstutu 发表于 2017-9-13 14:36
感觉版本兼容的问题

是的。解决好了。多谢。。封贴。发新帖。
回复

使用道具 举报

qcbb001 发表于 2017-9-13 14:44:52
remarkzhao 发表于 2017-9-13 14:37
是的。解决好了。多谢。。封贴。发新帖。

是因为jdk的原因?
回复

使用道具 举报

remarkzhao 发表于 2017-9-13 14:45:33
qcbb001 发表于 2017-9-13 14:44
是因为jdk的原因?

版本冲突。
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条