spark streaming应用提交报UnsupportedOperationException: Not implemented by th...

我的cdh是5.3.10，其spark是1.2.0的 。但我不想升级cdh版本 ，所用就用是spark1.6的源码重新编译了，生成spark-1.6.0-bin-cdh5.3.10.tar包。用这个新生成的tar包部署了集群。集群部署成功 。但我写了一个spark streaming程序，导入新生成的spark-assembly-1.6.0-hadoop2.5.0-cdh5.3.10.jar和在pom文件中添加spark-streaming-kafka_2.10包。在本地运行是ok的，但用spark-submit提交后报错：[mw_shl_code=java,true]Exception in thread "main" java.lang.UnsupportedOperationException: Not implemented by the TFS FileSystem implementation
        at org.apache.hadoop.fs.FileSystem.getScheme(FileSystem.java:216)
        at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:2564)
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2574)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
        at org.apache.spark.deploy.yarn.ClientBase$class.prepareLocalResources(ClientBase.scala:144)
        at org.apache.spark.deploy.yarn.Client.prepareLocalResources(Client.scala:35)
        at org.apache.spark.deploy.yarn.ClientBase$class.createContainerLaunchContext(ClientBase.scala:313)
        at org.apache.spark.deploy.yarn.Client.createContainerLaunchContext(Client.scala:35)
        at org.apache.spark.deploy.yarn.Client.submitApplication(Client.scala:80)
        at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend.start(YarnClientSchedulerBackend.scala:57)
        at org.apache.spark.scheduler.TaskSchedulerImpl.start(TaskSchedulerImpl.scala:140)
        at org.apache.spark.SparkContext.<init>(SparkContext.scala:335)
        at com.linkstec.bigdata.main.AppAnalyzeMain$.main(AppAnalyzeMain.scala:32)
        at com.linkstec.bigdata.main.AppAnalyzeMain.main(AppAnalyzeMain.scala)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
[/mw_shl_code]

TFS FileSystem是淘宝的文件系统，楼主用淘宝的文件系统了？

很可能是部署环境和开发环境不一致造成的，或则classpath配置等

已解决 ，运行用的spark-submit脚本不对