分享

spark运行日志报错,总是运行一段时间报错。但是我没使用广播变量

lukexi 发表于 2018-1-19 19:15:53 [显示全部楼层] 只看大图 回帖奖励 阅读模式 关闭右栏 6 4924
这是我在运行spark报的一个错误。总是运行一段时间之后就报错了,请问大家是哪的问题?有人说数据处理不过来,
望大神帮助,
18/01/18 10:23:53 INFO org.apache.spark.executor.CoarseGrainedExecutorBackend: Got assigned task 293978
18/01/18 10:23:53 INFO org.apache.spark.executor.Executor: Running task 1.2 in stage 659316.0 (TID 293978)
18/01/18 10:23:53 INFO org.apache.spark.storage.HolodeskBlockManager: Found block broadcast_134472 locally
18/01/18 10:23:53 INFO org.apache.spark.storage.HolodeskBlockManagerMaster: Updated info of block input-0-1516175924458_65e6a638989843de9b4212c297118687
18/01/18 10:23:53 INFO org.apache.spark.storage.HolodeskBlockManager: Removing block input-0-1516175924459_65e6a638989843de9b4212c297118687
18/01/18 10:23:53 INFO org.apache.spark.storage.RamdiskStore: Block input-0-1516175924459_65e6a638989843de9b4212c297118687 of size 2676 dropped from ramdisk (free 25305611650)
18/01/18 10:23:53 INFO org.apache.spark.broadcast.HttpBroadcast: Started reading broadcast variable 74103
18/01/18 10:23:53 ERROR org.apache.spark.executor.Executor: Exception in task 1.2 in stage 659316.0 (TID 293978)
java.io.FileNotFoundException: http://192.168.19.165:44520/broadcast_74103
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1624)
        at org.apache.spark.broadcast.HttpBroadcast$.org$apache$spark$broadcast$HttpBroadcast$$read(HttpBroadcast.scala:200)
        at org.apache.spark.broadcast.HttpBroadcast.readObject(HttpBroadcast.scala:89)
        at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
        at scala.collection.immutable.$colon$colon.readObject(List.scala:362)
        at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
        at scala.collection.immutable.$colon$colon.readObject(List.scala:362)
        at sun.reflect.GeneratedMethodAccessor9.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)
        at org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:62)
        at org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:87)
        at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:67)
        at org.apache.spark.scheduler.Task.run(Task.scala:62)
        at org.apache.spark.executor.Executor$TaskRunner$$anonfun$run$1.apply$mcV$sp(Executor.scala:265)
        at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:54)
        at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:53)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1854)
        at org.apache.spark.deploy.SparkHadoopUtil.runAsUser(SparkHadoopUtil.scala:53)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:224)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
18/01/18 10:23:53 INFO org.apache.spark.executor.CoarseGrainedExecutorBackend: Got assigned task 293979
18/01/18 10:23:53 INFO org.apache.spark.executor.Executor: Running task 0.3 in stage 659316.0 (TID 293979)
18/01/18 10:23:53 INFO org.apache.spark.storage.HolodeskBlockManager: Found block broadcast_134472 locally
18/01/18 10:23:53 INFO org.apache.spark.storage.HolodeskBlockManagerMaster: Updated info of block input-0-1516175924459_65e6a638989843de9b4212c297118687
18/01/18 10:23:53 INFO org.apache.spark.storage.HolodeskBlockManager: Removing broadcast 134387
18/01/18 10:23:53 INFO org.apache.spark.broadcast.HttpBroadcast: Started reading broadcast variable 74103
18/01/18 10:23:53 ERROR org.apache.spark.executor.Executor: Exception in task 0.3 in stage 659316.0 (TID 293979)
java.io.FileNotFoundException: http://192.168.19.165:44520/broadcast_74103
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1624)
        at org.apache.spark.broadcast.HttpBroadcast$.org$apache$spark$broadcast$HttpBroadcast$$read(HttpBroadcast.scala:200)
        at org.apache.spark.broadcast.HttpBroadcast.readObject(HttpBroadcast.scala:89)
        at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at java.io.ObjectStreamClass.invokeReadObject(ObjectStreamClass.java:1017)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1893)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)
        at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)
        at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)
        at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)
        at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)

有没有给解决一下,解实在解决不了,望大神帮忙,解决后会分享大家经验

有没有给解决一下,解实在解决不了,望大神帮忙,解决后会分享大家经验




已有(6)人评论

跳转到指定楼层
qcbb001 发表于 2018-1-19 20:45:31
代码里面是不是有connection,这里发生输入异常。而且可能有中间文件。看看异常中提供的路径是否能访问。还有端口url等都看下。
回复

使用道具 举报

arsenduan 发表于 2018-1-19 21:59:51
INFO org.apache.spark.storage.HolodeskBlockManager: Found block broadcast_134472 locally
集群多大,有的能找到,有的找不到。
回复

使用道具 举报

arsenduan 发表于 2018-1-19 22:02:08
集群数据和结果产生什么问题了吗?
回复

使用道具 举报

sstutu 发表于 2018-1-19 22:36:06
是否有旧的广播变量。是只有一个任务,还是什么情况。说说自己的集群环境。
回复

使用道具 举报

zstu 发表于 2018-1-24 14:06:54
楼主,错误解决了吗?
回复

使用道具 举报

翱翔于天变 发表于 2018-1-24 17:19:53
楼主,问题怎么解决的哇
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条