sqoop2 1.99.5 start job时报错,恳请各位前辈指点迷津

查看数: 12961 | 评论数: 7 | 收藏 0
关灯 | 提示:支持键盘翻页<-左 右->
    组图打开中,请稍候......
发布时间: 2017-7-24 15:09

正文摘要:

sqoop2 版本是 1.99.5, CDH-5.11.1 我创建了2个link 分别是: mysql_link_124: sqoop:000> show link -l 1 1 link(s) to show: link with id 1 and name mysql_link_124 (Enabled: true, Created by root at ...

回复

starrycheng 发表于 2017-7-25 14:27:36
大青山 发表于 2017-7-25 14:02
谢谢各位 问题已解决,在sqoop服务器下执行入下操作:

cd /opt/cloudera/parcels/CDH/lib/hadoop/client ...

相当于在/opt/cloudera/parcels/CDH/lib/hadoop/client这个路径下添加对应的包。

大青山 发表于 2017-7-25 14:02:42
谢谢各位 问题已解决,在sqoop服务器下执行入下操作:

cd /opt/cloudera/parcels/CDH/lib/hadoop/client
sudo ln -s ../../hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
sudo ln -s ../../hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar

参考链接: https://community.cloudera.com/t ... job/m-p/45359#M1890

大青山 发表于 2017-7-25 14:00:18
谢谢各位 问题已解决,在sqoop服务器下执行入下操作:

cd /opt/cloudera/parcels/CDH/lib/hadoop/client
sudo ln -s ../../hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
sudo ln -s ../../hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar

参考链接: https://community.cloudera.com/t ... job/m-p/45359#M1890
大青山 发表于 2017-7-25 13:55:15
解决办法是 在sqoop 所在服务器上执行入下操作:

cd /opt/cloudera/parcels/CDH/lib/hadoop/client
sudo ln -s ../../hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar
sudo ln -s ../../hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar

参考链接:https://community.cloudera.com/t ... job/m-p/45359#M1890
desehawk 发表于 2017-7-24 17:24:14
大青山 发表于 2017-7-24 15:43
我是通过 cloudera Manager 去安装的 sqoop2,

在 /var/log/sqoop2 日志下面的  localhost.2017-07-24. ...

你的sqoop封装了,而不是说cloudera封装了
另外你的什么地方用到了spring,恐怕可能也和sqoop没有太大关系。
先解决spring的问题。
大青山 发表于 2017-7-24 15:43:36
desehawk 发表于 2017-7-24 15:30
内容都封装了,看不出来什么问题。而且报错的好像是tomcat。

我是通过 cloudera Manager 去安装的 sqoop2,

在 /var/log/sqoop2 日志下面的  localhost.2017-07-24.log 日志文件中 会有这个错误,
我搜索了这个问题 基本都说缺少 jackson-core-asl-1.8.8.jar   和   jackson-mapper-asl-1.8.8.jar 这两个jar包
但是我看了 相关目录下 都有这两个包,所以我就不知道还有哪些方法去解决这个问题了。
不知道你还有没有一些办法去解决它,谢谢


[root@cloudera3 sqoop2]# cat localhost.2017-07-24.log
Jul 24, 2017 9:49:33 AM org.apache.catalina.core.StandardWrapperValve invoke
SEVERE: Servlet.service() for servlet v1.JobServlet threw exception
java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at org.apache.hadoop.mapreduce.Job.getJobSubmitter(Job.java:1291)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1302)
        at org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submitToCluster(MapreduceSubmissionEngine.java:274)
        at org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:255)
        at org.apache.sqoop.driver.JobManager.start(JobManager.java:288)
        at org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:380)
        at org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:116)
        at org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:96)
        at org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:79)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:622)
        at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:301)
        at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:574)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503)
        at java.lang.Thread.run(Thread.java:745)

Jul 24, 2017 10:53:32 AM org.apache.catalina.core.StandardWrapperValve invoke
SEVERE: Servlet.service() for servlet v1.JobServlet threw exception
java.lang.ClassNotFoundException: org.codehaus.jackson.map.JsonMappingException
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at org.apache.hadoop.mapreduce.Job.getJobSubmitter(Job.java:1291)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1302)
        at org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submitToCluster(MapreduceSubmissionEngine.java:274)
        at org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:255)
        at org.apache.sqoop.driver.JobManager.start(JobManager.java:288)
        at org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:380)
        at org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:116)
        at org.apache.sqoop.server.v1.JobServlet.handlePutRequest(JobServlet.java:96)
        at org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:79)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:646)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:723)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:622)
        at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:301)
        at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:574)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
        at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
        at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:610)
        at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503)
        at java.lang.Thread.run(Thread.java:745)


desehawk 发表于 2017-7-24 15:30:16
内容都封装了,看不出来什么问题。而且报错的好像是tomcat。
关闭

推荐上一条 /2 下一条