分享

Kettle 在Linux下执行pan.sh 出现报错 [HIVE2] couldn't be found

YTP520YTP 发表于 2018-1-8 10:33:14 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 7 18576
源码如下:[dcp@etlsvr1 pdi-ce-7.0.0.0-25]$ ./pan.sh -file=lnr.ktr
#######################################################################
WARNING:  no libwebkitgtk-1.0 detected, some features will be unavailable
    Consider installing the package with apt-get or yum.
    e.g. 'sudo apt-get install libwebkitgtk-1.0-0'
#######################################################################
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0
09:52:05,163 INFO  [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled
09:52:05,235 INFO  [KarafInstance]
*******************************************************************************
*** Karaf Instance Number: 1 at /kettle_vg/pdi-ce-7.0.0.0-25/./system/karaf ***
***   /caches/pan/data-2                                                    ***
*** Karaf Port:8802                                                         ***
*** OSGI Service Port:9051                                                  ***
*******************************************************************************
Jan 08, 2018 9:52:05 AM org.apache.karaf.main.Main$KarafLockCallback lockAquired
INFO: Lock acquired. Setting startlevel to 100
2018-01-08 09:52:07.852:INFO:oejs.Server:jetty-8.1.15.v20140411
2018-01-08 09:52:07.880:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9051
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (149) [org.apache.cxf.management.InstrumentationManager]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (198) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (153) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (184) [org.apache.cxf.wsdl.WSDLManager]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (187) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (186) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (189) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (194) [org.apache.cxf.transport.local.LocalTransportFactory]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (195) [org.apache.cxf.binding.object.ObjectBindingFactory]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2 ... rity-secext-1.0.xsd
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2 ... ity-utility-1.0.xsd
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig#
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-securitypolicy/200702
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (215) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (217) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (219) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader]
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register
INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy
Jan 08, 2018 9:52:08 AM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions
INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (220) [org.apache.cxf.javascript.JavascriptServerListener]
Jan 08, 2018 9:52:08 AM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess
INFO: New Caching Service registered
2018/01/08 09:52:09 - Pan - Start of run.
Processing has stopped because of an error:
Error reading object from XML file
Error reading object from XML file
Unable to load database connection info from XML node
Unable to create new database interface
database type with plugin id [HIVE2] couldn't be found!
org.pentaho.di.core.exception.KettleXMLException:
Error reading object from XML file
Error reading object from XML file
Unable to load database connection info from XML node
Unable to create new database interface
database type with plugin id [HIVE2] couldn't be found!
        at org.pentaho.di.trans.TransMeta.loadXML(TransMeta.java:3383)
        at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2740)
        at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2692)
        at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2669)
        at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2649)
        at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2614)
        at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2577)
        at org.pentaho.di.pan.Pan.main(Pan.java:393)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92)
Caused by: org.pentaho.di.core.exception.KettleXMLException:
Error reading object from XML file
Unable to load database connection info from XML node
Unable to create new database interface
database type with plugin id [HIVE2] couldn't be found!
        at org.pentaho.di.trans.TransMeta.loadXML(TransMeta.java:3365)
        ... 12 more
Caused by: org.pentaho.di.core.exception.KettleXMLException:
Unable to load database connection info from XML node
Unable to create new database interface
database type with plugin id [HIVE2] couldn't be found!
        at org.pentaho.di.core.database.DatabaseMeta.<init>(DatabaseMeta.java:1027)
        at org.pentaho.di.trans.TransMeta.loadXML(TransMeta.java:2958)
        ... 12 more
Caused by: org.pentaho.di.core.exception.KettleXMLException:
Unable to create new database interface
database type with plugin id [HIVE2] couldn't be found!
        at org.pentaho.di.core.database.DatabaseMeta.<init>(DatabaseMeta.java:991)
        ... 13 more
Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
database type with plugin id [HIVE2] couldn't be found!
        at org.pentaho.di.core.database.DatabaseMeta.findDatabaseInterface(DatabaseMeta.java:598)
        at org.pentaho.di.core.database.DatabaseMeta.getDatabaseInterface(DatabaseMeta.java:572)
        at org.pentaho.di.core.database.DatabaseMeta.<init>(DatabaseMeta.java:988)
        ... 13 more

哪位大神帮帮我呀,我搞了几天了,搞不定,求帮帮

已有(7)人评论

跳转到指定楼层
qcbb001 发表于 2018-1-8 17:06:47
hive界面是否可以测试成功
回复

使用道具 举报

YTP520YTP 发表于 2018-1-9 15:24:44
qcbb001 发表于 2018-1-8 17:06
hive界面是否可以测试成功

在界面里面可以执行成功,就是在命令行不行,是什么情况呀?
回复

使用道具 举报

YTP520YTP 发表于 2018-1-9 15:25:54
qcbb001 发表于 2018-1-8 17:06
hive界面是否可以测试成功

每次清理掉缓存,就可以执行成功,但是执行一次就要清理,这有办法ma ?还是哪里出了问题呀?
回复

使用道具 举报

qcbb001 发表于 2018-1-9 17:15:34
YTP520YTP 发表于 2018-1-9 15:25
每次清理掉缓存,就可以执行成功,但是执行一次就要清理,这有办法ma ?还是哪里出了问题呀?

没看到你的代码,里面是否使用了缓存造成的问题,如插件初始化失败等原因。
如果是缓存造成的,那就在执行前,通过代码清理下缓存即可。
回复

使用道具 举报

YTP520YTP 发表于 2018-1-9 21:55:23
qcbb001 发表于 2018-1-9 17:15
没看到你的代码,里面是否使用了缓存造成的问题,如插件初始化失败等原因。
如果是缓存造成的,那就在执 ...

执行一次,都要清理缓存,还有什么办法吗??并行执行的,一次执行好几个呢,每次执行完,清理缓存就可以执行,不清理缓存,就报错,这是什么原因呢/?有什么好的解决办法吗?谢谢您,这么好心帮我,谢谢您。
回复

使用道具 举报

qcbb001 发表于 2018-1-12 20:39:46
YTP520YTP 发表于 2018-1-9 21:55
执行一次,都要清理缓存,还有什么办法吗??并行执行的,一次执行好几个呢,每次执行完,清理缓存就可以 ...

没有遇到过这个问题。最根本的应该还是缓存的问题,需要从你的代码入手解决。
回复

使用道具 举报

super_麒麟 发表于 2018-8-14 10:18:40
YTP520YTP 发表于 2018-1-9 15:25
每次清理掉缓存,就可以执行成功,但是执行一次就要清理,这有办法ma ?还是哪里出了问题呀?

请问解决这个问题了吗,如何处理的,我现在也是每次执行前,清理缓存可以成功,不清理缓存就会报错
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条