以下是正常的作业输出日志,
2016-10-28 20:39:49,959 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:137)] Found primary key columns [id]
2016-10-28 20:39:49,959 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:152)] Using partition column: id
2016-10-28 20:39:49,959 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:238)] Using min/max query: SELECT MIN( id ), MAX( id ) FROM sqoop_test . student
2016-10-28 20:39:49,960 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:291)] Boundaries for the job: min=1, max=2, columnType=4
2016-10-28 20:39:49,961 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configureTableProperties(GenericJdbcFromInitializer.java:353)] Using dataSql: SELECT * FROM sqoop_test . student WHERE ${CONDITIONS}
2016-10-28 20:39:49,961 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configureTableProperties(GenericJdbcFromInitializer.java:354)] Field names: id , name , sex , age , tel
2016-10-28 20:39:49,981 INFO [org.apache.hadoop.conf.Configuration.warnOnceIfDeprecated(Configuration.java:1173)] fs.default.name is deprecated. Instead, use fs.defaultFS
2016-10-28 20:39:49,988 INFO [org.apache.sqoop.connector.hadoop.security.SecurityUtils.generateDelegationTokens(SecurityUtils.java:75)] Running on unsecured cluster, skipping delegation token generation.
2016-10-28 20:39:49,988 INFO [org.apache.sqoop.connector.hdfs.HdfsToInitializer.initialize(HdfsToInitializer.java:90)] Using working directory: /user/lta_hdfs/testDir/.e86c5954-ed1a-4e43-9817-b12d13c507fb
2016-10-28 20:39:50,004 INFO [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2016-10-28 20:39:50,038 INFO [org.apache.hadoop.yarn.client.RMProxy.createRMProxy(RMProxy.java:98)] Connecting to ResourceManager at /192.168.1.107:8032
2016-10-28 20:39:50,049 WARN [org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:64)] Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
2016-10-28 20:39:50,511 WARN [org.apache.hadoop.mapreduce.JobResourceUploader.uploadFiles(JobResourceUploader.java:171)] No job jar file set. User classes may not be found. See Job or Job#setJar(String).
2016-10-28 20:39:50,567 INFO [org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:198)] number of splits:1
2016-10-28 20:39:50,602 INFO [org.apache.hadoop.mapreduce.JobSubmitter.printTokens(JobSubmitter.java:287)] Submitting tokens for job: job_1477657370960_0003
2016-10-28 20:39:50,607 INFO [org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:371)] Job jar is not present. Not adding any jar to the list of resources.
2016-10-28 20:39:50,698 INFO [org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:273)] Submitted application application_1477657370960_0003
2016-10-28 20:39:50,703 INFO [org.apache.hadoop.mapreduce.Job.submit(Job.java:1294)] The url to track the job: http://master:8088/proxy/application_1477657370960_0003/
然后r任务出错的日志
2016-10-28 20:40:37,372 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:137)] Found primary key columns [id]
2016-10-28 20:40:37,372 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:152)] Using partition column: id
2016-10-28 20:40:37,372 INFO [org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.configurePartitionProperties(GenericJdbcFromInitializer.java:238)] Using min/max query: SELECT MIN("id"), MAX("id") FROM "sqoop_test"."teacher"
2016-10-28 20:40:37,373 ERROR [org.apache.sqoop.server.SqoopProtocolServlet.doPut(SqoopProtocolServlet.java:86)] Exception in PUT http://localhost:12000/sqoop/v1/job/jobTest1/start
org.apache.sqoop.common.SqoopException: GENERIC_JDBC_CONNECTOR_0016:Can't fetch schema
at org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.initialize(GenericJdbcFromInitializer.java:64)
at org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer.initialize(GenericJdbcFromInitializer.java:47)
at org.apache.sqoop.driver.JobManager$1.call(JobManager.java:520)
at org.apache.sqoop.driver.JobManager$1.call(JobManager.java:517)
两个作业的配置如下,配置是一样的,只是输出路径不一样。
两个做作业对应的from link如下:
为什么有一个作业sqoop会自动加上双引号。
|