分享

about云hadoop源码分析之如何获取任务名字及进度【hadoop2.7.1】

pig2 2015-7-11 15:14:47 发表于 介绍解说 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 1 10852

问题导读
1.你认为如何获取hadoop mapreduce任务名字?
2.你认为如何获取hadoop mapreduce?





有很多新手经常问,该如何获取任务的进度,有没有这方面的API。
答案是有的。具体在哪各类或则接口中?
我们找到包:
package org.apache.hadoop.mapreduce;
中TaskAttemptContext接口


[mw_shl_code=java,true]/**
* Licensed to the Apache Software Foundation (ASF) under one
* or more contributor license agreements.  See the NOTICE file
* distributed with this work for additional information
* regarding copyright ownership.  The ASF licenses this file
* to you under the Apache License, Version 2.0 (the
* "License"); you may not use this file except in compliance
* with the License.  You may obtain a copy of the License at
*
*     http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*/

package org.apache.hadoop.mapreduce;

import org.apache.hadoop.classification.InterfaceAudience;
import org.apache.hadoop.classification.InterfaceStability;
import org.apache.hadoop.util.Progressable;

/**
* The context for task attempts.
*/
@InterfaceAudience.Public
@InterfaceStability.Evolving
public interface TaskAttemptContext extends JobContext, Progressable {

  /**
   * Get the unique name for this task attempt.
   */
  public TaskAttemptID getTaskAttemptID();

  /**
   * Set the current status of the task to the given string.
   */
  public void setStatus(String msg);

  /**
   * Get the last set status message.
   * @return the current status message
   */
  public String getStatus();
  
  /**
   * The current progress of the task attempt.
   * @return a number between 0.0 and 1.0 (inclusive) indicating the attempt's
   * progress.
   */
  public abstract float getProgress();

  /**
   * Get the {@link Counter} for the given <code>counterName</code>.
   * @param counterName counter name
   * @return the <code>Counter</code> for the given <code>counterName</code>
   */
  public Counter getCounter(Enum<?> counterName);

  /**
   * Get the {@link Counter} for the given <code>groupName</code> and
   * <code>counterName</code>.
   * @param counterName counter name
   * @return the <code>Counter</code> for the given <code>groupName</code> and
   *         <code>counterName</code>
   */
  public Counter getCounter(String groupName, String counterName);

}[/mw_shl_code]


其中
[mw_shl_code=bash,true]public TaskAttemptID getTaskAttemptID();[/mw_shl_code]

为获取任何的名字

[mw_shl_code=bash,true] public abstract float getProgress();[/mw_shl_code]

为任务的当前进度












已有(1)人评论

跳转到指定楼层
tang 发表于 2015-7-13 07:58:40
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条