日志
hadoop中counter的使用
||
1、首先定义一个枚举类型
public static enum LOG_PROCESSOR_COUNTER {
BAD_RECORDS
};
2、在mapper或者reducer中增加计数器
context.getCounter(LOG_PROCESSOR_COUNTER.BAD_RECORDS).increment(1);
3、在driver当中获取定义的counters
Job job = new Job(getConf(), "log-analysis");
……
Counters counters = job.getCounters();
Counter badRecordsCounter = counters.findCounter(LOG_PROCESSOR_COUNTER.BAD_RECORDS);
System.out.println("# of Bad Records:"+badRecordsCounter.getValue());
4、执行job，观察输出的结果
/2 
