分享 MapReuce 怎么实现去掉文件重复的内容
zhanggl 2014-7-9 20:33
文件数据格式: Name,CardNo,Descriot,CtfTp,CtfId,Gender,Birthday,Address 彬,,,ID,xxxxx21059,M,20101001,,,F,,CHN,,,,,,,,139,19:46:02,4000000 珊,,,ID,xxxxx811090189,M,20101001,,,F,,CHN,,,,,,,,158 世,,,ID,4xxxxx1772,M,19880129,,,F,,CHN,,,,,,,,152108,2,1,,,,,0,2010-10-19 超,,,ID,4xxxxx1772, ...
个人分类: mapreduce|979 次阅读|2 个评论 热度 1
关闭

推荐上一条 /2 下一条