错误现象:
1. 今早在EMR3.2的生产新集群上执行导出操作,h org.apache.hadoop.h .mapreduce.Export safeclound.tb_ammeter /backup/tb_ammeter 1 1531843200000 1532016000000
2. 错误表现:
执行job任务显示:
2018-07-19 17:07:26,113 INFO [main] mapreduce.Job: Task Id : attempt_1529895044112_7775_m_000002_1, Status : FAILEDError: java.io.IOException: Cannot create a record reader because of a previous error. Please look at the previous logs lines from the task's full log for more details. at org.apache.hadoop.h .mapreduce.TableInputFormat .createRecordReader(TableInputFormat .java:174) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.(MapTask.java:515)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:758)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1727)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.IllegalStateException: The input format instance has not been properly initialized. Ensure you call initializeTable either in your constructor or initialize method
at org.apache.hadoop.h .mapreduce.TableInputFormat .getTable(TableInputFormat .java:585)
at org.apache.hadoop.h .mapreduce.TableInputFormat .createRecordReader(TableInputFormat .java:169)
... 8 more
然后查看日志:
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.h .ipc.controller.ServerRpcControllerFactory
....
解决方法(经联系阿里工程师,提供以下方案):
1. 创建客户端使用的h 配置
> mkdir /tmp/h -client-conf
> cp /etc/ecm/h -conf/* /tmp/h -client-conf
> vim /tmp/h -client-conf/h -site.
删除phoenix相关的配置,保存:
h .rpc.controllerfactory.class
h .master.loadbalancer.class
h .region.server.rpc.scheduler.factory.class
h .coprocessor.master.classes
2. 执行命令时指定使用客户端配置
h --config /tmp/h -client-conf org.apache.hadoop.h .mapreduce.Export safeclound.tb_ammeter /backup/tb_ammeter 1 1531843200000 1532016000000
继续阅读与本文标签相同的文章
-
优客工场再获3亿元融资,3年融资12轮,估值超18亿美元
2026-05-25栏目: 教程
-
Network Embedding 指南
2026-05-25栏目: 教程
-
要选海外服务器?如果是海外服务器国内访问是不是有延迟?
2026-05-25栏目: 教程
-
域名和服务器都已备案,想购买海外服务器
2026-05-25栏目: 教程
-
为什么百度显示“网站标题”是错误的?
2026-05-25栏目: 教程
