ERROR: Found lingering reference file hdfs
2024-09-04 01:25:21
Found lingering reference异常
ERROR: Found lingering reference file hdfs://jiujiang1:9000/hbase/month_hotstatic/5af24d51488823419d155283441c2d0f/c/9b58bc5e853f445e9f28b98a36da6d04.b330aa24d0e3652ae89e6674fc2b3689
官方解决:
第一种解决:hbase hbck -fixReferenceFiles month_hotstatic
另一种方法:
#http://stackoverflow.com/questions/17810443/error-found-inconsistency-in-table-hbase
This looks like you had a failed region split, see [HBASE-8052] (https://issues.apache.org/jira/browse/HBASE-8502) for more details.
This bug leaves references to parent regions that have been moved in HDFS. To fix, just delete the reference files listed in the HBCK output e.g.
hadoop fs -rm hdfs://master:8020/hbase/LogTable/f41ff2fae25d1dab3f16306f4f995369/l/d9c7d33257ae406caf8d94277ff6d247.fbda7904cd1f0ac9583e04029a138487
.Once the bad references are gone the region should be assigned automatically. You may have to do the assignment from the shell, in my experience though it only takes a minute or two for the region to get reassigned. Then run hbase hbck -fix
again to confirm there are no other inconsistencies.
hbase hbck > 1.log 2>&1
cat 1.log | grep -i "ERROR"
cat 1.log | grep -i "ERROR" | awk -F"ERROR: Found lingering reference file " '{print $2}' >a.txt
#!/bin/sh
while read line
do
hadoop fs -rmr $line
done < a.txt
最新文章
- Java垃圾回收
- 解锁scott用户及设置密码
- 导出word使用模版
- Leetcode 160 Intersection of Two Linked Lists 单向链表
- HTML输入框点击内容消失
- Linux档案与目录的管理
- POJ 2481 Cows
- ListControl常用操作汇总
- Apache-Tika解析XML文档
- 监测scroll
- 轻谈BFC
- CSS中垂直居中的方法
- jdk环境变量配置及配置原因
- Hack You CTF 2014: NotEasyTask
- Android Studio Intent使用(显式、隐式)
- 【代码笔记】Web-利用Dreamweaver实现form
- matlab padarray函数
- 分布式ID生成学习
- 天使投资、A轮、B轮、C轮
- AJPFX:外汇的价格图表类型和技术指标类型