smarthbasecompactor

KO | EN

gitlite — search

#javascript #ai #typescript #go #machine-learning #rust #deep-learning #docker #macos #java #awesome #pytorch #mcp #ios

smarthbasecompactor

(★ 8)

a smart, automated non-intrusive driver for hbase region-level major-compact

smarthbasecompactor 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# smarthbasecompactor
a smart, automated non-intrusive driver for hbase region-level major-compact.

It operates on a per server/region level. For every server, it finds regions with most region files, which are the ones that need to be major-compacted the most, then monitor whether the regions have W/R activities. If yes, move to the next region, otherwise issue a major compact command. It also ensure at most it has X number of regions compacting, and X is configurable, so that compact storm won't occur.

Parameters:
* -c,--serverConcurrency <minFileThreshold>   
  * max # of regions will be compacted at the same time per server, default to 2
* -f,--minFileThreshold <minFileThreshold>    
  * any region with fileCount >= (minFileThreshold + columnFamily) will be compact candidate. 
  * Defaulted to 1, meaning if fileCount > columnFamily, it will be a candidate.
  * Setting it to 0 means try to compact all regions. Regions with more files will still be compacted first.
* -t,--runPeriod <runPeriod>                  
  * # of minutes it should run, 30 for half an hour and -1 for forever

Sample:
  hadoop jar smarthbasecompactor-1.0-SNAPSHOT.jar com.luo.HbaseMgr -libjars ${HADOOP_LIB_JARS} -t 30 -f 2 -c 2

The code is tested on hbase 0.98. Not sure if it works for earlier version or not.

smarthbasecompactor

smarthbasecompactor 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

smarthbasecompactor

smarthbasecompactor 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README