snapshot-s3-util

KO | EN

gitlite — search

#hacktoberfest #react #golang #android #machine-learning #deep-learning #linux #macos #windows #cli #kubernetes #vue #awesome-list #openai

snapshot-s3-util

(★ 14)

Tool for exporting HBase snapshots in and out of S3

snapshot-s3-util 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Building
```
mvn clean package
```

# Running

To create a snapshot and immediately export to S3
```
hadoop jar target/snapshot-s3-util-1.0.0.jar com.imgur.backup.SnapshotS3Util --createExport --table <tableName> --bucketName <bucketName> --mappers <numMaps> --awsAccessKey <accessKey> --awsAccessSecret <accessSecret>
```

# Options
```
usage: BackupUtil [-a] -b <arg> -c | -e | -i | -x [-d <arg>]   -k <arg>
       [-l <arg>] [-m <arg>] [-n <arg>] [-p <arg>] -s <arg> [-t <arg>]
Backup utility for creating snapshots and exporting/importing to and from
S3
 -a,--s3n                     Use s3n protocol instead of s3. Might work
                              better, but beware of 5GB file limit imposed
                              by S3
 -b,--bucketName <arg>        The S3 bucket name where snapshots are
                              stored
 -c,--create                  Create HBase snapshot
 -d,--hdfsPath <arg>          The snapshot directory in HDFS. Default is
                              '/hbase'
 -e,--export                  Export HBase snapshot to S3
 -i,--import                  Import HBase snapshot from S3. May need to
                              run as hbase user if importing into HBase
 -k,--awsAccessKey <arg>      The AWS access key
 -l,--snapshotTtl <arg>       Delete snapshots older than this value
                              (seconds) from running HBase cluster
 -m,--mappers <arg>           The number of parallel copiers if copying
                              to/from S3. Default: 1
 -n,--snapshot <arg>          The snapshot name. Required for importing
                              from S3
 -p,--s3Path <arg>            The snapshot directory in S3. Default is
                              '/hbase'
 -s,--awsAccessSecret <arg>   The AWS access secret string
 -t,--table <arg>             The table name to create a snapshot from.
                              Required for creating a snapshot
 -x,--createExport            Create HBase snapshot AND export to S3

```

snapshot-s3-util

snapshot-s3-util 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

snapshot-s3-util

snapshot-s3-util 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README