CDStore

KO | EN

gitlite — search

#hacktoberfest #react #ai #llm #golang #android #machine-learning #linux #docker #nodejs #java #windows #awesome #pytorch

(★ 10)

Convergent Dispersal Deduplication Datastore

CDStore 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# CDSTORE

* Introduction
 * Requirements
 * Installation
 * Configuration
 * Make
 * Example
 * Maintainers

# INTRODUCTION

CDStore builds on an augmented secret sharing scheme called convergent dispersal, which supports deduplication by using deterministic content-derived hashes as inputs to secret sharing. It combines convergent dispersal with two-stage deduplication to achieve both bandwidth and storage savings and be robust against side-channel attacks.

# REQUIREMENTS

CDStore is built on Ubuntu 12.04.3 LTS with gcc version 4.6.3.

This software requires the following libraries:

* OpenSSL (https://www.openssl.org/source/openssl-1.0.2a.tar.gz)
 * GF-Complete (https://github.com/ceph/gf-complete/archive/master.zip)
 * boost C++ library (http://sourceforge.net/projects/boost/files/boost/1.58.0/boost_1_58_0.tar.gz)
 * LevelDB (https://github.com/google/leveldb/archive/master.zip)

The GF-Complete and LevelDB are packed in /client/lib/ and /server/lib/ respectively.

# INSTALLATION

For linux user you can install the LevelDB dependency, OpenSSL and Boost by the following:

* sudo apt-get install libssl1.0.0 libboost-all-dev libsnappy-dev

# CONFIGURATION

* Configure the server (CDStore requires at least 4 storage server)

- Make sure there are three directories under /server/meta
	- "DedupDB" for levelDB logs
	- "RecipeFiles" for temp recipe files
	- "ShareContainers" for share local cache
	- Start a server by "./SERVER [port]"

* Configure the client

- In the configure file /client/config, specify the storage nodes line by line with [IP]:[port]

Example: you have run 4 servers with "./SERVER [port]" on machines:
		- 192.168.0.30 with port 11030
		- 192.168.0.31 with port 11031
		- 192.168.0.32 with port 11032
		- 192.168.0.33 with port 11033
		
		you need to specify the ip and port in config with following format:

192.168.0.30:11030
			192.168.0.31:11031
			192.168.0.32:11032
			192.168.0.33:11033

(the actual order doesn't matter)
	
	- (Optional) In the configure class of client, /client/util/conf.hh

- set chunk and secure parameters following the comments
		- set the number of storage nodes according to your running servers

# MAKE

To make a client, on the client machine:

* Go to /client/lib/, type "make" to make gf_complete
	 * Back to /client/, type "make" to get the executable CLIENT program

To make a server, on each storage node:

* Go to /server/lib/leveldb/, type "make" to make levelDB
	 * Back to /server/, type "make" to get the executable SERVER program

# EXAMPLE

* After successful make

usage: ./CLIENT [filename] [userID] [action] [secutiyType]

- [filename]: full path of the file;
	- [userID]: user ID of current client;
	- [action]: [-u] upload; [-d] download;
	- [securityType]: [HIGH] AES-256 & SHA-256; [LOW] AES-128 & SHA-1

* To upload a file "test", assuming from user "0" using AES-256 & SHA-256

./CLIENT test 0 -u HIGH

* To download a file "test", assuming from user "1" using AES-128 & SHA-1

./CLIENT test 1 -d LOW

# MAINTAINER

* Current maintainer

- Chuan QIN, the Chinese University of Hong Kong, chintran27@gmail.com

* Original maintainer

- Mingqiang Li, Lenovo Hong Kong, mingqianglicn@gmail.com

CDStore

CDStore 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

CDStore

CDStore 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README