graphdb-benchmarks - GitLite

KO | EN

gitlite — search

#react #ai #golang #android #rust #docker #nodejs #java #windows #cli #kubernetes #security #mcp #openai

graphdb-benchmarks

(★ 198)

Performance benchmark between popular graph databases.

파일 탐색기

최종 버전 다운로드 (.zip)

.gitignore
LICENSE
NOTICE
pom.xml
README.md

# 설치 가이드

1. 코드 내려받기

git clone https://github.com/socialsensor/graphdb-benchmarks

깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.

cd graphdb-benchmarks

방금 내려받은 프로젝트 폴더 안으로 이동합니다.

2. Maven (Java)

보통 추천

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
JDK (Java) Java 프로젝트를 빌드/실행하려면 필요합니다.
Maven mvn 명령어를 쓰기 위한 빌드 도구입니다.

mvn clean install

Maven으로 의존성 설치와 빌드를 진행합니다.

✅ BUILD SUCCESS 메시지가 뜨면 성공입니다. target/ 폴더에 결과물이 생성됩니다.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

graphdb-benchmarks
==================
The project graphdb-benchmarks is a benchmark between popular graph dataases. Currently the framework supports [Titan](http://thinkaurelius.github.io/titan/), [OrientDB](http://www.orientechnologies.com/orientdb/), [Neo4j](http://neo4j.com/) and [Sparksee](http://www.sparsity-technologies.com/). The purpose of this benchmark is to examine the performance of each graph database in terms of execution time. The benchmark is composed of four workloads, Clustering, Massive Insertion, Single Insertion and Query Workload. Every workload has been designed to simulate common operations in graph database systems.

- *Clustering Workload (CW)*: CW consists of a well-known community detection algorithm for modularity optimization, the Louvain Method. We adapt the algorithm on top of the benchmarked graph databases and employ cache techniques to take advantage of both graph database capabilities and in-memory execution speed. We measure the time the algorithm needs to converge.
- *Massive Insertion Workload (MIW)*: we create the graph database and configure it for massive loading, then we populate it with a particular dataset. We measure the time for the creation of the whole graph.
- *Single Insertion Workload (SIW)*: we create the graph database and load it with a particular dataset. Every object insertion (node or edge) is committed directly and the graph is constructed incrementally. We measure the insertion time per block, which consists of one thousand edges and the nodes that appear during the insertion of these edges.
- *Query Workload (QW)*: we execute three common queries:
  * FindNeighbours (FN): finds the neighbours of all nodes.
  * FindAdjacentNodes (FA): finds the adjacent nodes of all edges.
  * FindShortestPath (FS): finds the shortest path between the first node and 100 randomly picked nodes.

Here we measure the execution time of each query.

For our evaluation we use both synthetic and real data. More specifically, we execute MIW, SIW and QW with real data derived from the SNAP dataset collection ([Enron Dataset](http://snap.stanford.edu/data/email-Enron.html), [Amazon dataset](http://snap.stanford.edu/data/amazon0601.html), [Youtube dataset](http://snap.stanford.edu/data/com-Youtube.html) and [LiveJournal dataset](http://snap.stanford.edu/data/com-LiveJournal.html)). On the other hand, with the CW we use synthetic data generated with the [LFR-Benchmark generator](https://sites.google.com/site/andrealancichinetti/files) which produces networks with power-law degree distribution and implanted communities within the network. The synthetic data can be downloaded form [here](http://figshare.com/articles/Synthetic_Data_for_graphdb_benchmark/1221760).

For further information about the study please refer to the [published paper](http://link.springer.com/chapter/10.1007/978-3-319-10518-5_1) on Springer site and the presentation on [Slideshare](http://www.slideshare.net/sympapadopoulos/adbis2014-presentation).

**Note 1:** The published paper contains the experimental study of Titan, OrientDB and Neo4j. After the publication we included the Sparksee graph database.

**Note 2:** After the very useful comments and contributions of OrientDB developers, we updated the benchmark implementations and re-run the experiments. We have updated the initial presentation with the new results and uploaded a new version of the paper in the following [link](http://mklab.iti.gr/files/beis_adbis2014_corrected.pdf).

**Note 3:** Alexander Patrikalakis, a software developer at Amazon Web Services, refactored the benchmark, added support for Blueprints 2.5 and added support for the DynamoDB Storage Backend for Titan.

Instructions
------------
To run the project at first you have to choose one of the aforementioned datasets. Of course you can select any dataset, but because there is not any utility class to convert the dataset in the appropriate format (for now), the format of the data must be identical with the tested datasets. The input parameters are configured from the src/test/resources/input.properties file. Please follow the instructions in this file to select the correct parameters. Then, run `mvn dependency:copy-dependencies && mvn test -Pbench` to execute the benchmarking run.

Results
-------
This section contains the results of each benchmark. All the measurements are in seconds.

####CW results
Below we list the results of the CW for graphs with 1,000, 5,000, 10,0000, 20,000, 30,000, 40,000, 50,000 nodes.

| Graph-Cache | Titan | OrientDB | Neo4j |
| ----------- | ----- | -------- | ----- |
|Graph1k-5%   |2.39   |**0.92**  |2.46   |
|Graph1k-10%  |1.45   |**0.59**  |2.07   |
|Graph1k-15%  |1.30   |**0.58**  |1.88   |
|Graph1k-20%  |1.25   |**0.55**  |1.72   |
|Graph1k-25%  |1.19   |**0.49**  |1.67   |
|Graph1k-30%  |1.15   |**0.48**  |1.55   |
|                                        |
|Graph5k-5%   |16.01  |**5.88**  |12.80  |
|Graph5k-10%  |15.10  |**5.67**  |12.13  |
|Graph5k-15%  |14.63  |**4.81**  |11.91  |
|Graph5k-20%  |14.16  |**4.62**  |11.68  |
|Graph5k-25%  |13.76  |**4.51**  |11.31  |
|Graph5k-30%  |13.38  |**4.45**  |10.94  |
|                                        |
|Graph10k-5%  |46.06  |**18.20** |34.05  |
|Graph10k-10% |44.59  |**17.92** |32.88  |
|Graph10k-15% |43.68  |**17.31** |31.91  |
|Graph10k-20% |42.48  |**16.88** |31.01  |
|Graph10k-25% |41.32  |**16.58** |30.74  |
|Graph10k-30% |39.98  |**16.34** |30.13  |
|                                        | 
|Graph20k-5%  |140.46 |**54.01** |87.04  |
|Graph20k-10% |138.10 |**52.51** |85.49  |
|Graph20k-15% |137.25 |**52.12** |82.88  |
|Graph20k-20% |133.11 |**51.68** |82.16  |
|Graph20k-25% |122.48 |**50.79** |79.87  |
|Graph20k-30% |120.94 |**50.49** |78.81  |
|                                        |
|Graph30k-5%  |310.25 |**96.38** |154.60 |
|Graph30k-10% |301.80 |**94.98** |151.81 |
|Graph30k-15% |299.27 |**94.85** |151.12 |
|Graph30k-20% |296.43 |**94.67** |146.25 |
|Graph30k-25% |294.33 |**92.62** |144.08 |
|Graph30k-30% |288.50 |**90.13** |142.33 |
|                                        |
|Graph40k-5%  |533.29 |**201.19**|250.79 |
|Graph40k-10% |505.91 |**199.18**|244.79 |
|Graph40k-15% |490.39 |**194.34**|242.55 |
|Graph40k-20% |478.31 |**183.14**|241.47 |
|Graph40k-25% |467.18 |**177.55**|237.29 |
|Graph40k-30% |418.07 |**174.65**|229.65 |
|                                        |
|Graph50k-5%  |642.42 |**240.58**|348.33 |
|Graph50k-10% |624.36 |**238.35**|344.06 |
|Graph50k-15% |611.70 |**237.65**|340.20 |
|Graph50k-20% |610.40 |**230.76**|337.36 |
|Graph50k-25% |596.29 |**230.03**|332.01 |
|Graph50k-30% |580.44 |**226.31**|325.88 |

####MIW & QW results
Below we list the results of MIW and QW for each dataset.

| Dataset | Workload | Titan | OrientDB | Neo4j    |
| ------- | -------- | ----- | -------- | -----    |
|   EN    |    MIW   |9.36   |62.77     |**6.77**  |
|   AM    |    MIW   |34.00  |97.00     |**10.61** |
|   YT    |    MIW   |104.27 |252.15    |**24.69** |
|   LJ    |    MIW   |663.03 |9416.74   |**349.55**|
|                                                  |
|   EN    |  QW-FN   |1.87   |**0.56**  |0.95      |
|   AM    |  QW-FN   |6.47   |3.50      |**1.85**  |
|   YT    |  QW-FN   |20.71  |9.34      |**4.51**  |
|   LJ    |  QW-FN   |213.41 |303.09    |**47.07** |
|                                                  |
|   EN    |  QW-FA   |3.78   |0.71      |**0.16**  |
|   AM    |  QW-FA   |13.77  |2.30      |**0.36**  |
|   YT    |  QW-FA   |42.82  |6.15      |**1.46**  |
|   LJ    |  QW-FA   |460.25 |518.12    |**16.53** |
|                                                  |
|   EN    |  QW-FS   |1.63   |3.09      |**0.16**  |
|   AM    |  QW-FS   |0.12   |83.29     |**0.302** |
|   YT    |  QW-FS   |24.87  |23.47     |**0.08**  |
|   LJ    |  QW-FS   |123.50 |86.87     |**18.13** |

####SIW results
Below we list the results of SIW for each dataset.

![siw_benchmark_updated](https://cloud.githubusercontent.com/assets/8163869/12272282/62b1c9f4-b914-11e5-85be-efd3f58e1e05.png)

Contact
-------
For more information or support, please contact: sotbeis@iti.gr, sot.beis@gmail.com, papadop@iti.gr or amcp@me.com.