distributed-rocksdb-talk

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

distributed-rocksdb-talk

★ 8 Open GitHub ↗

References to Distributed RocksDB

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## Abstract
At Indix, all systems deal with huge volumes of data, which means, they need to be distributed. We started out with using open source distributed systems (like Hadoop, HBase, Solr, Spark, etc) to help accomplish some of our needs. Along the way, we’ve also had some problems where existing solutions wouldn’t really work for the use cases that we had or there was a large operation overheard associated with them. This pushed us to build a couple of “simple” distributed systems.We built most of these using RocksDB as the backend store. This talk contains learnings from our discussion.

Slides - http://bit.ly/distributed-rocksdb

Video - https://www.youtube.com/watch?v=PSCa9_Avne0

## About Author
Ashwanth Kumar is a Principal Engineer at Indix. His major interest lies in building and operating large data systems. When not dealing with data, he spends his time reading research papers in similar topics.

## References
- https://speakerdeck.com/caitiem20/building-scalable-stateful-services-1
- http://www.i-programmer.info/news/136-open-source/8220-microsoft-puts-orleans-code-on-github.html
- http://www.slideshare.net/HiveData/tech-talk-rocksdb-slides-by-dhruba-borthakur-haobo-xu-of-facebook
- http://www.slideshare.net/IgorCanadi/rocksdb-storage-engine-for-mysql-and-mongodb
- http://www.slideshare.net/meeeejin/rocksdb-compaction
- [Write Amplification](https://en.wikipedia.org/wiki/Write_amplification#Basic_SSD_operation)
- [Read Amplification Factor](http://mysqlha.blogspot.in/2011/08/read-amplification-factor.html)
- [The Chubby Lock Service for Loosely-Coupled Distributed Systems](http://research.google.com/archive/chubby.html)

## Tools
- [RocksDB](http://rocksdb.org/)
- [Suuchi](https://github.com/ashwanthkumar/suuchi) - Toolkit for Building Distributed Data systems

## Image Credits
- [Twitter by aguycalledgary](https://thenounproject.com/search/?q=twitter+bird&i=23267) from the Noun Project
- [team by Wilson Joseph](https://thenounproject.com/term/team/717083/) from the Noun Project
- [Earth by To Uyen](https://thenounproject.com/search/?q=internet+globe&i=318309) from the Noun Project
- [database by Kevin Woodland](https://thenounproject.com/search/?q=database&i=282705) from the Noun Project
- [options by Mert Güler](https://thenounproject.com/search/?q=toolkit&i=638516) from the Noun Project
- [SQL File by Viktor Vorobyev](https://thenounproject.com/search/?q=sql&i=342070) from the Noun Project
- [database by ✦ Shmidt Sergey ✦](https://thenounproject.com/search/?q=database&i=691819) from the Noun Project
- [sigma by Davo Sime from the Noun Project](https://thenounproject.com/search/?q=sigma&i=607382)
- [tools by Viktor Vorobyev from the Noun Project](https://thenounproject.com/search/?q=hammer&i=561830)
- [Info by Lance Weisser from the Noun Project](https://thenounproject.com/search/?q=info&i=91723)
- C++ Logo - https://worldvectorlogo.com/logo/c
- Scala Logo - https://github.com/OlegIlyenko/scala-icon

## License
[![Creative Commons License](https://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/)  
<span xmlns:dct="http://purl.org/dc/terms/" property="dct:title">Building Distributed RocksDB</span> by [Ashwanth Kumar](http://bit.ly/distributed-rocksdb) is licensed under a [Creative Commons Attribution 4.0 International License](http://creativecommons.org/licenses/by/4.0/).

distributed-rocksdb-talk

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README