lmdbdict

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

★ 23 Open GitHub ↗

A simple wrapper for lmdb. Support dict-like operations.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# lmdbdict
![CI test](https://github.com/ruotianluo/lmdbdict/workflows/CI%20test/badge.svg?event=push)
[![PyPI version](https://badge.fury.io/py/lmdbdict.svg)](https://badge.fury.io/py/lmdbdict)
[![Documentation Status](https://readthedocs.org/projects/lmdbdict/badge/?version=latest)](https://lmdbdict.readthedocs.io/en/latest/?badge=latest)

This is a lib trying to make lmdb behaved like a python dict.

Many adopted from https://github.com/Lyken17/Efficient-PyTorch.

# Install
```pip install lmdbdict```

or build from master:

```pip install git+https://github.com/ruotianluo/lmdbdict.git```

# How to use

```
from lmdbdict import lmdbdict

lmdbpath = 'tmplmdb.lmdb'
# In write mode, you can modify keys
# keys and values can be any pickable objects
d = lmdbdict(lmdbpath, mode = 'w')
d[1] = 2; d[2] = 3
list(d.keys())
d.values() # not supported
del d[2]
# you can flush the d to make sure the data is written to the disk
d.flush()
# delete the d will also flush
del d

# In read mode, you can only read
d = lmdbdict(lmdbpath, mode = 'r')
d[1]
```

Learn more at the [documentation](https://lmdbdict.readthedocs.io/).

# Folder to lmdb
For directory structure like this.
```
folder1
  - folder2
    - x.txt
  - y.txt
```
run
```
python folder2lmdb.py -f folder1 --lmdb folder1.lmdb
```
You will get keys to be `['folder2/x.txt', 'y.txt']`.

lmdbdict

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README