lmdbdict

KO | EN

gitlite — search

#llm #golang #machine-learning #rust #macos #nodejs #awesome #kubernetes #vue #awesome-list #security #openai #ios #open-source

(★ 23)

A simple wrapper for lmdb. Support dict-like operations.

lmdbdict Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# lmdbdict
![CI test](https://github.com/ruotianluo/lmdbdict/workflows/CI%20test/badge.svg?event=push)
[![PyPI version](https://badge.fury.io/py/lmdbdict.svg)](https://badge.fury.io/py/lmdbdict)
[![Documentation Status](https://readthedocs.org/projects/lmdbdict/badge/?version=latest)](https://lmdbdict.readthedocs.io/en/latest/?badge=latest)

This is a lib trying to make lmdb behaved like a python dict.

Many adopted from https://github.com/Lyken17/Efficient-PyTorch.

# Install
```pip install lmdbdict```

or build from master:

```pip install git+https://github.com/ruotianluo/lmdbdict.git```

# How to use

```
from lmdbdict import lmdbdict

lmdbpath = 'tmplmdb.lmdb'
# In write mode, you can modify keys
# keys and values can be any pickable objects
d = lmdbdict(lmdbpath, mode = 'w')
d[1] = 2; d[2] = 3
list(d.keys())
d.values() # not supported
del d[2]
# you can flush the d to make sure the data is written to the disk
d.flush()
# delete the d will also flush
del d

# In read mode, you can only read
d = lmdbdict(lmdbpath, mode = 'r')
d[1]
```

Learn more at the [documentation](https://lmdbdict.readthedocs.io/).

# Folder to lmdb
For directory structure like this.
```
folder1
  - folder2
    - x.txt
  - y.txt
```
run
```
python folder2lmdb.py -f folder1 --lmdb folder1.lmdb
```
You will get keys to be `['folder2/x.txt', 'y.txt']`.

lmdbdict

lmdbdict Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

lmdbdict

lmdbdict Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README