rawdodendron

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #golang #android #rust #deep-learning #docker #java #kubernetes #security #openai #open-source

(★ 9)

An audio/image converter using a raw approach

rawdodendron Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# rawdodendron

An audio/image converter using a raw approach. A byte-to-byte translation is provided between image file and audio files (in both directions), in order to misuse image and sound processing algorithms.

Using this tool before and after using a [Digital Audio Workstation](https://en.wikipedia.org/wiki/Digital_audio_workstation) (such as audacity, ardour or reaper) gives a way to apply audio filters on images.

Using this tool before and after using a [Raster Graphic Editor](https://en.wikipedia.org/wiki/Raster_graphics_editor) (such as gimp) gives a way and to apply image filters on audio files.

*This tool is inspired by Cécile Georges' artistic practices, and aims to extend the possibilities offered by digital bending.*

## Raw conversion

The raw conversion uses a byte to byte conversion, each audio sample being translated into a pixel. By consequence, we obtain a time wrapping, each audio sample being the neighbor of a sample from the past (and future). The size of the wrapping (in ms) depends on the audio bitrate and the width of the image.

![Audio wrapping in an image. The image is defined line by line.](https://raw.githubusercontent.com/jmtrivial/rawdodendron/main/images/wrapping.png)

**Note:** stereo audio files and RGB/RGBA images are not described in this image, but it works in a similar way (each audio sample is a 2-bytes data, one per channel, and each pixel is a x-bytes data, one per color).

## Dependancies

* [pydub](http://pydub.com/)
* [pillow](https://pillow.readthedocs.io/en/stable/)
* [argparse](https://docs.python.org/3/library/argparse.html)
* [appdirs](https://pypi.org/project/appdirs/)
* [PyQt5](https://pypi.org/project/PyQt5/)

### Install dependancies on a debian system

```
sudo apt install python3-pydub python3-pil python3-appdirs python3-pyqt5
```

## Installation

- Add dependancies (see below)
- Download this repository
- run ```./install.sh```

## Usage

### Command line

Without spectific option, the script is using history to adjust the properties of the output. For example, in the following sequence, the first run produces a stereo 44.1 kHz audio file (default format), and store in the history the specific properties of the input image (width, height, RGB/RGBA). The second run uses the history to identify the correct image parameters, using the properties of the audio file (number of samples, number of channels and sample rate)  as a filtering to identify the possible configuration of the audio file ancestor.

* ```rawdodendron.py -i image.png -o audio.wav``` to convert an image to an audio file
* ```rawdodendron.py -i audio.wav -o image.png``` to convert an audio file to an image

You can of course force properties using command line parameters:

* ```rawdodendron.py -i audio.wav -o image.png -w 300 --rgb```

All the command line parameters are visibles using the following command:

* ```rawdodendron.py -h```

### Graphical interface

A Qt5 interface is provided (only available in french), in order to process a series of conversion, editing each of the available parameters for each input file.

![graphic interface](https://raw.githubusercontent.com/jmtrivial/rawdodendron/main/images/interface.png)

### Service menu on KDE

Right clic on an image file and find the *rawdodendron* entry to convert it to an audio file.

![service menu (image to audio)](https://raw.githubusercontent.com/jmtrivial/rawdodendron/main/images/service-menu.png)

Right clic on an audio file and find the *rawdodendron* entry to convert it to an image file.

![service menu (audio to image)](https://raw.githubusercontent.com/jmtrivial/rawdodendron/main/images/service-menu2.png)

## Examples

### Using image processing algorithms on audio

![Screenshot of a conversion processing from gimp to audacity](https://raw.githubusercontent.com/jmtrivial/rawdodendron/main/images/image-2-audio.png)

Here is a link to a Youtube video illustrating the use of image processing algorithms on an audio file. Description is given in french.

[![Extrait d'une vidéo de démonstration de Rawdodendron](https://img.youtube.com/vi/e5jLRHVnhWw/0.jpg)](https://www.youtube.com/watch?v=e5jLRHVnhWw)

### Using audio processing algorithms on images

![Screenshot of a conversion processing from audacity to gimp](https://raw.githubusercontent.com/jmtrivial/rawdodendron/main/images/audio-2-image.png)

Some images generated from an RGBA png version of the initial *rhododendron* image, using the following process:

* convert the image to an audio file
* apply an audio processing algorithm (compression, reverb)
* convert back to an image

The last image is the result of a reverb, but from an RGB image (without alpha channel):

rawdodendron

rawdodendron Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

rawdodendron

rawdodendron Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README