osm-tagger

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

★ 9 Open GitHub ↗

Generate OSM tags from text and images

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# OSM Tagger

As part of HOT's participation in @Tech To The Rescue, we collaborated with our new tech partner 
[Fulton Ring](https://www.fultonring.com/) for the development of an AI-powered API for **generating
valid OSM tags from street-level imagery**

The original idea was to integrate OSM Tagger with [ChatMap](https://github.com/hotosm/chatmap/) but it
can be used with any source of geo-located pictures.

_This tool is an experimental project, is not intended to be used yet by the general user/mapper to
update OSM_

## Setup & run

### Model (local)

For running OSM Tagger locally, you'll need [Ollama](https://ollama.com/) installed on your system.

Then, depending on your hardware, select and download an Ollama model.

Currently we support: `ollama/llava:34b` and `llama3.2-vision:11b`.

```sh
ollama pull llama3.2-vision:11b
```

And configure `config/models.py` accordingly.

_Note: you can also use Amazon Bedrock._

### Database & Storage

For local development and testing:

```sh
docker compose -f docker-compose.dev.yaml up -d
```

#### Database

Migrations and initial data for tagging roads:

```sh
poetry run alembic --name alembic revision --autogenerate
poetry run alembic --name alembic upgrade head
poetry run insert-image-embeddings
```

#### Storage

Go to the MinIO [admin](http://localhost:9001/browser) and setup a new bucket named `hotosm-osm-tagger`.

Then generate access keys and edit `config/models.py` un-commenting the lines for MinIO and adding the
credentials (`aws_access_key_id`, `aws_secret_access_key`).

You'll need to upload images to the Bucket, these are +9000 images of roads downloaded from Mapillary
that will help OSM Tagger to do the work and return a confidence value:

https://drive.google.com/file/d/1rNhUnXxmTjkCvbw6TuKc-0MgEIRsWxq4/view?usp=drive_link

Download the .zip file, un-compress it and upload the files to your bucket.

_Note: you can also use AWS S3_

### API

Install dependencies and run the API:

```sh
poetry install
uvicorn tagger.main:app --reload
```

Then, send a request with category and image (url and coordinates).

In this example we use "roads" and the image below:

```
curl --request POST -H "Content-Type: application/json" \
  --url http://127.0.0.1:8000/api/v1/tags/ \
  --data '{
  "category": "roads",
  "image": {
    "url": "https://umap.hotosm.org/media_file/00000030-PHOTO-2025-02-04-07-03-24.jpg",
    "coordinates": {
      "lat": -31.039293,
      "lon": -64.312332
    }
  }
}'
```

You should receive a response with OSM tags:

```json
{
  "tag_id": "f9ed4777-e9ef-46e0-b629-004eba0d2997",
  "tags": [
    {
      "key": "smoothness",
      "value": "intermediate",
      "confidence": 0.6
    },
    {
      "key": "surface",
      "value": "unpaved",
      "confidence": 0.6
    }
  ]
}
```

### Upload API

You can also upload images directly using the `/upload` endpoint:

```
curl --location 'http://localhost:8000/api/v1/tags/upload' \
--form 'category="roads"' \
--form 'lat="6.248001"' \
--form 'lon="-75.540833"' \
--form 'image=@"/Users/jeremyherzog/Downloads/bad_unpaved_road.jpg"'
```

### Curating Tags

Once tags have been confirmed, they can be saved for future use to improve
accuracy using the `tag_id`:

```
curl --location 'http://localhost:8000/api/v1/tags/f9ed4777-e9ef-46e0-b629-004eba0d2997' \
--header 'Content-Type: application/json' \
--data '{
    "tags": [
        {
            "key": "smoothness",
            "value": "very_bad",
            "confidence": 0.9497874632288248
        },
        {
            "key": "surface",
            "value": "unpaved",
            "confidence": 0.9497874632288248
        }
    ]
}'
```

## OSMTagger API

OSMTagger API should receive a request with an image URL, geo-location and category, and return
OSM valid tags. The category will help the API to decide a prompt and maybe other configurations.

Two models will be used, one focused on  extracting text from an image and the other for generating
OSM tags from the text. This will divide the problem in two and provide more flexibility for the 
final solution.

osm-tagger

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README