earth-osm

KO | EN

gitlite — search

#python #hacktoberfest #react #ai #go #android #machine-learning #nodejs #java #cli #awesome-list #security #pytorch #mcp

(★ 54)

Export infrastructure data from OpenStreetMap using Python

earth-osm 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# earth-osm
One-command to extract infrastructure data from OpenStreetMap

[![][badge-pypi-monthly-downloads]][pypi-url]
[![][badge-codecov]][codecov-url]
[![][badge-ci]][gh-repo-url]
[![][badge-docs]][docs-url]
[![][badge-pypi]][pypi-url]
[![][badge-conda]][conda-url]
[![][badge-release]][gh-release-url]
[![][badge-license]][license]
[![][badge-discord]][discord-url]

[![][badge-gh-stars]][gh-stars-url]
[![][badge-gh-forks]][gh-forks-url]
[![][badge-gh-issues]][gh-issues-url]
[![][badge-gh-pulls]][gh-pulls-url]

</div>

## 📚 Overview

earth-osm downloads, filters, cleans and exports infrastructure data from OpenStreetMap (OSM). It provides a Python API and a CLI interface to extract data for various infrastructure types, such as power lines, substations, and more.

## 🌟 Key Features

- 🔌 Extracts infrastructure data from OSM
- 📅 Historical data support (specify target dates)
- 🧹 Cleans and standardizes the data *(coming soon)*
- 🚀 No API rate limits (data served from GeoFabrik)
- 🐍 Provides a Python API
- 🖥️ Supports multiprocessing for faster extraction
- 📊 Outputs data in .csv and .geojson formats
- 🌍 Supports planetary data extraction
- 🖱️ Easy-to-use CLI interface
- 🌐 Dual data sources: GeoFabrik (default) and live Overpass API
- 
## 🚀 Getting Started

### Installation

Install earth-osm using pip (recommended):

```bash
pip install earth-osm
```

Or with conda:

```bash
conda install --channel=conda-forge earth-osm
```

### Basic Usage

Extract OSM data using the CLI:

```bash
earth_osm extract power --regions benin monaco --features substation line
```

This command extracts power infrastructure data for Benin and Monaco, focusing on substations and power lines. By default, the resulting .csv and .geojson files are stored in `./earth_data/out`.

Load the extracted data using pandas:

```python
import pandas as pd
import geopandas as gpd

# For Pandas
df_substations = pd.read_csv('./earth_data/out/BJ_raw_substations.csv')

# For GeoPandas
gdf_substations = gpd.read_file('./earth_data/out/BJ_raw_substations.geojson')
```

### Optional: Speed up downloads with aria2c

Install [`aria2c`](https://aria2.github.io/) (for example `brew install aria2`, `sudo apt-get install aria2`, or `choco install aria2`) and set `EO_PARALLEL_DOWNLOADS` greater than 1; `earth-osm` will then use multiple connections for `.osm.pbf` downloads and otherwise falls back automatically.

```bash
export EO_PARALLEL_DOWNLOADS=8    # fish: set -x EO_PARALLEL_DOWNLOADS 8
earth_osm extract power --regions germany --features line
```

## 🛠️ CLI Reference

### Extract Command

```bash
earth_osm extract <primary> --regions <region1> <region2> ... [options]
```

#### Arguments:

- `<primary>`: Primary feature to extract (e.g power)

#### Required Options:

- `--regions`: Specify one or more regions using ISO 3166-1 alpha-2, ISO 3166-2 codes, or full names

> **Tip:** A list of regions is available at [regions.md](https://github.com/pypsa-meets-earth/earth-osm/blob/main/docs/generated-docs/regions_table.md)

#### Optional Arguments:

| Argument | Description | Default |
|----------|-------------|---------|
| `--features` | Specify sub-features of the primary feature | All features |
| `--update` | Update existing data | False |
| `--no_mp` | Disable multiprocessing | False (MP enabled) |
| `--data_dir` | Path to data directory | './earth_data' |
| `--out_dir` | Path to output directory | Same as data_dir |
| `--out_format` | Export format(s): csv and/or geojson | ['csv', 'geojson'] |
| `--agg_feature` | Aggregate outputs by feature | False |
| `--agg_region` | Aggregate outputs by region | False |
| `--source` | Data source: geofabrik (default) or overpass | geofabrik |

> ℹ️ When using the Overpass backend, wildcard feature selections such as `ALL_power` are not supported. Specify concrete feature values instead, or switch to the Geofabrik source for wildcard exports.

### Planet-wide extractions

Use the special `earth` region to export the full OpenStreetMap planet snapshot.

```bash
earth_osm extract power --regions earth --features line 
```

## 🐍 Python API

For more advanced usage, you can use the Python API:

```python
import earth_osm as eo

eo.save_osm_data(
    primary_name='power',
    region_list=['benin', 'monaco'],
    feature_list=['substation', 'line'],
    update=False,
    mp=True,
    data_dir='./earth_data',
    out_format=['csv', 'geojson'],
    out_aggregate=False,
    data_source='geofabrik'  # or 'overpass'
)
```

For historical data, add the `target_date` parameter:

```python
from datetime import datetime

# Download historical data for a specific date
eo.get_osm_data(
    region_str='malta',
    primary_name='power',
    feature_name='line',
    target_date=datetime(2020, 1, 1)  # Jan 1, 2020
)
```

## 🛠️ Development

To contribute to earth-osm, follow these steps:

1. (Optional) Install a specific version of earth_osm:
   ```bash
   pip install git+https://github.com/pypsa-meets-earth/earth-osm.git@<required-commit-hash>
   ```

2. (Optional) Create a virtual environment for Python >=3.10:
   ```bash
   python3 -m venv .venv
   source .venv/bin/activate
   ```

3. Install the development dependencies:
   ```bash
   pip install git+https://github.com/pypsa-meets-earth/earth-osm.git
   pip install -e .[dev]
   ```

4. Read the [CONTRIBUTING.md](https://github.com/pypsa-meets-earth/earth-osm/blob/main/CONTRIBUTING.md) file for more detailed information on how to contribute to the project.

## 🤝 Community

Join our [Discord community](https://discord.gg/AnuJBk23FU) to connect with other users and contributors, ask questions, and get support.

## 📚 Documentation

For more detailed information, check out our [full documentation](https://pypsa-meets-earth.github.io/earth-osm/).

---

<p align="center">
Made with ❤️ by the PyPSA meets Earth team
</p>

[contributing]: https://github.com/pypsa-meets-earth/earth-osm/blob/main/CONTRIBUTING.md
[license]: https://github.com/pypsa-meets-earth/earth-osm/blob/main/LICENSE
[docs-url]: https://pypsa-meets-earth.github.io/earth-osm/
[discord-url]: https://discord.gg/AnuJBk23FU
[pypi-url]: https://pypi.org/project/earth-osm/
[conda-url]: https://anaconda.org/conda-forge/earth-osm
[codecov-url]: https://codecov.io/gh/pypsa-meets-earth/earth-osm
[gh-repo-url]: https://github.com/pypsa-meets-earth/earth-osm
[gh-release-url]: https://github.com/pypsa-meets-earth/earth-osm/releases
[gh-stars-url]: https://github.com/pypsa-meets-earth/earth-osm/stargazers
[gh-forks-url]: https://github.com/pypsa-meets-earth/earth-osm/network/members
[gh-issues-url]: https://github.com/pypsa-meets-earth/earth-osm/issues
[gh-pulls-url]: https://github.com/pypsa-meets-earth/earth-osm/pulls

[badge-pypi-monthly-downloads]: https://img.shields.io/pypi/dm/earth-osm?style=flat&labelColor=black&logoColor=white&logo=pypi
[badge-codecov]: https://img.shields.io/codecov/c/github/pypsa-meets-earth/earth-osm?style=flat&labelColor=black&logoColor=white&logo=codecov
[badge-ci]: https://img.shields.io/github/actions/workflow/status/pypsa-meets-earth/earth-osm/main.yml?style=flat&labelColor=black&logoColor=white&logo=github
[badge-docs]: https://img.shields.io/github/actions/workflow/status/pypsa-meets-earth/earth-osm/docs-ci.yml?style=flat&labelColor=black&logoColor=white&logo=github

[badge-pypi]: https://img.shields.io/pypi/v/earth-osm.svg?style=flat&labelColor=black&logoColor=white&logo=pypi
[badge-conda]: https://img.shields.io/conda/vn/conda-forge/earth-osm.svg?style=flat&labelColor=black&logoColor=white&logo=conda-forge

[badge-discord]: https://img.shields.io/discord/911692131440148490?style=flat&labelColor=black&logoColor=white&logo=discord&color=blue
[badge-license]: https://img.shields.io/badge/License-MIT-blue.svg?style=flat&labelColor=black
[badge-release]: https://img.shields.io/github/v/release/pypsa-meets-earth/earth-osm?style=flat&labelColor=black&logoColor=white&logo=github

[badge-gh-stars]: https://img.shields.io/github/stars/pypsa-meets-earth/earth-osm?style=for-the-badge&labelColor=black&logoColor=white&color=yellow
[badge-gh-forks]: https://img.shields.io/github/forks/pypsa-meets-earth/earth-osm?style=for-the-badge&labelColor=black&logoColor=white&color=grey
[badge-gh-issues]: https://img.shields.io/github/issues/pypsa-meets-earth/earth-osm?style=for-the-badge&labelColor=black&logoColor=white&color=red
[badge-gh-pulls]: https://img.shields.io/github/issues-pr/pypsa-meets-earth/earth-osm?style=for-the-badge&labelColor=black&logoColor=white&color=green

earth-osm

earth-osm 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

earth-osm

earth-osm 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README