stac-geoparquet - GitLite

KO | EN

gitlite — search

#hacktoberfest #react #llm #golang #android #rust #deep-learning #linux #docker #java #awesome-list #pytorch #openai #open-source

stac-geoparquet

(★ 148)

Convert STAC items between JSON, GeoParquet, pgstac, and Delta Lake.

File Explorer

Download Latest Version (.zip)

- - continuous-integration.yml
  - deploy-mkdocs.yml
  - publish.yml
  - release-please.yml
- dependabot.yml
- - arrow.md
  - legacy.md
  - pgstac.md
- - dump_pgstac_to_parquet.ipynb
  - naip.ipynb
- - main.html
- index.md
- usage.md
- whatsnew.md
- lint
- stac-geoparquet-spec.md
- - __init__.py
  - _api.py
  - _batch.py
  - _constants.py
  - _crs.py
  - _delta_lake.py
  - _from_arrow.py
  - _to_arrow.py
  - _to_parquet.py
  - _util.py
  - types.py
- __init__.py
- _compat.py
- from_arrow.py
- json_reader.py
- pgstac_reader.py
- py.typed
- stac_geoparquet.py
- to_arrow.py
- to_parquet.py
- utils.py
- - 3dep-lidar-copc-pc-collection.json
  - 3dep-lidar-copc-pc.json
  - 3dep-lidar-dsm-pc.json
  - cop-dem-glo-30-pc.json
  - download.py
  - io-lulc-annual-v02-pc.json
  - io-lulc-pc.json
  - landsat-c2-l1-pc.json
  - landsat-c2-l2-pc.json
  - naip-pc.json
  - naip.parquet
  - planet-nicfi-analytic-pc.json
  - README.md
  - sentinel-1-rtc-pc.json
  - sentinel-2-l2a-pc.json
  - umbra-sar.json
  - us-census-pc.json
- __init__.py
- base_sentinel2_l2a.json
- json_equals.py
- record_sentinel2_l2a.json
- sentinel-2-item.json
- test_arrow.py
- test_delta_lake.py
- test_parquet.py
- test_pgstac_reader.py
- test_stac_geoparquet.py
- test_to_dict.py
.dockerignore
.gitignore
.pre-commit-config.yaml
.python-version
.release-please-manifest.json
CHANGELOG.md
Dockerfile
LICENSE
mkdocs.yml
pyproject.toml
README.md
release-please-config.json
uv.lock

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# STAC-GeoParquet

Convert [STAC](https://stacspec.org/en) items between JSON, [GeoParquet](https://geoparquet.org/), [pgstac](https://github.com/stac-utils/pgstac), and [Delta Lake](https://delta.io/).

## Purpose

The STAC spec defines a JSON-based schema.
But it can be hard to manage and search through many millions of STAC items in JSON format.
For one, JSON is very large on disk.
And you need to parse the entire JSON data into memory to extract just a small piece of information, say the `datetime` and one `asset` of an Item.

GeoParquet can be a good complement to JSON for many bulk-access and analytic use cases.
While STAC Items are commonly distributed as individual JSON files on object storage or through a [STAC API](https://github.com/radiantearth/stac-api-spec), STAC GeoParquet allows users to access a large number of STAC items in bulk without making repeated HTTP requests.

For analytic questions like "find the items in the Sentinel-2 collection in June 2024 over New York City with cloud cover of less than 20%" it can be much, much faster to find the relevant data from a GeoParquet source than from JSON, because GeoParquet needs to load only the relevant columns for that query, not the full data.

See the [STAC-GeoParquet specification](https://radiantearth.github.io/stac-geoparquet-spec/) for details on the exact schema of the written Parquet files.

## Installation

Install via `pip` or `conda`:

* `pip install stac-geoparquet`
* `conda install conda-forge::stac-geoparquet`

## Documentation

[Documentation website](https://stac-utils.github.io/stac-geoparquet/)

## Development

Get [uv](https://docs.astral.sh/uv/getting-started/installation/), then:

```shell
git clone git@github.com:stac-utils/stac-geoparquet.git
cd stac-geoparquet
uv sync
uv run pre-commit install
uv run pytest
scripts/lint
```

## Releasing

We use [release-please](https://github.com/googleapis/release-please) to manage releases.
To create a new release, look for a [release PR](https://github.com/stac-utils/stac-geoparquet/pulls), approve it, and merge it.
**release-please** will create a tag and a release, which will trigger a new release on PyPI.