KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #developer-tools #ai-agent #claude-code #codex #typescript #ai-agents #deepseek-harness #mcp #cli #rust

PIEPredict

★ 162 Open GitHub ↗

PIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Pedestrian intention and trajectory estimation

This repository contains Python code and pretrained models for pedestrian intention and trajectory estimation presented in our paper [**A. Rasouli, I. Kotseruba, T. Kunic, and J. Tsotsos, "PIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction", ICCV 2019.**](https://openaccess.thecvf.com/content_ICCV_2019/papers/Rasouli_PIE_A_Large-Scale_Dataset_and_Models_for_Pedestrian_Intention_Estimation_ICCV_2019_paper.pdf)

### Table of contents
* [Dependencies](#dependencies)
* [PIE dataset](#PIE_dataset)
* [Train](#train)
* [Test](#test)
* [Citation](#citation)
* [Corresponding authors](#authors)
* [License](#license)

<a name="dependencies"></a>
## Dependencies
The interface is written and tested on Ubuntu 16.04 with Python 3.5, CUDA 9 and cuDNN 7. The interface also requires
the following external libraries:<br/>
* tensorflow (tested with 1.9 and 1.14)
* keras (tested with 2.1 and 2.2)
* scikit-learn
* numpy
* pillow

To install via virtual environment (recommended) follow these steps:

- Install virtual environment `sudo apt-get install virtualenv`.

- Create a virtual environment with Python3:

```
> virtualenv --system-site-packages -p python3 ./venv
> source venv/bin/activate
```
- Install dependencies:
`pip3 install -r requirements.txt`

<a name="datasets"></a>
## PIE Dataset
The code is trained and tested with [Pedestrian Intention Estimation (PIE) dataset](http://data.nvision2.eecs.yorku.ca/PIE_dataset/).

Download annotations and video clips from the [PIE webpage](http://data.nvision2.eecs.yorku.ca/PIE_dataset/) and place them in the `PIE_dataset` directory. The folder structure should look like this:

```
PIE_dataset
    annotations
        set01
        set02
        ...
    PIE_clips
        set01
        set02
        ...

```

Videos will be automatically split into individual frames for training. This will require **1.1T** of free space on the hard drive.

Create environment variables for PIE data root and add them to your `.bashrc`:

```
export PIE_PATH=/path/to/PIE/data/root
export PIE_RAW_PATH=/path/to/PIE/data/PIE_clips/
```

Download PIE data interface `pie_data.py` from [PIE github](https://github.com/aras62/PIE).

<a name="train"></a>
## Train

To train all models from scratch and evaluate them on the test data use this command:
```
python train_test.py 1
```
This will train intention, speed and trajectory models separately and evaluate them on the test data.

_Note: training intention model uses image data and requires 32GB RAM.

Due to the random initialization of the networks and minor changes to the annotations there might be slight variation in the results.

<a name="test"></a>
## Test

To reproduce the results of our best model which combines pedestrian intention and vehicle speed for pedestrian trajectory prediction run this command:

```
python train_test.py 2
```

<a name="citation"></a>
## Citation
If you use our dataset and/or models, please cite:
```
@inproceedings{rasouli2017they,
  title={PIE: A Large-Scale Dataset and Models for Pedestrian Intention Estimation and Trajectory Prediction},
  author={Rasouli, Amir and Kotseruba, Iuliia and Kunic, Toni and Tsotsos, John K},
  booktitle={ICCV},
  year={2019}
}

```
<a name="authors"></a>
## Corresponding authors

* **[Amir Rasouli](https://aras62.github.io/)**
* **[Iuliia Kotseruba](http://www.cse.yorku.ca/~yulia_k/)**

Should you have any questions about downloading and using the data or the models, please feel free to raise an issue or send an email to arasouli.ai@gmail.com or yulia_k@eecs.yorku.ca.

<a name="license"></a>
## License
This project is licensed under the Apache 2.0 License - see the [LICENSE](LICENSE) file for details

PIEPredict

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README