HIMOS

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

★ 21 Open GitHub ↗

Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation. Project website: http://himos.cs.uni-freiburg.de

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# HIMOS: Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation

Repository providing the source code for the paper "Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation", see the [project website]([http://mobile-rl.cs.uni-freiburg.de/](http://himos.cs.uni-freiburg.de)).  
Please cite the paper as follows:

@article{schmalstieg2023learning,
        title={Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation},
        author={Schmalstieg, Fabian and Honerkamp, Daniel and Welschehold, Tim and Valada, Abhinav},
        journal={arXiv preprint arXiv:2307.06125},
        year={2023}
    }

#### Simulation Setup
The repository uses the iGibson Simulator as well as Stable-baseline3 as external libaries. Please install iGibson==2.2.0 and Stable-baseline3==1.4.0

To train the Fetch robot, you must copy the inflated maps from the requirements folder into the respective iGibson data folders such that the robot computes feasable paths for navigation.

The iGibson dataset requires a valid license, which needs to be added manually. The corresponding link can be found here https://docs.google.com/forms/d/e/1FAIpQLScPwhlUcHu_mwBqq5kQzT2VRIRwg_rJvF0IWYBk_LxEZiJIFg/viewform.
For more information please have a look on the official website: https://stanfordvl.github.io/iGibson/dataset.html

#### Docker
To enable easy use and reproduction, we provide a docker container. To use this container, download the data as discussed above. Then mount the data folder to `/opt/iGibson/igibson/data`. A configuration for VSCode can be found in `.devcontainer/devcontainer.json`.

To run the container, clone this repository, then run the following, replacing the paths where needed.
```
docker pull dhonerkamp/himos
docker run -it --gpus=all --rm --network=host --shm-size=120.0gb --env DISPLAY --volume /tmp/.X11-unix:/tmp/.11-unix:rw --volume ${localEnv:HOME}/.Xauthority:/root/.Xauthority:rw --volume ${dataFolder}:/opt/Gibson/igibson/data:rw --env QT_X11_NO_MITSHM=1 --volume ${localRepositoryFolder}:/workspaces/HIMOS dhonerkamp/himos bash
```

##### Visualisation
For visualizating the egocentric maps and their corresponding static map, add the flag `show_map=true` in`config.yaml`.

#### Notes

The iGibson simulator might crash, when evaluating multiple envrionments and use the gui mode.

#### References
<a name="interactive-multi-object-search" href="https://arxiv.org/abs/2307.06125">[1]</a> Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulation,
[arXiv]([https://arxiv.org/abs/2205.11384](https://arxiv.org/abs/2307.06125)https://arxiv.org/abs/2307.06125).

HIMOS

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

HIMOS

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README