SoM

(β˜… 1,553)

[arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs

  • .env.example
  • .gitignore
  • client.py
  • CODE_OF_CONDUCT.md
  • demo_gpt4v_som.py
  • demo_som.py
  • deploy.py
  • deploy_requirements.txt
  • docker-build-ec2.yml.j2
  • Dockerfile
  • download_ckpt.sh
  • entrypoint.sh
  • gpt4v.py
  • LICENSE
  • README.md
  • SECURITY.md
  • SUPPORT.md

# Installation Guide

1. Get the code
git clone https://github.com/microsoft/SoM

Downloads the entire project code from GitHub to your computer.

cd SoM

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended
Prerequisites
  • Python 3 Python is required to use pip.
pip install git+https://github.com/UX-Decoder/Segment-Everything-Everywhere-All-At-Once.git@package

Installs the package published on PyPI directly β€” no need to clone the source.

pip install git+https://github.com/facebookresearch/segment-anything.git

Installs the package published on PyPI directly β€” no need to clone the source.

pip install git+https://github.com/UX-Decoder/Semantic-SAM.git@package

Installs the package published on PyPI directly β€” no need to clone the source.

βœ… After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Docker

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -t som .

Builds a runnable image based on the Dockerfile.

docker run -p 8080:80 som

Runs the built image as an actual container.

βœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

4. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install git+https://github.com/UX-Decoder/Segment-Everything-Everywhere-All-At-Once.git@package

Installs the package published on PyPI directly β€” no need to clone the source.

pip install git+https://github.com/facebookresearch/segment-anything.git

Installs the package published on PyPI directly β€” no need to clone the source.

pip install git+https://github.com/UX-Decoder/Semantic-SAM.git@package

Installs the package published on PyPI directly β€” no need to clone the source.

python -m pip install 'git+https://github.com/MaureenZOU/detectron2-xyz.git'

Installs the Python libraries listed in requirements.txt (or similar).

βœ… If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

// repository documentation