florence-2-large-playground

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

florence-2-large-playground

★ 12 Open GitHub ↗

No description available.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Microsoft Florence-2 Vision Model

This project demonstrates the use of Microsoft's Florence-2 Vision Model for various computer vision tasks using a Gradio interface.

## Overview

Florence-2 is a novel vision foundation model designed to handle a variety of computer vision and vision-language tasks with simple text prompts. This project allows you to upload an image and select a task to perform, such as object detection, OCR, captioning, and more.

## How to Run

1. **Install the required dependencies**:
   Ensure you have Python installed, then install the required packages using the following command:
   ```bash
   pip install -r requirements.txt
   ```

2. **Run the script**:
   Execute the Python script to start the Gradio interface:
   ```bash
   python ms-florence-2-gradio-v2.py
   ```

3. **Use the Gradio Interface**:
   - Open the provided local URL in your web browser.
   - Upload an image using the "Upload Image" button.
   - Select a task from the "Select Task" dropdown menu.
   - Optionally, provide additional text input if required by the selected task.
   - Click the "Start" button to process the image and view the results.

## Available Tasks

- **Object Detection**
- **OCR**
- **OCR with Region**
- **Caption**
- **Detailed Caption**
- **More Detailed Caption**
- **Caption to Phrase Grounding**
- **Dense Region Caption**
- **Region Proposal**
- **Expression Segmentation**
- **Open Vocabulary Detection**

![image](https://raw.githubusercontent.com/skye0402/florence-2-large-playground/master/images/cover.png "Example of a detection")

## Example

1. Upload an image.
2. Select "Object Detection" from the task dropdown.
3. Click "Start" to see the detected objects highlighted in the image.

## Additional Information

For more details on Florence-2, you can refer to the official publication by Microsoft: [Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks](https://www.microsoft.com/en-us/research/publication/florence-2-advancing-a-unified-representation-for-a-variety-of-vision-tasks/).

## Requirements

- gradio==4.36.1
- pillow==10.3.0
- transformers==4.41.2
- torch==2.3.1
- einops==0.8.0
- timm==1.0.7

Make sure to install these dependencies before running the script.

Enjoy exploring the capabilities of the Florence-2 Vision Model!

### Example of a detailed caption
![image](https://raw.githubusercontent.com/skye0402/florence-2-large-playground/master/images/caption1.jpg "Example of a detailed caption")
### Example of a segmentation 'a cup of coffee'
![image](https://raw.githubusercontent.com/skye0402/florence-2-large-playground/master/images/caption2.jpg "Example of a segmentation")
### Example of detailed object detection
![image](https://raw.githubusercontent.com/skye0402/florence-2-large-playground/master/images/caption3.jpg "Example of detailed object detection")

florence-2-large-playground

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README