ChartDete

KO | EN

gitlite — search

#react #ai #typescript #golang #go #linux #docker #nodejs #macos #windows #awesome #awesome-list #security #mcp

(★ 53)

Context-Aware Chart Element Detection

ChartDete 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

CACHED: Context-Aware Chart Element Detection
===

The github repository for ICDAR 2023 paper 'CACHED: Context-Aware Chart Element Detection'. The code is based on MMDetection Framework. The [<u>[Link]</u>](https://link.springer.com/chapter/10.1007/978-3-031-41676-7_13) to our paper, alternative option [<u>[ArXiv]</u>](https://arxiv.org/abs/2305.04151)

- Updated PMC Dataset (COCO format) is available from [HERE](https://drive.google.com/file/d/1YZmRy9TcaOJ6tA8DLeG0sXhSjwqqAw_h/view?usp=sharing), please unzip it to 'data/' folder.
- Models can be accessed in [HERE](https://drive.google.com/file/d/1htEEzRVE9Qlppz8ZgyEPJ3OI1HHY6gDS/view?usp=sharing), please download them and unzip them to 'work_dirs/' folder.
- Model Config files are under 'configs/'.

**cite our work by:**
```latex
@InProceedings{10.1007/978-3-031-41676-7_13,
    author="Yan, Pengyu
    and Ahmed, Saleem
    and Doermann, David",
    editor="Fink, Gernot A.
    and Jain, Rajiv
    and Kise, Koichi
    and Zanibbi, Richard",
    title="Context-Aware Chart Element Detection",
    booktitle="Document Analysis and Recognition - ICDAR 2023",
    year="2023",
    publisher="Springer Nature Switzerland",
    address="Cham",
    pages="218--233",
    abstract="As a prerequisite of chart data extraction, the accurate detection of chart basic elements is essential and mandatory. In contrast to object detection in the general image domain, chart element detection relies heavily on context information as charts are highly structured data visualization formats. To address this, we propose a novel method CACHED, which stands for Context-Aware Chart Element Detection, by integrating a local-global context fusion module consisting of visual context enhancement and positional context encoding with the Cascade R-CNN framework. To improve the generalization of our method for broader applicability, we refine the existing chart element categorization and standardized 18 classes for chart basic elements, excluding plot elements. Our CACHED method, with the updated category of chart elements, achieves state-of-the-art performance in our experiments, underscoring the importance of context in chart element detection. Extending our method to the bar plot detection task, we obtain the best result on the PMC test dataset. Our code and model are available at https://github.com/pengyu965/ChartDete.",
    isbn="978-3-031-41676-7"
}
```

## Introduction
### Our method

![Objective](https://raw.githubusercontent.com/pengyu965/ChartDete/main/docs/paper_doc/context-aware-chart-detection_v4.png "Method")

---

![Our Method](https://raw.githubusercontent.com/pengyu965/ChartDete/main/docs/paper_doc/framework.png "Framework")

### Main Result

Here we attached the screenshots of table in our paper for your references:

![Legacy Evaluation](https://raw.githubusercontent.com/pengyu965/ChartDete/main/docs/paper_doc/legacy_result.png "Legacy Evaluation")
![COCO Evaluation](https://raw.githubusercontent.com/pengyu965/ChartDete/main/docs/paper_doc/coco_result.png "COCO Evaluation")
![PMC Bar Evaluation](https://raw.githubusercontent.com/pengyu965/ChartDete/main/docs/paper_doc/extendedbar_result.png "PMC Bar Evaluation")

**Note:** The models can be downloaded [HERE](https://drive.google.com/file/d/1n9UtHgfOA6H8cxp4Y44fG7OdXbVJzMnJ/view?usp=share_link), which include:
- DETR
- ResNeXt-101 Faster-RCNN
- ResNeXt-101 Cascade-RCNN
- Swin-Transformer Cascade-RCNN
- Our methods
- Our methods (bar chart detection)

## Updated PMC dataset
We analyze and refine the chart element categorization. Totally 18 classes of chart element are summarized. We updated the PMC chart dataset from ICPR 2022 Chart Competition according to the new category and convert them to COCO format.

## Model Usage
### Install Environment

This code is based on MMdetection Framework, please refer to MMDetection Official [Website](https://github.com/open-mmlab/mmdetection) for detailed installation. The following is brief environment and installation:

Pytorch 1.13.1 and CUDA 11.7 are used during building and testing.

Create Conda Environment:
```bash
conda create -n ChartDete python=3.8
conda activate ChartDete
```

Make sure CUDA 11.7 with correct cudnn version is installed in your environment, then install pytorch 1.13.1:
```bash
conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia
```

Install mmcv:
```bash
pip install -U openmim
mim install mmcv-full
```

The newest mmdetection has replaced the mmcv-full with mmcv 2.0, but it would raise compatibale issue for our code, therefore, we use mmcv-full here.

Install MMDetection:
```
git clone https://github.com/pengyu965/ChartDete
cd ChartDete
pip install -v -e .
```

### Inference
The model config files and weights need to be paired correctly for usage. Model weights could be download from above link, please unzip them to './work_dirs/'.

The inference follows the MMDetection routine, please refer to the official [tutorial](./docs/en/1_exist_data_model.md).

A simple demo is here for your convenience:
```python
from mmdet.apis import init_detector, inference_detector
import mmcv

# Specify the path to model config and checkpoint file
config_file = './work_dirs/cascade_rcnn_swin-t_fpn_LGF_VCE_PCE_coco_focalsmoothloss/cascade_rcnn_swin-t_fpn_LGF_VCE_PCE_coco_focalsmoothloss.py'
checkpoint_file = './work_dirs/cascade_rcnn_swin-t_fpn_LGF_VCE_PCE_coco_focalsmoothloss/checkpoint.pth'

# build the model from a config file and a checkpoint file
model = init_detector(config_file, checkpoint_file, device='cuda:0')

# test a single image and show the results
img = './sample.jpg'  # or img = mmcv.imread(img), which will only load it once
result = inference_detector(model, img)
# visualize the results in a new window
model.show_result(img, result)
# or save the visualization results to image files
model.show_result(img, result, out_file='./sample_result.jpg')
```

Example detection result:

![demo result](https://raw.githubusercontent.com/pengyu965/ChartDete/main/sample_result.jpg "Title")

ChartDete

ChartDete 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

ChartDete

ChartDete 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README