Detecting-Melanoma-Fairly

KO | EN

gitlite — search

#ai #typescript #go #android #machine-learning #rust #linux #nodejs #cli #vue #pytorch #security #mcp #openai

Detecting-Melanoma-Fairly

(★ 18)

Implementation for MICCAI DART paper: 'Detecting Melanoma Fairly: Skin Tone Detection and Debiasing for Skin Lesion Classification'

Detecting-Melanoma-Fairly 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Detecting Melanoma Fairly: Skin Tone Detection and Debiasing for Skin Lesion Classification [[PDF](https://arxiv.org/pdf/2202.02832.pdf)]

## Method:

"Convolutional Neural Networks have demonstrated dermatologist-level performance in the classification of melanoma and other skin lesions, but performance disparities between differing skin tones is an issue that should be addressed before widespread deployment. In this work, we look to tackle skin tone bias in melanoma classification. We propose a simple algorithm for automatically labelling the skin tone of lesion images, and use this to annotate the benchmark ISIC dataset. We subsequently use two leading bias unlearning techniques [[2]](https://openaccess.thecvf.com/content_CVPR_2019/papers/Kim_Learning_Not_to_Learn_Training_Deep_Neural_Networks_With_Biased_CVPR_2019_paper.pdf) 
[[3]](https://www.robots.ox.ac.uk/~vgg/publications/2018/Alvi18/alvi18.pdf) to mitigate skin tone bias. Our experimental results provide evidence that our skin tone detection algorithm outperforms existing solutions and that unlearning skin tone improves generalisation and can reduce the performance disparity between lighter and darker skin tones [[4]](https://arxiv.org/abs/2104.09957)."

[[Bevan and Atapour-Abarghouei, 2021](https://arxiv.org/abs/2202.02832)]

---
---

## Usage

### Software used (see `requirements.txt` for package requirements)

Python 3.9.6

CUDA Version 11.3

Nvidia Driver Version: 465.31

PyTorch 1.8.1

---

### Downloading data

A free account must be created to download The Interactive Atlas of Dermoscopy, available at this link:
[https://derm.cs.sfu.ca/Download.html](https://derm.cs.sfu.ca/Download.html). Place the `release_v0.zip` file into the
`data/raw_images` directory (see below), from which it will be processed by the `download.py` script. The other datasets
will be automatically downloaded and processed by the `download.py` script.

Run `download.py` to download, crop and resize the ISIC, ASAN, MClass clinical, MClass dermoscopic and Fitzpatrick17k
datasaets. Have patience as it may take around an hour to complete. The 256x256 resized images are automatically placed
into `data/images` as shown below. The manually downloaded Atlas data (`data/raw_images/release_v0.zip`) will also be
processed by this script. Note this script clears the `data/images` directory before populating it, so if you want to put other
images in there, do this after running the `download.py` script.

If you do wish to manually download the datasets, they are available at the following links:

ISIC 2020 data: [https://www.kaggle.com/cdeotte/jpeg-melanoma-256x256](https://www.kaggle.com/cdeotte/jpeg-melanoma-256x256)  
ISIC 2019/2018/2017 data: [https://www.kaggle.com/cdeotte/jpeg-isic2019-256x256](https://www.kaggle.com/cdeotte/jpeg-isic2019-256x256)  
Interactive Atlas of Dermoscopy: [https://derm.cs.sfu.ca/Welcome.html](https://derm.cs.sfu.ca/Welcome.html)  
ASAN Test set: [https://figshare.com/articles/code/Caffemodel_files_and_Python_Examples/5406223](https://figshare.com/articles/code/Caffemodel_files_and_Python_Examples/5406223)  
MClassC/MClassD: [https://skinclass.de/mclass/](https://skinclass.de/mclass/)

---

### Training and evaluation

Training commands for the main experiments from the paper are below. Please see `arguments.py` for the full range of arguments if you wish to devise alternative experiments. Test results (plots, logs and weights) will autosave into the `results` directory, in subdirectories specific to the test number. Please contact me if you require trained weights for any model in the report.

Some useful arguments to tweek the below commands:
* Adjust `--CUDA_VISIBLE_DEVICES` and `num-workers` to suit the available GPUs and CPU cores respectively on your machine.
* To run in debug mode add `--DEBUG` (limits epochs to 3 batches)
* To rerun with different random seeds, use `--seed` argument
* To run on different architechtures, use `--arch` argument to choose from `resnext101`, `enet`, `resnet101`, `densenet` or `inception` (default=`resnext101`)
* Add `--cv` to perform cross validation
* Add `--test-only` if you wish to load weights and run testing only (loads weights of whatever `--test-no` argument is passed).

***Unlearning skin type when training on Fitzpatrick17k data (trains on types 1&2 skin and tests on types 3&4, and 5&6 skin)***
<pre>
Baseline: python train.py --test-no 13 --n-epochs 30 --sktone --CUDA_VISIBLE_DEVICES 0,1 --dataset Fitzpatrick17k --split-skin-types
LNTL: python train.py --test-no 14 --n-epochs 30 --debias-config LNTL --GRL --sktone --CUDA_VISIBLE_DEVICES 0,1 --dataset Fitzpatrick17k --split-skin-types
TABE: python train.py --test-no 15 --n-epochs 30 --debias-config TABE --sktone --CUDA_VISIBLE_DEVICES 0,1 --dataset Fitzpatrick17k --split-skin-types
CLGR: python train.py --test-no 16 --n-epochs 30 --debias-config TABE --GRL --sktone --CUDA_VISIBLE_DEVICES 0,1 --dataset Fitzpatrick17k --split-skin-types
</pre>

Pre labelled skin types are provided in `data/csv/isic_train_20-19-18-17.csv`, but if you wish to run the labelling algorithm, run `preprocessing.py`.

***Unlearning skin type when training on full ISIC data***
<pre>
Baseline: python train.py --test-no 17 --n-epochs 4 --sktone --CUDA_VISIBLE_DEVICES 0,1
LNTL: python train.py --test-no 18 --n-epochs 4 --debias-config LNTL --GRL --sktone --CUDA_VISIBLE_DEVICES 0,1 --num-aux 6
TABE: python train.py --test-no 19 --n-epochs 4 --debias-config TABE --sktone --CUDA_VISIBLE_DEVICES 0,1 --num-aux 6
CLGR: python train.py --test-no 20 --n-epochs 4 --debias-config TABE --GRL --sktone --CUDA_VISIBLE_DEVICES 0,1 --num-aux 6
</pre>

---

## Reference:

[Detecting Melanoma Fairly: Skin Tone Detection and Debiasing for Skin Lesion Classification](https://arxiv.org/abs/2202.02832)
(P. Bevan, A. Atapour-Abarghouei) [[pdf](https://arxiv.org/pdf/2202.02832.pdf)]

```
@misc{bevan2022detecting,
      title={Detecting Melanoma Fairly: Skin Tone Detection and Debiasing for Skin Lesion Classification}, 
      author={Peter J. Bevan and Amir Atapour-Abarghouei},
      year={2022},
      eprint={2202.02832},
      archivePrefix={arXiv},
      primaryClass={eess.IV}
}
```
---

Detecting-Melanoma-Fairly

Detecting-Melanoma-Fairly 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Detecting-Melanoma-Fairly

Detecting-Melanoma-Fairly 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README