KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#developer-tools #typescript #dsh #dsh-plugin #ai-agent #codex #ai-agents #deepseek-harness #claude-code #cli #react #mcp

skin_cancer_detection

★ 96 Open GitHub ↗

Detecting cancers on mobile phones

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Skin Lesion Detection

### What is this all about?
The aim of this project is to detect **skin lesions** using a deep learning model. This project is a part of the ongoing **[#PoweredByTF 2.0 Challenge! ](https://tensorflow.devpost.com/)**. As the challenge is based on TF2.0, our aim is to build something in order to showcase:
* The ease of using TF2.0
* The power and simplicity of **Keras**
* The exceptional **tflite** framework

### Introduction
Any type of cancer is somehow deeply dangerous if not deadly. To see how bad the situation is, let us look at some of the stats given by the [skin cancer organization](https://www.skincancer.org/skin-cancer-information/):
* One in five Americans will develop skin cancer by the age of 70
* Actinic keratosis is the most common precancer; it affects more than 58 million Americans
* The annual cost of treating skin cancers in the U.S. is estimated at $8.1 billion: about $4.8 billion for nonmelanoma skin cancers and $3.3 billion for melanoma.
* Skin cancer represents approximately 2 to 4 percent of all cancers in Asians
* Skin cancer represents 4 to 5 percent of all cancers in Hispanics
* Skin cancer represents 1 to 2 percent of all cancers in blacks

### Problem
Analyzing cancers isn't an easy task. It requires intensive examining. More than 50% of lesions are confirmed through histopathology (histo), the ground truth for the rest of the cases is either follow-up examination (follow_up), expert consensus (consensus), or confirmation by in-vivo confocal microscopy (confocal). The lack of experts(radiologists) has always been a bottleneck. Now there are three things that we have to consider here:
* Given the fact that there are a limited number of experts, how can we make them more efficient? Can we aid them using state of the art machine learning techniques? If yes, how?
* Training of neural networks for automated diagnosis of pigmented skin lesions is hampered by the small size and lack of diversity of available dataset of dermatoscopic images. Labelled data in healthcare is another bottleneck. With the available limited data, how much can we do?

As Machine Learning Engineers, if we can't help the doctors and ultimately the society, then what are we good at? Healthcare is a complicated field and using Machine Learning in this field has its own *advantages* and *disadvantages*. There is a limit to which we can do things with ML in healthcare but whatever we can do, it matters!

### Dataset
The dataset is a part of [Kaggle Datasets](https://www.kaggle.com/kmader/skin-cancer-mnist-ham10000). A big thank you to **Kevin Mader** for uploading this dataset to kaggle.
The dataset comprises of a total of **10,000** images stored in two folders. The information about the data is stored in a dataframe which looks like this:

There are a total of **7 classes** of skin cancer in the dataset. After removing the duplicates we were left with around **~8K samples**. Checking the final distribution as shown below, we found out that the dataset is **highly imbalanced** which poses another challenge. For detailed notes, please check the **EDA notebook** in the notebooks directory

## Architecture
The ultimate aim of this project was to get a model that can run on mobile phones. In this regard, the only choices of architecture we had were: `Mobilenet_v1`, `MobileNet_v2`, `M-Nasnet`, and `Shufflenet`. I focused on the mobilenets family as they are readily available in the `keras model zoo`. I chose `MobileNetv2` as it much faster on mobile as compared to mobilenet_v1

The base network was used for feature extractor, excluding all the top layers that were responsible for classification. In mobilenets, the last layer for feature extraction is `global average pooling`, hence we discard all the layers beyond this point. The task of training the model was completed into two phases:
* **Transfer learning** where we added new layers on the top of the base network and trained the new layers while keeping the base network in the frozen state.
* **Fine-tuning** where we unfreeze some of the layers of the base network for improved gains.

Please refer to [this](./how_to_run.md) file for detailed instructions for preparing dataset, modelling, model conversion, etc.

## Demo
The final version of the android app works on `CPU` as well as on `GPU`. Check the demo below. There are two scenarios represented here. One where the app works perfectly and second where it doesn't.

**Works like a charm**

![Perfect Classification](https://raw.githubusercontent.com/AakashKumarNain/skin_cancer_detection/master/works.gif)

**Misclassifications**

![Misclassified examples](https://raw.githubusercontent.com/AakashKumarNain/skin_cancer_detection/master/fails.gif)

## Reports

Final **training loss**:   0.4029<br>
Final **validation loss**: 0.6417

Final **training categorical accuracy(top-1)**:   0.8627     
Final **validation categorical accuracy(top-1)**: 0.7897

Final **training categorical accuracy(top-2)**:   0.9612     
Final **validation categorical accuracy(top-2)**: 0.9123

**Confusion matrix**
![conf_mtx](https://raw.githubusercontent.com/AakashKumarNain/skin_cancer_detection/master/images/confusion_matrix.png)

**Classification Report**

precision    recall  f1-score   support

akiec       0.44      0.50      0.47        34
         bcc       0.62      0.80      0.70        49
         bkl       0.62      0.45      0.52       109
          df       0.33      0.18      0.24        11
         mel       0.60      0.45      0.52        93
          nv       0.86      0.94      0.90       540
        vasc       1.00      0.57      0.73        14

micro avg      0.78      0.78      0.78       850
    macro avg      0.64      0.56      0.58       850
    weighted avg   0.77      0.78      0.77       850

## Disclaimer!
This deep learning model has been trained on a very small dataset. Although the `top-2` accuracy of the model is pretty high, it is still not `adequate`. Though this app can be used to `aid` doctors to answer one question regarding a lesion **What are the most probable two/three cases?** This is one of the reasons I haven't published the app on the store. **We need to do better!**

skin_cancer_detection

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README