Deep-SAD-PyTorch - GitLite

KO | EN

gitlite — search

#hacktoberfest #react #ai #typescript #go #docker #macos #windows #awesome #cli #security #ios #mcp #openai

Deep-SAD-PyTorch

(★ 358)

A PyTorch implementation of Deep SAD, a deep Semi-supervised Anomaly Detection method.

파일 탐색기

최종 버전 다운로드 (.zip)

- .gitkeep
- .gitkeep
- fig1.png
- .gitkeep
- - __init__.py
  - base_dataset.py
  - base_net.py
  - base_trainer.py
  - odds_dataset.py
  - torchvision_dataset.py
- - __init__.py
  - isoforest.py
  - kde.py
  - ocsvm.py
  - SemiDGM.py
  - ssad.py
- - __init__.py
  - cifar10.py
  - fmnist.py
  - main.py
  - mnist.py
  - odds.py
  - preprocessing.py
- - __init__.py
  - cifar10_LeNet.py
  - dgm.py
  - fmnist_LeNet.py
  - main.py
  - mlp.py
  - mnist_LeNet.py
  - vae.py
- - __init__.py
  - ae_trainer.py
  - DeepSAD_trainer.py
  - SemiDGM_trainer.py
  - vae_trainer.py
  - variational.py
- - __init__.py
  - config.py
  - misc.py
- __init__.py
- baseline_isoforest.py
- baseline_kde.py
- baseline_ocsvm.py
- baseline_SemiDGM.py
- baseline_ssad.py
- DeepSAD.py
- main.py
LICENSE
README.md
requirements.txt

# 설치 가이드

1. 코드 내려받기

git clone https://github.com/lukasruff/Deep-SAD-PyTorch

깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.

cd Deep-SAD-PyTorch

방금 내려받은 프로젝트 폴더 안으로 이동합니다.

2. Python

쉬움 추천

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
Python 3 설치 시 'Add Python to PATH' 옵션을 꼭 체크하세요 (Windows).

pip install -r requirements.txt

requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.

✅ 에러 메시지 없이 실행되고 터미널에 안내 문구가 출력되면 정상입니다.

이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Deep SAD: A Method for Deep Semi-Supervised Anomaly Detection
This repository provides a [PyTorch](https://pytorch.org/) implementation of the *Deep SAD* method presented in our ICLR 2020 paper ”Deep Semi-Supervised Anomaly Detection”.

## Citation and Contact
You find a PDF of the Deep Semi-Supervised Anomaly Detection ICLR 2020 paper on arXiv 
[https://arxiv.org/abs/1906.02694](https://arxiv.org/abs/1906.02694).

If you find our work useful, please also cite the paper:
```
@InProceedings{ruff2020deep,
  title     = {Deep Semi-Supervised Anomaly Detection},
  author    = {Ruff, Lukas and Vandermeulen, Robert A. and G{\"o}rnitz, Nico and Binder, Alexander and M{\"u}ller, Emmanuel and M{\"u}ller, Klaus-Robert and Kloft, Marius},
  booktitle = {International Conference on Learning Representations},
  year      = {2020},
  url       = {https://openreview.net/forum?id=HkgH0TEYwH}
}
```

If you would like get in touch, just drop us an email to [contact@lukasruff.com](mailto:contact@lukasruff.com).

## Abstract
> > Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may have---in addition to a large set of unlabeled samples---access to a small pool of labeled samples, e.g. a subset verified by some domain expert as being normal or anomalous. Semi-supervised approaches to anomaly detection aim to utilize such labeled samples, but most proposed methods are limited to merely including labeled normal samples. Only a few methods take advantage of labeled anomalies, with existing deep approaches being domain-specific. In this work we present Deep SAD, an end-to-end deep methodology for general semi-supervised anomaly detection. We further introduce an information-theoretic framework for deep anomaly detection based on the idea that the entropy of the latent distribution for normal data should be lower than the entropy of the anomalous distribution, which can serve as a theoretical interpretation for our method. In extensive experiments on MNIST, Fashion-MNIST, and CIFAR-10, along with other anomaly detection benchmark datasets, we demonstrate that our method is on par or outperforms shallow, hybrid, and deep competitors, yielding appreciable performance improvements even when provided with only little labeled data.

## The need for semi-supervised anomaly detection

![fig1](https://raw.githubusercontent.com/lukasruff/Deep-SAD-PyTorch/master/imgs/fig1.png)

## Installation
This code is written in `Python 3.7` and requires the packages listed in `requirements.txt`.

Clone the repository to your machine and directory of choice:
```
git clone https://github.com/lukasruff/Deep-SAD-PyTorch.git
```

To run the code, we recommend setting up a virtual environment, e.g. using `virtualenv` or `conda`:

### `virtualenv`
```
# pip install virtualenv
cd <path-to-Deep-SAD-PyTorch-directory>
virtualenv myenv
source myenv/bin/activate
pip install -r requirements.txt
```

### `conda`
```
cd <path-to-Deep-SAD-PyTorch-directory>
conda create --name myenv
source activate myenv
while read requirement; do conda install -n myenv --yes $requirement; done < requirements.txt
```

## Running experiments
We have implemented the [`MNIST`](http://yann.lecun.com/exdb/mnist/), 
[`Fashion-MNIST`](https://research.zalando.com/welcome/mission/research-projects/fashion-mnist/), and 
[`CIFAR-10`](https://www.cs.toronto.edu/~kriz/cifar.html) datasets as well as the classic anomaly detection
benchmark datasets `arrhythmia`, `cardio`, `satellite`, `satimage-2`, `shuttle`, and `thyroid` from the 
Outlier Detection DataSets (ODDS) repository ([http://odds.cs.stonybrook.edu/](http://odds.cs.stonybrook.edu/))
as reported in the paper.

The implemented network architectures are as reported in the appendix of the paper.

### Deep SAD
You can run Deep SAD experiments using the `main.py` script.

Here's an example on `MNIST` with `0` considered to be the normal class and having 1% labeled (known) training samples 
from anomaly class `1` with a pollution ratio of 10% of the unlabeled training data (with unknown anomalies from all 
anomaly classes `1`-`9`):
```
cd <path-to-Deep-SAD-PyTorch-directory>

# activate virtual environment
source myenv/bin/activate  # or 'source activate myenv' for conda

# create folders for experimental output
mkdir log/DeepSAD
mkdir log/DeepSAD/mnist_test

# change to source directory
cd src

# run experiment
python main.py mnist mnist_LeNet ../log/DeepSAD/mnist_test ../data --ratio_known_outlier 0.01 --ratio_pollution 0.1 --lr 0.0001 --n_epochs 150 --lr_milestone 50 --batch_size 128 --weight_decay 0.5e-6 --pretrain True --ae_lr 0.0001 --ae_n_epochs 150 --ae_batch_size 128 --ae_weight_decay 0.5e-3 --normal_class 0 --known_outlier_class 1 --n_known_outlier_classes 1;
```
Have a look into `main.py` for all possible arguments and options.

### Baselines
We also provide an implementation of the following baselines via the respective `baseline_<method_name>.py` scripts:
OC-SVM (`ocsvm`), Isolation Forest (`isoforest`), Kernel Density Estimation (`kde`), kernel Semi-Supervised Anomaly 
Detection (`ssad`), and Semi-Supervised Deep Generative Model (`SemiDGM`).

Here's how to run SSAD for example on the same experimental setup as above:
```
cd <path-to-Deep-SAD-PyTorch-directory>

# activate virtual environment
source myenv/bin/activate  # or 'source activate myenv' for conda

# create folder for experimental output
mkdir log/ssad
mkdir log/ssad/mnist_test

# change to source directory
cd src

# run experiment
python baseline_ssad.py mnist ../log/ssad/mnist_test ../data --ratio_known_outlier 0.01 --ratio_pollution 0.1 --kernel rbf --kappa 1.0 --normal_class 0 --known_outlier_class 1 --n_known_outlier_classes 1;
```

The autoencoder is provided through Deep SAD pre-training using `--pretrain True` with `main.py`. 
To then run a hybrid approach using one of the classic methods on top of autoencoder features, simply point to the saved
autoencoder model using `--load_ae ../log/DeepSAD/mnist_test/model.tar` and set `--hybrid True`.

To run hybrid SSAD for example on the same experimental setup as above:
```
cd <path-to-Deep-SAD-PyTorch-directory>

# activate virtual environment
source myenv/bin/activate  # or 'source activate myenv' for conda

# create folder for experimental output
mkdir log/hybrid_ssad
mkdir log/hybrid_ssad/mnist_test

# change to source directory
cd src

# run experiment
python baseline_ssad.py mnist ../log/hybrid_ssad/mnist_test ../data --ratio_known_outlier 0.01 --ratio_pollution 0.1 --kernel rbf --kappa 1.0 --hybrid True --load_ae ../log/DeepSAD/mnist_test/model.tar --normal_class 0 --known_outlier_class 1 --n_known_outlier_classes 1;
```

## License
MIT