xERM

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

(★ 33)

[AAAI 2022 Oral] This is a Pytorch implementation of the AAAI 2022 paper "Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification"

xERM 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# [AAAI22 Oral] Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification

We point out the overlooked unbiasedness in long-tailed classification: models should perform well on both imbalanced and balanced test distributions.
To tackle this challenge, we propose a novel training paradigm called [Cross-Domain Empirical Risk Minimization (xERM)](https://arxiv.org/pdf/2112.14380.pdf).
xERM consists of two ERM terms, which are the cross-entropy losses with different supervisions: 
one is the ground-truth label from the seen imbalanced domain, and the other is the prediction of a balanced model. 
The imbalanced domain empirical risk encourages the model to learn from the ground-truth annotations from the imbalanced distribution, 
which favors the head classes. The balanced domain empirical risk encourages the model to learn from the prediction of a balanced model, 
which imagines a balanced distribution and prefers the tail classes. These two risks are weighted to take advantage of both, 
i.e., protect the model training from being neither too “head biased” nor too “tail biased”, and can achieve the unbiasedness.

The codes are organized into three folders:

1. [xERM.PC.public](xERM.PC.public) uses Post-Compensated Softmax ([PC](https://arxiv.org/abs/2012.00321)) as balanced model to implement xERM.
2. [xERM.TDE.public](xERM.TDE.public) uses Total Direct Effect ([TDE](https://arxiv.org/abs/2009.12991)) as balanced model to implement xERM.
3. [xERM.RIDE.public](xERM.RIDE.public) uses [RIDE](https://arxiv.org/abs/2010.01809) as balanced model to implement xERM.

## Citation

If you find our paper or this project helps your research, please kindly consider citing our paper in your publication.

```
@inproceedings{beierxERM,
  title={Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification},
  author={Zhu, Beier and Niu, Yulei and Hua, Xian-Sheng and Zhang, Hanwang},
  booktitle={AAAI Conference on Artificial Intelligence},
  year={2022}
}
```

## Update Logs
- 28 Dec 2021, Release train and eval code of xERM-PC on CIFAR100-LT and ImageNet-LT Dataset. 
- 30 Dec 2021, Release train and eval code of xERM-TDE on Places365-LT Dataset (ResNet50 Backbone). 
- 31 Dec 2021, Release train and eval code of xERM-TDE on Places365-LT Dataset (ResNet152 Backbone). 
- 23 Jan 2022, Release train and eval code of xERM-RIDE-PC-{2,3} on CIFAR100-LT-IB-100 Dataset.

xERM

xERM 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

xERM

xERM 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README