icse2020

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #golang #machine-learning #deep-learning #awesome #vue #awesome-list #security #mcp #openai #open-source

(★ 10)

This is the project repository for the paper "Understanding the Automated Parameter Optimization on Transfer Learning for Cross-Project Defect Prediction: An Empirical Study"

icse2020 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## Background
Data-driven defect prediction has become increasingly important in software engineering process. Since it is not uncommon that data from a software project is insufficient for training a reliable defect prediction model, transfer learning that borrows data/knowledge from other projects to facilitate the model building at the current project, namely Cross-Project Defect Prediction (CPDP), is naturally plausible. Most CPDP techniques involve two major steps, i.e., transfer learning and classification, each of which has at least one parameter to be tuned to achieve their optimal performance. This practice fits well with the purpose of automated parameters optimization. However, there is a lack of thorough understanding about what are the impacts of automated parameters optimization on various CPDP techniques.

Bearing this consideration in mind, this paper presents the first empirical study that looks into such impacts on 62 CPDP techniques, 13 of which are chosen from the existing CPDP literature while the other 49 ones have not been explored before. We build defect prediction models over 20 real-world software projects that are of different scales and characteristics.

Our major findings are:
> Automated parameter optimization substantially improves the defect prediction performance of 77% CPDP techniques with a manageable computational cost. Thus more efforts on this aspect are required in future CPDP studies.

> Transfer learning is of ultimate importance in CPDP. Given a tight computational budget, it is more cost-effective to focus on optimizing the parameter configuration of transfer learning algorithms

> The research on CPDP is far from mature where it is ‘not difficult’ to find a better alternative by making a combination of existing transfer learning and classification techniques.

## Hyperopt for automated parameter optimisation

Hyperopt is a Python library that provides algorithms and software infrastructure to optimise hyperparameters of machine learning algorithms. In this project, we use Hyperopt as the optimiser (its basic optimisation driver is hyperopt.fmin) to optimise the parameter configurations of the CPDP techniques. The architecture of our automated parameter optimisation on CPDP model by using Hyperopt is as follows.

![](https://raw.githubusercontent.com/COLA-Laboratory/icse2020/master/framework.png)

## Datasets

+ AEEEM
+ JURECZKO (12 selected projects)
+ ReLink

## Installation

- `Python version should be 3.6` 
- Install thrid-party packages (In `Anacaonda` environment)
  - `pip install hyperopt`
  - `pip install scikit-learn==0.20.4`
  - `pip install iteration_utilities`
  - `conda install tqdm`
  - `pip install imbalanced-learn==0.4  `
  - `pip install func_timeout`

## A quick start to run experiments

> Please follow `INSTALL.md` before starting to run the code.

+ Run `code\optADPT.py` to evaluate the impact of parameter optimization on the transfer learning in CPDP.
+ Run `code\optCLF.py` to evaluate the impact of parameter optimization on the classifier in CPDP.
+ Run `code\optALL.py` to evaluate the impact of parameter optimization on both transfer learning and classifier in CPDP simultaneously.
+ Run `code\optSEQ.py` to evaluate the impact of parameter optimization in a sequential manner, i.e., optimising the parameters of transfer learning before those of the classifier.

## Further developments

> This code is flexible to any further development.
1. If you want to investigate more transfer learning algorithms, please amend `code\Algorithms\domainAdaptation.py`.
2. If you want to investigate more classifiers, please amend `code\Algorithms\Classifier.py`
3. If you want to adapt the calling format, please amend `code\Alogrithms\Framework.py`.

## Contact

If you meet any problems, please feel free to contact us.
+ Ke Li (k.li@exeter.ac.uk)
+ Zilin Xiang (zilin.xiang@hotmail.com)

icse2020

icse2020 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

icse2020

icse2020 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README