CTrLBenchmark - GitLite

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #golang #rust #docker #nodejs #macos #cli #pytorch #mcp #openai #open-source

CTrLBenchmark

(★ 117)

Benchmark for Lifelong learning research

File Explorer

Download Latest Version (.zip)

- - __init__.py
  - tree.py
  - utils.py
- - __init__.py
  - concept.py
  - concept_tree.py
- - __init__.py
  - DTD.py
  - image_dataset_tree.py
  - md_tree.py
  - taxonomies.py
- - __init__.py
  - attributes_strategy.py
  - data_strategy.py
  - incremental_strategy.py
  - input_domain_strategy.py
  - label_permutation_strategy.py
  - mixed_strategy.py
  - random_mutation_strategy.py
  - split_strategy.py
  - task_creation_strategy.py
- - __init__.py
  - default_datasets.yaml
  - s_in.yaml
  - s_long.yaml
  - s_minus.yaml
  - s_out.yaml
  - s_pl.yaml
  - s_plus.yaml
- - __init__.py
  - task.py
  - task_generator.py
- - __init__.py
  - identity_transformation.py
  - img_rotations.py
  - noisy_nn_transformation.py
  - rainbow_transformation.py
  - randperm_transformation.py
  - transformation.py
  - transformation_pool.py
  - transformation_tree.py
  - utils.py
- __init__.py
- - conf.py
  - index.rst
  - usage.rst
- Makefile
- __init__.py
- test_ctrl.py
.gitignore
CODE_OF_CONDUCT.md
CONTRIBUTING.md
LICENSE
MANIFEST.in
README.md
setup.py

# Installation Guide

1. Get the code

git clone https://github.com/facebookresearch/CTrLBenchmark

Downloads the entire project code from GitHub to your computer.

cd CTrLBenchmark

Moves into the project folder you just downloaded.

2. Python

Easy Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.

pip install .

Installs the package published on PyPI directly — no need to clone the source.

python <실행할 파일명>.py # README에서 정확한 실행 파일명을 확인하세요

Runs the Python script (or module).

✅ If it runs without errors and prints output in the terminal, it worked.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Continual Transfer Learning Benchmark
The CTrL benchmark aims to help research by studying the transfer behaviour of different models in the Lifelong Learning context.

For a quick presentation of the benchmark, please check out [this blog post](https://ai.facebook.com/blog/ctrl-and-mntdp-a-new-open-source-benchmark-and-model-for-continual-learning/).

For more details, the paper is available on [arxiv](https://arxiv.org/abs/2012.12631).

## Creating a Stream:

The `TaskGenerator` class is at the center of the implementation of the CTrL Benchmark. 
It gives access to a high-level API allowing to seamlessly generate a wide variety of streams with a loose coupling between the different components such as the underlying dataset(s), the strategy to generate the tasks (split, incremental, mixture of datasets, ...) and the processing to apply to each task.

The 3 main components of a `Task Generator` are:
- A pool of concepts to select from to generate the tasks. It can be a few classes, a full dataset or even a mixture of datasets.
- A pool of transformation that can be modified or combined to apply specific processing to the data for each task.
- A Strategy, describing how to combine the conecpts and trasnformation over time to generate an actual stream.

Each of these components can be created by hand or using our automatic `TaskGenerator` creation tool using yaml configuration files.

For examples simply executing
```python
import ctrl
task_gen = ctrl.get_stream('s_minus')
```
will return the corresponding task generator that be used either directy to generate tasks on the fly:
```python
t1 = task_gen.add_task()
t2 = task_gen.add_task()
t3 = task_gen.add_task()
...
```

or as an iterator:
```python
for t in task_gen:
    print(t)
```

### Available streams:
In the current version, only the streams of the CTrL benchmark are directly available, they can be obtained by passing the following `name` arguments in `ctrl.get_stream`:
- S<sup>+</sup>: `"s_plus"`
- S<sup>-</sup>: `"s_minus"`
- S<sup>in</sup>: `"s_in"`
- S<sup>out</sup>: `"s_out"`
- S<sup>pl</sup>: `"s_pl"`
- S<sup>long</sup>: `"s_long"`

More documentation and details on the internal components will be progressively added.

See the CONTRIBUTING file for how to help out.

# LICENSE
See the LICENSE file.