Benchmarks

Benchmarks and DatasetCode Examples

Avalanche offers significant support for defining your own benchmarks (instantiation of one scenario with one or multiple datasets) or using "classic" benchmarks already consolidate in the literature.

You can find examples related to the benchmarks here:

• Classic MNIST benchmarks: in this simple example we show all the different ways you can use MNIST with Avalanche.

• __CLEAR benchmark: training and evaluating on CLEAR benchmark (RGB images)

• CLEAR Linear benchmark: Training and evaluating on CLEAR benchmark (with pre-trained features)

• Detection Benchmark: about the utils you can use create a detection benchmark.

• Endless CL Simulator: this example makes use of the Endless-Continual-Learning-Simulator's derived dataset scenario.

• Simple CTRL benchmark: In this example we show a simple way to use the ctrl benchmark.

• Hugging Face integration: how to use Hugging Face models and datasets within Avalanche for Natural Language Processing.