The Collective Tuning Initiative is a community-driven initiative started by
Grigori Fursin
Grigori Fursin is a British computer scientist, vice president of MLOps at OctoML and the president of the non-profit CTuning foundation. His research group created open-source machine learning based self-optimizing compiler, MILEPOST GCC, cons ...
to develop free collaborative
open-source
Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...
research tools with unified
API for code and architecture characterization, optimization and co-design. This enables the sharing of benchmarks, data sets and optimization cases from the community in the
open optimization repository through unified web services to predict better optimizations or architecture designs (provided there is enough information collected in the repository from multiple users).
Grigori Fursin
Grigori Fursin is a British computer scientist, vice president of MLOps at OctoML and the president of the non-profit CTuning foundation. His research group created open-source machine learning based self-optimizing compiler, MILEPOST GCC, cons ...
. Collective Tuning Initiative: automating and accelerating development and optimization of computing systems. Proceedings of the GCC Summit'09, Montreal, Canada, June 2009
link
[''Rethinking code optimization for mobile and multicore'', InfoWorld, July 2009]
link
Using common research-and-development tools should help to improve the quality and reproducibility of research into code, architecture design and optimization, encouraging innovation in this area. This approach helped establish Artifact Evaluation at several
ACM-sponsored conferences to encourage sharing of artifacts and validation of experimental results from accepted papers.
The tools and repository include:
* ''
Collective Optimization Database'': Open repository to share optimization cases from the community, provide web services and
plugins
Plug-in, plug in or plugin may refer to:
* Plug-in (computing) is a software component that adds a specific feature to an existing computer program.
** Audio plug-in, adds audio signal processing features
** Photoshop plugin, a piece of software t ...
to analyze collective optimization data and predict program optimizations based on statistical and machine-learning techniques and improve the quality and reproducibility of the compiler (and architecture research)
* ''Online machine learning-based program optimization predictor'': Suggests optimization-improving factors such as execution time, code size and compilation time, based on similarities between programs (program features)
* ''Continuous Collective Compilation Framework'': Automates and distribute iterative feedback-directed exploration of large optimization spaces by multiple users
* ''
Interactive Compilation Interface
The Interactive Compilation Interface (ICI) is a plugin system with a high-level compiler-independent and low-level compiler-dependent API to transform current black-box compilers into collaborative modular interactive toolsets. It was developed b ...
'': Opens and transforms production compilers into stable interactive research tool sets using an event-driven plugin system to avoid the development of new research compilers from scratch
* ''Collective benchmark with multiple data sets'': Enables realistic benchmarking and research on iterative compilation and run-time adaptation.
* ''Universal Adaptation Framework'': Enables run-time adaptation and optimization of statically-compiled programs for heterogeneous, multi-core architectures.
A new version of these open-source tools to support collaborative and reproducible experimentation (
Collective Knowledge) was released in 2015.
Collective Optimization Database
The Collective Optimization Database is an open repository to enable sharing of
benchmarks, data sets and optimization cases from the community, provide
web services and
plugins
Plug-in, plug in or plugin may refer to:
* Plug-in (computing) is a software component that adds a specific feature to an existing computer program.
** Audio plug-in, adds audio signal processing features
** Photoshop plugin, a piece of software t ...
to analyze optimization data and predict program transformations or better hardware designs for multi-objective optimizations based on statistical and
machine learning techniques provided there is enough information collected in the repository from multiple users.
Functionality
The Collective Optimization Database is also intended to improve the quality and reproducibility of the research on
code
In communications and information processing, code is a system of rules to convert information—such as a letter, word, sound, image, or gesture—into another form, sometimes shortened or secret, for communication through a communication ...
and architecture design, characterization and optimization. It includes an online machine learning-based program optimization predictor
[ Collective Knowledge based portal for collaborative benchmarking and optimization of emerging workloads a]
cknowledge.io
/ref> that can suggest profitable optimizations to improve program execution time, code size, or compilation time, based on similarities between programs. The Collective Optimization Database is an important part of the Collective Tuning Initiativeopen-source
Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...
R&D tools for collaborative and reproducible computing systems research.
References
{{Reflist
External links
Collective Optimization Database
at ctuning.org
Collective Tuning Center
Collective Tuning Tools
Collective Tuning Repository
Software optimization
Types of databases
Online databases