The Collective Tuning Initiative is a community-driven initiative started by

Grigori Fursin Grigori Fursin is a British computer scientist, president of the non-profit CTuning foundation, founding member of MLCommons, and co-chair of the MLCommons Task Force on Automation and Reproducibility. His research group created open-source mach ...

to develop free and

open-source Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use and view the source code, design documents, or content of the product. The open source model is a decentrali ...

research tools with a unified

API An application programming interface (API) is a connection between computers or between computer programs. It is a type of software interface, offering a service to other pieces of software. A document or standard that describes how to build ...

for collaborative characterization, optimization and co-design of computer systems. They enable sharing of benchmarks, data sets and optimization cases from the community in the Collective Optimization Database through unified web services to predict better optimizations or architecture designs (provided there is enough information collected in the repository from multiple users).

. Collective Tuning Initiative: automating and accelerating development and optimization of computing systems. Proceedings of the GCC Summit'09, Montreal, Canada, June 2009
link
''Rethinking code optimization for mobile and multicore'', InfoWorld, July 2009
link
Using common research-and-development tools should help to improve the quality and reproducibility of computer systems' research and development and accelerate innovation in this area. This approach helped establish Reproducibility Initiatives and Artifact Evaluation at several ACM-sponsored conferences to encourage sharing of artifacts and validation of experimental results from accepted papers. The tools and repository include: * ''Collective Optimization Database'': an open repository to share optimization cases from the community, provide web services and plugins to analyze collected performance numbers and predict compiler optimizations to speed up applications based on statistical and machine-learning techniques * ''Machine learning-based program optimization predictor'': web-service that suggests optimization-improving factors such as execution time, code size and compilation time, based on similarities between programs (program features) * ''Continuous Collective Compilation Framework'': automates and distributes exploration of large optimization spaces and compiler auto-tuning across multiple users * ''

Interactive Compilation Interface The Interactive Compilation Interface (ICI) is a plugin system with a high-level compiler-independent and low-level compiler-dependent API to transform production compilers into interactive research toolsets. It was developed by Grigori Fursin d ...

'': converts production compilers into interactive research toolsets using an event-driven plugin system to avoid the development of new research compilers from scratch * ''Collective benchmark with multiple data sets'': enables realistic benchmarking and research on iterative compilation and run-time adaptation. * ''Universal Adaptation Framework'': Enables run-time adaptation and optimization of statically-compiled programs for heterogeneous, multi-core computer architectures. All above tools became a part of the ( Collective Knowledge framework) released in 2015.

Collective Optimization Database

The Collective Optimization Database is an open repository to enable sharing of

benchmark Benchmark may refer to: Business and economics * Benchmarking, evaluating performance within organizations * Benchmark price * Benchmark (crude oil), oil-specific practices Science and technology * Experimental benchmarking, the act of defining a ...

s, data sets and optimization cases from the community, provide

web service A web service (WS) is either: * a service offered by an electronic device to another electronic device, communicating with each other via the Internet, or * a server running on a computer device, listening for requests at a particular port over a n ...

s and plugins to analyze optimization data and predict program transformations or better hardware designs for multi-objective optimizations based on statistical and

machine learning Machine learning (ML) is a field of study in artificial intelligence concerned with the development and study of Computational statistics, statistical algorithms that can learn from data and generalise to unseen data, and thus perform Task ( ...

techniques provided there is enough information collected in the repository from multiple users.

Functionality

The Collective Optimization Database is also intended to improve the quality and reproducibility of the research on

code In communications and information processing, code is a system of rules to convert information—such as a letter, word, sound, image, or gesture—into another form, sometimes shortened or secret, for communication through a communicati ...

and architecture design, characterization and optimization. It includes an online machine learning-based program optimization predictor Collective Knowledge based portal for collaborative benchmarking and optimization of emerging workloads a
cknowledge.io
/ref> that can suggest profitable optimizations to improve program execution time, code size, or compilation time, based on similarities between programs. The Collective Optimization Database is an important part of the Collective Tuning Initiative which is developing

R&D tools for collaborative and reproducible computing systems research.

References

{{Reflist

External links

Collective Tuning Center

Collective Tuning Tools
Software optimization Types of databases Online databases