Gfarm file system is an
open-source
Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...
distributed file system
A clustered file system is a file system which is shared by being simultaneously mounted on multiple servers. There are several approaches to clustering, most of which do not employ a clustered file system (only direct attached storage for ...
, generally used for large-scale
cluster computing
A computer cluster is a set of computers that work together so that they can be viewed as a single system. Unlike grid computers, computer clusters have each node set to perform the same task, controlled and scheduled by software.
The comp ...
and wide-area
data sharing
Data sharing is the practice of making data used for scholarly research available to other investigators. Many funding agencies, institutions, and publication venues have policies regarding data sharing because transparency and openness are consid ...
, and provides features to manage replica location explicitly. The name is derived from the Grid Data Farm architecture it implements.
Grid Datafarm is a
petascale
Petascale computing refers to computing systems capable of calculating at least 1015 floating point operations per second (1 petaFLOPS). Petascale computing allowed faster processing of traditional supercomputer applications. The first system ...
data-intensive computing
Data-intensive computing is a class of parallel computing applications which use a data parallel approach to process large volumes of data typically terabytes or petabytes in size and typically referred to as big data. Computing applications ...
project initiated in Japan.
[Osamu Tatebe, Kohei Hiraga, Noriyuki Soda, "Gfarm Grid File System", New Generation Computing, Ohmsha, Ltd. and Springer, Vol. 28, No. 3, pp.257-275, 2010.] The project is a collaboration among High Energy Accelerator Research Organization (
KEK
, known as KEK, is a Japanese organization whose purpose is to operate the largest particle physics laboratory in Japan, situated in Tsukuba, Ibaraki prefecture. It was established in 1997. The term "KEK" is also used to refer to the laboratory ...
),
(AIST)
High Performance Computing Infrastructure project the University of Tokyo
, abbreviated as or UTokyo, is a public research university located in Bunkyō, Tokyo, Japan. Established in 1877, the university was the first Imperial University and is currently a Top Type university of the Top Global University Project by ...
,
Tokyo Institute of Technology
is a national research university located in Greater Tokyo Area, Japan. Tokyo Tech is the largest institution for higher education in Japan dedicated to science and technology, one of first five Designated National University and selected a ...
and
University of Tsukuba
is a public research university located in Tsukuba, Ibaraki, Japan. It is a top 10 Designated National University, and was ranked Type A by the Japanese government as part of the Top Global University Project.
The university has 28 colle ...
. The challenge involves construction of a Peta- to Exascale parallel filesystem exploiting local storage of PCs spread over the worldwide Grid.
See also
*
Distributed file system
A clustered file system is a file system which is shared by being simultaneously mounted on multiple servers. There are several approaches to clustering, most of which do not employ a clustered file system (only direct attached storage for ...
*
List of file systems, the distributed parallel fault-tolerant file system section
References
External links
Gfarm file system Home PageOSS Tsukuba at GitHub
Distributed file systems
Distributed file systems supported by the Linux kernel
Network file systems
{{compu-storage-stub