Network File System (protocol)

Network File System (NFS) is a distributed file system protocol originally developed by Sun Microsystems (Sun) in 1984, allowing a user on a client computer to access files over a computer network much like local storage is accessed. NFS, like many other protocols, builds on the Open Network Computing Remote Procedure Call (ONC RPC) system. NFS is an open IETF standard defined in a Request for Comments (RFC), allowing anyone to implement the protocol.

Versions and variations

Sun used version 1 only for in-house experimental purposes. When the development team added substantial changes to NFS version 1 and released it outside of Sun, they decided to release the new version as v2, so that version interoperation and RPC version fallback could be tested.

NFSv2

Version 2 of the protocol (defined in , March 1989) originally operated only over User Datagram Protocol (UDP). Its designers meant to keep the server side stateless, with locking (for example) implemented outside of the core protocol. People involved in the creation of NFS version 2 include Russel Sandberg, Bob Lyon, Bill Joy, Steve Kleiman, and others.

The Virtual File System interface allows a modular implementation, reflected in a simple protocol. By February 1986, implementations were demonstrated for operating systems such as System V release 2, DOS, and VAX/VMS using Eunice.
NFSv2 only allows the first 2 GB of a file to be read due to 32-bit limitations.

NFSv3

Version 3 (, June 1995) added:
* support for 64-bit file sizes and offsets, to handle files larger than 2 gigabytes (GB);
* support for asynchronous writes on the server, to improve write performance;
* additional file attributes in many replies, to avoid the need to re-fetch them;
* a READDIRPLUS operation, to get file handles and attributes along with file names when scanning a directory;
* assorted other improvements.

The first NFS Version 3 proposal within Sun Microsystems was created not long after the release of NFS Version 2. The principal motivation was an attempt to mitigate the performance issue of the synchronous write operation in NFS Version 2. By July 1992, implementation practice had solved many shortcomings of NFS Version 2, leaving only lack of large file support (64-bit file sizes and offsets) a pressing issue. At the time of introduction of Version 3, vendor support for TCP as a transport-layer protocol began increasing. While several vendors had already added support for NFS Version 2 with TCP as a transport, Sun Microsystems added support for TCP as a transport for NFS at the same time it added support for Version 3. Using TCP as a transport made using NFS over a WAN more feasible, and allowed the use of larger read and write transfer sizes beyond the 8 KB limit imposed by User Datagram Protocol.

YANFS/WebNFS

YANFS (Yet Another NFS), formerly WebNFS, is an extension to NFSv2 and NFSv3 allowing it to function behind restrictive firewalls without the complexity of Portmap and MOUNT protocols. YANFS/WebNFS has a fixed TCP/UDP port number (2049), and instead of requiring the client to contact the MOUNT RPC service to determine the initial filehandle of every filesystem, it introduced the concept of a ''public filehandle'' (null for NFSv2, zero-length for NFSv3) which could be used as the starting point. Both of those changes were later incorporated into NFSv4. YANFS's post-WebNFS development has also included server-side integration.

NFSv4

Version 4 (, December 2000; revised in , April 2003 and again in , March 2015), influenced by Andrew File System (AFS) and Server Message Block (SMB), includes performance improvements, mandates strong security, and introduces a stateful protocol. Version 4 became the first version developed with the Internet Engineering Task Force (IETF) after Sun Microsystems handed over the development of the NFS protocols.

NFS version 4.1 (, January 2010; revised in , August 2020) aims to provide protocol support to take advantage of clustered server deployments including the ability to provide scalable parallel access to files distributed among multiple servers (pNFS extension). Version 4.1 includes Session trunking mechanism (Also known as NFS Multipathing) and is available in some enterprise solutions as VMware ESXi.

NFS version 4.2 () was published in November 2016 with new features including: server-side clone and copy, application I/O advise, sparse files, space reservation, application data block (ADB), labeled NFS with sec_label that accommodates any MAC security system, and two new operations for pNFS (LAYOUTERROR and LAYOUTSTATS).

One big advantage of NFSv4 over its predecessors is that only one UDP or TCP port, 2049, is used to run the service, which simplifies using the protocol across firewalls.

Other extensions

WebNFS, an extension to Version 2 and Version 3, allows NFS to integrate more easily into Web-browsers and to enable operation through firewalls. In 2007 Sun Microsystems open-sourced their client-side WebNFS implementation.

Various side-band protocols have become associated with NFS. Note:
* the byte-range advisory Network Lock Manager (NLM) protocol (added to support UNIX System V file locking APIs)
* the remote quota-reporting (RQUOTAD) protocol, which allows NFS users to view their data-storage quotas on NFS servers
* NFS over RDMA, an adaptation of NFS that uses remote direct memory access (RDMA) as a transport
* NFS-Ganesha, an NFS server, running in user-space and supporting various file systems like GPFS/Spectrum Scale, CephFS via respective FSAL (File System Abstraction Layer) modules. The CephFS FSAL is supported using libcephfs

*Trusted NFS (TNFS)

Platforms

NFS is available on:

* Unix-like operating systems ( Solaris, AIX, HP-UX, FreeBSD, and Linux distros)
* AmigaOS
* ArcaOS
* Haiku
* IBM i, although the default networking protocol is OS/400 File Server (QFileSvr.400)
* macOS, although the default networking protocol is Apple Filing Protocol (AFP)
* Microsoft Windows, although the default networking protocol is Server Message Block (SMB)
* MS-DOS
* Novell NetWare, although the default networking protocol is NetWare Core Protocol (NCP)
* OpenVMS
* OS/2
* RISC OS

Protocol development

During the development of the ONC protocol (called SunRPC at the time), only Apollo's Network Computing System (NCS) offered comparable functionality. Two competing groups developed over fundamental differences in the two remote procedure call systems. Arguments focused on the method for data-encoding — ONC's External Data Representation (XDR) always rendered integers in big-endian order, even if both peers of the connection had little-endian machine-architectures, whereas NCS's method attempted to avoid byte-swap whenever two peers shared a common endianness in their machine-architectures. An industry-group called the Network Computing Forum formed (March 1987) in an (ultimately unsuccessful) attempt to reconcile the two network-computing environments.

In 1987, Sun and AT&T announced they would jointly develop AT&T's UNIX System V Release 4. This caused many of AT&T's other licensees of UNIX System to become concerned that this would put Sun in an advantaged position, and ultimately led to Digital Equipment, HP, IBM, and others forming the Open Software Foundation (OSF) in 1988. Ironically, Sun and AT&T had formerly competed over Sun's NFS versus AT&T's Remote File System (RFS), and the quick adoption of NFS over RFS by Digital Equipment, HP, IBM, and many other computer vendors tipped the majority of users in favor of NFS.
NFS interoperability was aided by events called "Connectathons" starting in 1986 that allowed vendor-neutral testing of implementations with each other. OSF adopted the Distributed Computing Environment (DCE) and the DCE Distributed File System (DFS) over Sun/ONC RPC and NFS. DFS used DCE as the RPC, and DFS derived from the Andrew File System (AFS); DCE itself derived from a suite of technologies, including Apollo's NCS and Kerberos.

1990s

Sun Microsystems and the Internet Society (ISOC) reached an agreement to cede "change control" of ONC RPC so that the ISOC's engineering-standards body, the Internet Engineering Task Force (IETF), could publish standards documents (RFCs) related to ONC RPC protocols and could extend ONC RPC. OSF attempted to make DCE RPC an IETF standard, but ultimately proved unwilling to give up change control. Later, the IETF chose to extend ONC RPC by adding a new authentication flavor based on Generic Security Services Application Program Interface (GSSAPI), RPCSEC GSS, to meet IETF requirements that protocol standards have adequate security.

Later, Sun and ISOC reached a similar agreement to give ISOC change control over NFS, although writing the contract carefully to exclude NFS version 2 and version 3. Instead, ISOC gained the right to add new versions to the NFS protocol, which resulted in IETF specifying NFS version 4 in 2003.

2000s

By the 21st century, neither DFS nor AFS had achieved any major commercial success as compared to SMB or NFS. IBM, which had formerly acquired the primary commercial vendor of DFS and AFS, Transarc, donated most of the AFS source code to the free software community in 2000. The OpenAFS project lives on. In early 2005, IBM announced end of sales for AFS and DFS.

In January, 2010, Panasas proposed an NFSv4.1 based on their ''Parallel NFS'' (pNFS) technology claiming to improve data-access parallelism capability. The NFSv4.1 protocol defines a method of separating the filesystem meta-data from file data location; it goes beyond the simple name/data separation by striping the data amongst a set of data servers. This differs from the traditional NFS server which holds the names of files and their data under the single umbrella of the server. Some products are multi-node NFS servers, but the participation of the client in separation of meta-data and data is limited.

The NFSv4.1 pNFS server is a set of server resources or components; these are assumed to be controlled by the meta-data server.

The pNFS client still accesses one meta-data server for traversal or interaction with the namespace; when the client moves data to and from the server it may directly interact with the set of data servers belonging to the pNFS server collection. The NFSv4.1 client can be enabled to be a direct participant in the exact location of file data and to avoid solitary interaction with one NFS server when moving data.

In addition to pNFS, NFSv4.1 provides:

* Sessions
* Directory Delegation and Notifications
* Multi-server Namespace
* access control lists and discretionary access control
* Retention Attributions
* SECINFO_NO_NAME

See also

* 9P (protocol)
* Alluxio
* BeeGFS
* CacheFS – a caching mechanism for Linux NFS clients
* Hadoop Distributed File System (HDFS)
* Kerberos (protocol)
* Network Information Service
* Remote File System
* Root squash
* Secure Shell Filesystem
* Shared resource
* TCP Wrapper

References

External links

* RFCs:
** – NFS Version 2 Protocol Specification
** – Sun/ISOC ONC RPC Change Control Agreement
** – NFS Version 3 Protocol Specification
** – WebNFS Client Specification
** – WebNFS Server Specification
** – RPCSEC_GSS Specification
** – NFS URL Scheme Specification
** – Sun/ISOC NFS Change Control Agreement
** – NFS Version 4 Protocol Specification (obsoleted by RFC 3530)
** – NFS Version 4 Protocol Specification (obsoleted by RFC 7530 and RFC 7531)
** – RPCSEC_GSS Version 2
** – NFS Version 4.1 Protocol Specification (obsoleted by RFC 8881)
** – NFS Version 4.1 Protocol XDR Description
** – Parallel NFS - Block/Volume Layout Specification
** – Parallel NFS - Object-Based Operations Specification
** – NFS Version 4 Protocol Specification
** – NFS Version 4 Protocol XDR Description
** – NFS Version 4.2 Protocol Specification
** – NFS Version 4.2 Protocol XDR Description
** – Parallel NFS - SCSI Layout Specification
** – Umask attribute extension for NFS Version 4.2
** – Xattrs extension for NFSv4
** – Parallel NFS - Flexible File Layout Specification
** – NFS Version 4.1 Protocol Specification
* Open Group Technical Standards:
*
Protocols for Interworking: XNFS, Version 3W
– Open Group specification of NFS2, NFS3 and side-band protocols MNT, NSM and NLM for file locking which are not covered by RFC documents
*
Protocols for X/Open PC Interworking: (PC)NFS
– Open Group specification of NFS2 and side-band protocols MNT, NLM and PCNFSD which are not covered by RFC documents
* Various resources:
*

*
Linux NFS Overview, FAQ and HOWTO Documents
*
NFS operation explained with sequence diagrams



by Mike Eisler, October 27, 2006

{{DEFAULTSORT:Network File System (Protocol)
Internet protocols
Network file systems
Internet Protocol based network software
Unix network-related software
Application layer protocols
Network file transfer protocols
Distributed file systems
Network booting
1984 software