History of web syndication technology
   HOME

TheInfoList



OR:

Web syndication technologies were preceded by metadata standards such as the
Meta Content Framework Meta Content Framework (MCF) is a specification of a content format for structuring metadata about web sites and other data. History MCF was developed by Ramanathan V. Guha at Apple Computer's Advanced Technology Group between 1995 and 1997. Roo ...
(MCF) and the Resource Description Framework (RDF), as well as by ' push' specifications such as Channel Definition Format (CDF). Early web syndication standards included
Information and Content Exchange Information and Content Exchange (ICE) is an XML-based protocol used for content syndication via the Internet. By using XML both sender and receiver have an agreed-upon language in which to communicate. Using a client–server architecture, ICE de ...
(ICE) and RSS. More recent specifications include
Atom Every atom is composed of a nucleus and one or more electrons bound to the nucleus. The nucleus is made of one or more protons and a number of neutrons. Only the most common variety of hydrogen has no neutrons. Every solid, liquid, gas, ...
and GData.


Predecessors

Web syndication specifications were preceded by several formats in push and metadata technologies, few of which achieved widespread popularity, as many, such as Backweb and
Pointcast PointCast was a dot-com company founded in 1992 by Christopher R. Hassett in Sunnyvale, California. PointCast Network The company's initial product amounted to a screensaver that displayed news and other information, delivered live over the Inter ...
, were intended to work only with a single service. Between 1995 and 1997, Ramanathan V. Guha and others at Apple Computer's Advanced Technology Group developed the
Meta Content Framework Meta Content Framework (MCF) is a specification of a content format for structuring metadata about web sites and other data. History MCF was developed by Ramanathan V. Guha at Apple Computer's Advanced Technology Group between 1995 and 1997. Roo ...
(MCF). MCF was a specification for structuring metadata information about web sites and other data, implemented in HotSauce, a 3D flythrough visualizer for the web. When the research project was discontinued in 1997, Guha left Apple for Netscape. Guha and the
XML Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable ...
co-creator
Tim Bray Timothy William Bray (born June 21, 1955) is a Canadian software developer, environmentalist, political activist and one of the co-authors of the original XML specification. He worked for Amazon Web Services from December 2014 until May 2020 w ...
extended MCF into an XML application that Netscape submitted to the
World Wide Web Consortium The World Wide Web Consortium (W3C) is the main international standards organization for the World Wide Web. Founded in 1994 and led by Tim Berners-Lee, the consortium is made up of member organizations that maintain full-time staff working ...
(W3C) as a proposed web standard in June 1997. This submission contributed towards the emergence of the Resource Description Framework (RDF). In March 1997,
Microsoft Microsoft Corporation is an American multinational technology corporation producing computer software, consumer electronics, personal computers, and related services headquartered at the Microsoft Redmond campus located in Redmond, Washin ...
submitted a detailed specification for the 'push' technology Channel Definition Format (CDF) to the W3C. This format was designed for the Active Channel feature of
Internet Explorer 4.0 Microsoft Internet Explorer 4 (IE4) is a graphical web browser that Microsoft unveiled in Spring of 1997, and released in September 1997, primarily for Microsoft Windows, but also with versions available for the classic Mac OS, Solaris (operating ...
. CDF never became popular, perhaps because of the extensive resources it required at a time when people were mostly on dial-up. Backweb and Pointcast were geared towards news, much like a personal application programming interface (API) feed. Backweb later morphed into providing software updates, a precursor to the push update features used by various companies now. In September 1997, Netscape previewed a new, competing technology named "Aurora," based on RDF, a metadata model whose first public working draft would be posted the next month by a W3C working group that included representatives of many companies, including R.V. Guha of Netscape. In December 1997,
Dave Winer Dave Winer (born May 2, 1955, in Queens, New York City) is an American software developer, entrepreneur, and writer who resides in New York City. Winer is noted for his contributions to outliners, scripting, content management, and web servi ...
designed his own XML format for use on his
Scripting News Dave Winer (born May 2, 1955, in Queens, New York City) is an American software developer, entrepreneur, and writer who resides in New York City. Winer is noted for his contributions to outliners, scripting, content management, and web servic ...
weblog.


Early web syndication: ICE and RSS

The first standard created specifically for web syndication was
Information and Content Exchange Information and Content Exchange (ICE) is an XML-based protocol used for content syndication via the Internet. By using XML both sender and receiver have an agreed-upon language in which to communicate. Using a client–server architecture, ICE de ...
(ICE), which was proposed by Firefly Networks and
Vignette Vignette may refer to: * Vignette (entertainment), a sketch in a sketch comedy * Vignette (graphic design), decorative designs in books (originally in the form of leaves and vines) to separate sections or chapters * Vignette (literature), short, i ...
in January 1998. The ICE Authoring Group included
Microsoft Microsoft Corporation is an American multinational technology corporation producing computer software, consumer electronics, personal computers, and related services headquartered at the Microsoft Redmond campus located in Redmond, Washin ...
, Adobe,
Sun The Sun is the star at the center of the Solar System. It is a nearly perfect ball of hot plasma, heated to incandescence by nuclear fusion reactions in its core. The Sun radiates this energy mainly as light, ultraviolet, and infrared radi ...
, CNET,
National Semiconductor National Semiconductor was an American semiconductor manufacturer which specialized in analog devices and subsystems, formerly with headquarters in Santa Clara, California. The company produced power management integrated circuits, display dr ...
,
Tribune Media Services Tribune Content Agency (TCA) is a syndication company owned by Tribune Publishing. TCA had previously been known as the Chicago Tribune Syndicate, the Chicago Tribune New York News Syndicate (CTNYNS), Tribune Company Syndicate, and Tribune Media S ...
,
Ziff Davis Ziff Davis, Inc. is an American digital media and internet company. First founded in 1927 by William Bernard Ziff Sr. and Bernard George Davis, the company primarily owns technology-oriented media websites, online shopping-related services, an ...
and
Reuters Reuters ( ) is a news agency owned by Thomson Reuters Corporation. It employs around 2,500 journalists and 600 photojournalists in about 200 locations worldwide. Reuters is one of the largest news agencies in the world. The agency was esta ...
, amongst others, and was limited to thirteen companies. The ICE advisory council included nearly a hundred members. ICE was submitted to the
World Wide Web Consortium The World Wide Web Consortium (W3C) is the main international standards organization for the World Wide Web. Founded in 1994 and led by Tim Berners-Lee, the consortium is made up of member organizations that maintain full-time staff working ...
standards body on 26 October 1998, and showcased in a press event the day after. The standard failed to benefit from the open-source implementation that W3C XML specifications often received. RDF Site Summary, the first web syndication format to be called "RSS", was offered by Netscape in March 1999 for use on the My Netscape portal. This version became known as RSS 0.9. In July 1999, responding to comments and suggestions,
Dan Libby Dan or DAN may refer to: People * Dan (name), including a list of people with the name ** Dan (king), several kings of Denmark * Dan people, an ethnic group located in West Africa **Dan language, a Mande language spoken primarily in Côte d'Ivoi ...
produced a prototype tentatively named RSS 0.91 (RSS standing for Rich Site Summary at that time), that simplified the format and incorporated parts of Winer's scripting news format. This they considered an interim measure, with Libby suggesting an RSS 1.0-like format through the so-called Futures Document. In April 2001, in the midst of AOL's acquisition and subsequent restructuring of Netscape properties, a re-design of the My Netscape portal removed RSS/XML support. The RSS 0.91 DTD was removed during this re-design, but in response to feedback, Dan Libby was able to restore the DTD, but not the RSS validator previously in place. In response to comments within the RSS community at the time, Lars Marius Garshol, to whom authorship of the original 0.9 DTD is sometimes attributed, commented, "What I don't understand is all this fuss over Netscape removing the DTD. A well-designed RSS tool, whether it validates or not, would not use the DTD at Netscape's site in any case. There are several mechanisms which can be used to control the dereferencing of references from XML documents to their DTDs. These should be used. If not the result will be as described in the article." Effectively, this left the format without an owner, just as it was becoming widely used.


Initial adoption of RSS (2000–2003)

A
working group A working group, or working party, is a group of experts working together to achieve specified goals. The groups are domain-specific and focus on discussion or activity around a specific subject area. The term can sometimes refer to an interdis ...
and mailing list, RSS-DEV, was set up by various users and XML notables to continue its development. At the same time, Winer unilaterally posted a modified version of the RSS 0.91 specification to the Userland website, since it was already in use in their products. He claimed the RSS 0.91 specification was the property of his company,
UserLand Software UserLand Software is a US-based software company, founded in 1988, that sells web content management, as well as blogging software packages and services. Company history Dave Winer founded the company in 1988 after leaving Symantec in the spri ...
. Since neither side had any official claim on the name or the format, arguments raged whenever either side claimed RSS as its own, creating what became known as the RSS fork. The RSS-DEV group went on to produce RSS 1.0 in December 2000. Like RSS 0.9 (but not 0.91) this was based on the RDF specifications, but was more modular, with many of the terms coming from standard metadata vocabularies such as
Dublin Core 220px, Logo image of DCMI, which formulates Dublin Core The Dublin Core, also known as the Dublin Core Metadata Element Set (DCMES), is a set of fifteen "core" elements (properties) for describing resources. This fifteen-element Dublin Core has ...
. Nineteen days later, Winer released by himself RSS 0.92, a minor and supposedly compatible set of changes to RSS 0.91 based on the same proposal. In April 2001, he published a draft of RSS 0.93 which was almost identical to 0.92. A draft RSS 0.94 surfaced in August, reverting the changes made in 0.93, and adding a ''type'' attribute to the ''description'' element. In September 2002, Winer released a final successor to RSS 0.92, known as ''RSS 2.0'' and emphasizing "Really Simple Syndication" as the meaning of the three-letter abbreviation. The RSS 2.0 spec removed the ''type'' attribute added in RSS 0.94 and allowed people to add extension elements using
XML namespaces XML namespaces are used for providing uniquely named elements and attributes in an XML document. They are defined in a W3C recommendation. An XML instance may contain element or attribute names from more than one XML vocabulary. If each vocabulary ...
. Several versions of RSS 2.0 were released, but the version number of the document model was not changed. In November 2002, ''The
New York Times ''The New York Times'' (''the Times'', ''NYT'', or the Gray Lady) is a daily newspaper based in New York City with a worldwide readership reported in 2020 to comprise a declining 840,000 paid print subscribers, and a growing 6 million paid ...
'' began offering its readers the ability to subscribe to RSS news feeds related to various topics. In January 2003, Winer called the New York Times' adoption of RSS the "tipping point" in driving the RSS format's becoming a
de facto standard A ''de facto'' standard is a custom or convention that has achieved a dominant position by public acceptance or market forces (for example, by early entrance to the market). is a Latin phrase (literally " in fact"), here meaning "in practice b ...
. In July 2003, Winer and Userland Software assigned ownership of the RSS 2.0 specification to his then workplace, Harvard's Berkman Center for the Internet & Society.


Development of Atom (2003)

In 2003, the primary method of web content syndication was the RSS family of formats. Developers who wished to overcome the limitations of these formats were unable to make changes directly to RSS 2.0 because the specification was copyrighted by
Harvard University Harvard University is a private Ivy League research university in Cambridge, Massachusetts. Founded in 1636 as Harvard College and named for its first benefactor, the Puritan clergyman John Harvard, it is the oldest institution of high ...
and "frozen," stating that "no significant changes can be made and it is intended that future work be done under a different name

In June 2003,
Sam Ruby Sam Ruby is a prominent software developer who has made significant contributions to web standards and open source software projects. In particular he has contributed to the standardization of syndicated web feeds via his involvement with the At ...
set up a
wiki A wiki ( ) is an online hypertext publication collaboratively edited and managed by its own audience, using a web browser. A typical wiki contains multiple pages for the subjects or scope of the project, and could be either open to the pub ...
to discuss what makes "a well-formed log entry." This posting acted as a rallying point

People quickly started using the wiki to discuss a new syndication format to address the shortcomings of RSS. It also became clear that the new format could also form the basis of a more robust replacement for blog editing protocols such as Blogger.com, Blogger API and
LiveJournal LiveJournal (russian: Живой Журнал), stylised as LiVEJOURNAL, is a Russian-owned social networking service where users can keep a blog, journal, or diary. American programmer Brad Fitzpatrick started LiveJournal on April 15, 1999, a ...
XML-RPC Client/Server Protocol. The project aimed to develop a web syndication format that was

* "100% vendor neutral," * "implemented by everybody," * "freely extensible by anybody, and" * "cleanly and thoroughly specified." In short order,
project road map
was built. The effort quickly attracte
more than 150 supporters
including
Dave Sifry Dave Sifry is an American software entrepreneur and blogosphere icon known for founding Technorati in 2004, formerly a leading blog search engine. He also lectures widely on wireless technology and policy, weblogs, and open source software. Ear ...
of
Technorati Technorati was a search engine and a publisher advertising platform that served as an advertising solution for the thousands of websites in its network. Technorati launched its ad network in 2008, and at one time was one of the largest ad network ...
, Mena Trott of
Six Apart Six Apart Ltd., sometimes abbreviated 6A, is a software company known for creating the Movable Type blogware, TypePad blog hosting service, and Vox (the blogging platform). The company also is the former owner of LiveJournal. Six Apart is he ...
,
Brad Fitzpatrick Bradley Joseph Fitzpatrick (born February 5, 1980) is an American programmer. He is best known as the creator of LiveJournal and is the author of a variety of free software projects such as memcached, PubSubHubbub, OpenID, and Perkeep. Early life ...
of LiveJournal,
Jason Shellen Jason Harper Shellen (born August 30, 1973) is an American internet entrepreneur who was the founding product manager of Google Reader and helped create and launch Brizzly. His most recent software startup is the email app Boxer (app), Boxer. He ...
of Blogger,
Jeremy Zawodny As of October 2012, Jeremy Zawodny is an employee of Craigslist, having previously worked in Yahoo!'s platform engineering group, where he was described as "Yahoo!'s MySQL guru". He maintains a popular weblog focused on Yahoo! initiatives, which ...
of
Yahoo! Yahoo! (, styled yahoo''!'' in its logo) is an American web services provider. It is headquartered in Sunnyvale, California and operated by the namesake company Yahoo Inc., which is 90% owned by investment funds managed by Apollo Global Manage ...
, Timothy Appnel of the O'Reilly Network, Glenn Otis Brown of Creative Commons and
Lawrence Lessig Lester Lawrence Lessig III (born June 3, 1961) is an American academic, attorney, and political activist. He is the Roy L. Furman Professor of Law at Harvard Law School and the former director of the Edmond J. Safra Center for Ethics at Harvard ...
. Other notables supporting Atom include
Mark Pilgrim Mark Pilgrim is a software developer, writer, and advocate of free software. He authored a popular blog, and has written several books, including ''Dive into Python'', a guide to the Python programming language published under the GNU Free Docu ...
,
Tim Bray Timothy William Bray (born June 21, 1955) is a Canadian software developer, environmentalist, political activist and one of the co-authors of the original XML specification. He worked for Amazon Web Services from December 2014 until May 2020 w ...
,
Aaron Swartz Aaron Hillel Swartz (November 8, 1986 – January 11, 2013) was an American computer programmer, entrepreneur, writer, political organizer, and Internet hacktivist. A prolific programmer, Swartz helped develop the web feed format RSS, the tech ...
,
Joi Ito is a Japanese entrepreneur and venture capitalist. He is a former director of the MIT Media Lab, former professor of the practice of media arts and sciences at MIT, and a former visiting professor of practice at the Harvard Law School. Ito has ...
, and Jack Park

Also, Dave Winer, the key figure behind RSS 2.0, gave tentative support to the Atom endeavor (which at the time was called Echo

After this point, discussion became chaotic, due to the lack of a decision-making process. The project also lacked a name, tentatively using "Pie," "Echo," and "Necho" before settling on
Atom Every atom is composed of a nucleus and one or more electrons bound to the nucleus. The nucleus is made of one or more protons and a number of neutrons. Only the most common variety of hydrogen has no neutrons. Every solid, liquid, gas, ...
. After releasing a project snapshot known as ''Atom 0.2'' in early July 2003, discussion was shifted off the wiki. The discussion then moved to a newly set up mailing list. The next and final snapshot during this phase was ''Atom 0.3'', released in December 2003. This version gained widespread adoption in syndication tools, and in particular it was added to several
Google Google LLC () is an American Multinational corporation, multinational technology company focusing on Search Engine, search engine technology, online advertising, cloud computing, software, computer software, quantum computing, e-commerce, ar ...
-related services, such as Blogger, Google News, and
Gmail Gmail is a free email service provided by Google. As of 2019, it had 1.5 billion active users worldwide. A user typically accesses Gmail in a web browser or the official mobile app. Google also supports the use of email clients via the POP and ...
. Google's Data APIs (Beta) GData are based on Atom 1.0 and RSS 2.0.


Atom 1.0 and IETF standardization

In 2004, discussions began about moving the Atom project to a standards body such as the W3C or the
Internet Engineering Task Force The Internet Engineering Task Force (IETF) is a standards organization for the Internet and is responsible for the technical standards that make up the Internet protocol suite (TCP/IP). It has no formal membership roster or requirements and a ...
(IETF). The group eventually chose the IETF and th
Atompub working group
was formally set up in June 2004, finally giving the project a charter and process. The Atompub working group is co-chaired by
Tim Bray Timothy William Bray (born June 21, 1955) is a Canadian software developer, environmentalist, political activist and one of the co-authors of the original XML specification. He worked for Amazon Web Services from December 2014 until May 2020 w ...
(the co-editor of the
XML Extensible Markup Language (XML) is a markup language and file format for storing, transmitting, and reconstructing arbitrary data. It defines a set of rules for encoding documents in a format that is both human-readable and machine-readable ...
specification) and Paul Hoffman. Initial development was focused on the syndication format. The final draft of ''Atom 1.0'' was published in July 2005 and was accepted by the IETF as a "proposed standard" in August 2005. Work then continued on the further development of the publishing protocol and various extensions to the syndication format. The Atom Syndication Format was issued as a proposed "internet official protocol standard" in IETF RFC 4287 in December 2005 with the help of the co-editors Mark Nottingham and Robert Sayre.


Post-Atom technical developments related to web syndication

In January 2005, Sean B. Palmer, Christopher Schmidt, and Cody Woodard produced a preliminary draft of RSS 1.1. It was intended as a bugfix for 1.0, removing little-used features, simplifying the syntax and improving the specification based on the more recent RDF specifications. As of July 2005, RSS 1.1 had amounted to little more than an academic exercise. In April 2005, Apple released Safari 2.0 with RSS Feed capabilities built in. Safari delivered the ability to read RSS feeds, and bookmark them, with built-in search features. Safari's RSS button is a blue rounded rectangle with "RSS" written inside in white. The favicon displayed defaults to a newspaper icon. In November 2005, Microsoft proposed its Simple Sharing Extensions to RSS. In December 2005, Microsoft announced in blogs that
Internet Explorer 7 Windows Internet Explorer 7 (IE7) (codenamed Rincon) is a web browser for Windows. It was released by Microsoft on October 18, 2006, as the seventh version of Internet Explorer and the successor to Internet Explorer 6. Internet Explorer 7 is pa ...
and Microsoft Outlook 12 (Outlook 2007) will adopt the
feed icon On the World Wide Web, a web feed (or news feed) is a data format used for providing users with frequently updated content. Content distributors ''Web syndication, syndicate'' a web feed, thereby allowing users to ''subscribe'' a channel to it b ...
first used in the Mozilla Firefox, effectively making the orange square with white radio waves the industry standard for both RSS and related formats such as Atom. Also in February 2006,
Opera Software Opera is a Norwegian multinational technology company and subsidiary of Kunlun that specializes in web browser development, fintech, as well as services such as Opera News and YoYo Games. The company's total user base, including users of its ...
announced they too would add the orange square in their
Opera Opera is a form of theatre in which music is a fundamental component and dramatic roles are taken by singers. Such a "work" (the literal translation of the Italian word "opera") is typically a collaboration between a composer and a libr ...
9 release. In January 2006,
Rogers Cadenhead Rogers Cadenhead (born April 13, 1967) is a computer book author and web publisher who served from 2006 to 2008 as chairman of the RSS Advisory Board, a group that publishes the RSS 2.0 specification. He graduated from Lloyd V. Berkner High Schoo ...
relaunched the
RSS Advisory Board The RSS Advisory Board is a group founded in July 2003 that publishes the RSS 0.9, RSS 0.91 and RSS 2.0 specifications and helps developers create RSS applications. Dave Winer, the lead author of several RSS specifications and a longtime evangelis ...
in order to move the RSS format forward. In January 2007, as part of a revitalization of Netscape by AOL, the
FQDN A fully qualified domain name (FQDN), sometimes also referred to as an ''absolute domain name'', is a domain name that specifies its exact location in the tree hierarchy of the Domain Name System (DNS). It specifies all domain levels, including th ...
for my.netscape.com was redirected to a holding page in preparation for an impending relaunch, and as a result some news feeders using RSS 0.91 stopped working. The DTD has again been restored.


HTML5

In 2013 the Candidate Recommendation for
HTML5 HTML5 is a markup language used for structuring and presenting content on the World Wide Web. It is the fifth and final major HTML version that is a World Wide Web Consortium (W3C) recommendation. The current specification is known as the HTML ...
included explicit provision for syndication by introducing the 'article' element.W3C org draft proposal for article element
/ref>


See also

*
History of the World Wide Web The World Wide Web ("WWW", "W3" or, simply, "the Web") is a global information medium which users can access via computers connected to the Internet. The term is often mistakenly used as a synonym for the Internet, but the Web is a service tha ...


References


External links


Early RSS history from several different personal points of view


History of RSS compiled in 2003 by Joseph Reagle

History of RSS compiled in 2004 by Dave Winer

History of the RSS fork compiled in 2002 by Mark Pilgrim

History of ESS Feed in 2012
{{DEFAULTSORT:History of Web Syndication Technology Web syndication technology Web syndication formats History of computing