Skill-based matchmaking (SBMM), also referred to as matchmaking ranking, is a form of
matchmaking dependent on the relative skill level of the players involved.
History
A common rating system in
chess is the
Elo rating system, developed by
Arpad Elo. Former
International Chess Federation
The International Chess Federation or World Chess Federation, commonly referred to by its French acronym FIDE ( Fédération Internationale des Échecs), is an international organization based in Switzerland that connects the various national c ...
president
Florencio Campomanes
Florencio Campomanes (22 February 1927 – 3 May 2010) was a Filipino political scientist, chess player, and chess organizer.
Education
Campomanes was born in Manila and earned his B.A. in political science from the University of the Philippin ...
described it as an "inseparable partner to high-level chess". In 2006,
Microsoft researchers proposed a skill-based rating system using
Bayesian inference
Bayesian inference is a method of statistical inference in which Bayes' theorem is used to update the probability for a hypothesis as more evidence or information becomes available. Bayesian inference is an important technique in statistics, a ...
and deployed it on the
Xbox Live
The Xbox network, formerly and still sometimes branded as Xbox Live, is an Internet, online multiplayer video game, multiplayer gaming and digital media delivery service created and operated by Microsoft. It was first made available to the Xbox ...
network, then one of the largest deployments of a Bayesian inference algorithm. The researchers were displeased with the ranking system in the beta of ''
Halo 2'' (2004). By the time ''Halo 2'' launched, it was using TrueSkill.
The term skill-based matchmaking first appeared in a 2008 interview with game designer
John Carmack
John D. Carmack II (born August 20, 1970) is an American computer programmer and video game developer. He co-founded the video game company id Software and was the lead programmer of its 1990s games ''Commander Keen'', ''Wolfenstein 3D'', ''Doo ...
in which he emphasized its importance in ''
Quake Live'' (2010). Upon setting up an account with
id Software, the game will ask the player for their skill level and judge accordingly depending on their performance from that point forward. The presence—or lack thereof—of skill-based matchmaking became a point of contention. During the development of ''
Dota 2
''Dota 2'' is a 2013 multiplayer online battle arena (MOBA) video game by Valve. The game is a sequel to ''Defense of the Ancients'' (''DotA''), a community-created mod for Blizzard Entertainment's '' Warcraft III: Reign of Chaos.'' ''Dota 2' ...
'' (2013),
Valve Software believed that the barrier to entry could be solved with, among other things, skill-based matchmaking through its
Steamworks
Steam is a video game digital distribution service and storefront by Valve. It was launched as a software client in September 2003 as a way for Valve to provide automatic updates for their games, and expanded to distributing and offering third ...
service; when ''
Call of Duty: Black Ops'' (2010) developer
Treyarch was asked why the game wouldn't include skill-based matchmaking unlike ''
Halo 3'' (2007), multiplayer design director
David Vonderhaar said that speed was "more important than anything else".
Description
Team-based, competitive games such as ''
League of Legends'' (2009), ''
Counter-Strike: Global Offensive'' (2012), ''
Dota 2
''Dota 2'' is a 2013 multiplayer online battle arena (MOBA) video game by Valve. The game is a sequel to ''Defense of the Ancients'' (''DotA''), a community-created mod for Blizzard Entertainment's '' Warcraft III: Reign of Chaos.'' ''Dota 2' ...
'' (2013), and ''
Overwatch'' (2016) benefit from skill-based matchmaking. In contrast, ''
Call of Duty: Black Ops II'' (2012)—a game that primarily focuses on single-player accomplishments—does not benefit from skill-based matchmaking.
Treyarch, who developed ''Call of Duty: Black Ops II'', consciously queued players exclusively using
ping and
latency, in a subversion of industry standards at the time.
Queues
In skill-based matchmaking, queue design focuses on how to divide parties into appropriate skill groups. In contrast to ''
StarCraft II'' (2010), which focuses on player-on-player action,
Blizzard Entertainment's ''
Heroes of the Storm'' (2015) is a team-based game. The ''Heroes of the Storm'' matchmaker aims to have players win at least half of the games that they play. The game's matchmaker also aims to pair coordinated teams with other coordinated teams in order to avoid an unfair communication advantage.
According to game director
Ben Brode, ''
Hearthstone
''Hearthstone'' is a free-to-play online digital collectible card game developed and published by Blizzard Entertainment. Originally subtitled ''Heroes of Warcraft'', ''Hearthstone'' builds upon the existing lore of the ''Warcraft'' series by u ...
'' (2014) maintains a separate pool of new players. Players remain in the pool until they win ten games or obtain two legendary minions.
Player rating model
The skill rating of a player is their ability to win a match based on aggregate data. Various models have emerged to achieve this. Mark Glickman implemented skill volatility into the
Glicko rating system
The Glicko rating system and Glicko-2 rating system are methods of assessing a player's strength in games of skill, such as chess and Go. The Glicko rating system was invented by Mark Glickman in 1995 as an improvement on the Elo rating system, a ...
. In 2008, researchers at
Microsoft extended
TrueSkill for two-player games by describing a number for a player's ability to force draws. Variability in map, character, and server effects have been considered in at least two research papers. In 2016, two
Cornell University graduates modeled skill rating as a vector of numbers, showing "substantial intransitivity".
Reception
Skill-based matchmaking is a controversial practice. In ''
Call of Duty: Warzone'' (2020), streamers of the game often seek out "bot lobbies"—lobbies with less-skilled players. ''
The Washington Post'' compared the practice to "
LeBron James looking to join pickup games at the local
YMCA". ''Call of Duty: Warzone'' players who have spoken out against the game's use of skill-based matchmaking include
100 Thieves
100 Thieves, LLC is an American lifestyle brand and gaming organization based in Los Angeles, California, founded in 2017 by Matthew "Nadeshot" Haag and Dan Gilbert. The organization competes in several video games, including ''Apex Legends'', ...
CEO
Nadeshot, former professional ''Counter-Strike: Global Offensive'' player
Shroud, and 100 Thieves co-owner
CouRage
Courage (also called bravery or valor) is the choice and willingness to confront agony, pain, danger, uncertainty, or intimidation. Valor is courage or bravery, especially in battle.
Physical courage is bravery in the face of physical pain, h ...
. Competitive ''Call of Duty: Warzone'' player HusKerrs wrote that high-skilled players must "sweat or try hard" in order to create engaging content. Streamer
TimTheTatman refused to stream ''
Call of Duty: Modern Warfare II'' (2022) upon discovering that it would implement skill-based matchmaking.
In February 2023, ''
Destiny 2'' (2017) introduced skill-based matchmaking. Higher-skilled players subsequently discovered a way to enter lobbies with lower-skilled players, resulting in outcry from the community.
References
Citations
Works cited
*
*
*
*
*
*
*
*
** {{Harvc , last=Zook , first=Alex , c=Chapter 3: Building Matchmaking Systems , in=Wallner , year=2019
Matchmaking
Video game terminology