Kialo

Kialo is an online structured debate platform with argument maps in the form of debate trees. It is a collaborative reasoning tool for thoughtful discussion, understanding different points of view, and collaborative decision-making, showing arguments for and against claims underneath user-submitted theses or questions.

The deliberative discourse platform is designed to present hundreds of supporting or opposing arguments in a dynamic argument tree and is streamlined for rational civil debate on topics such as philosophical questions, policy deliberations, entertainment, ethics, science questions, and unsolved problems or subjects of disagreement in general.

Argument-boxes are structured into hierarchical branches where the root is the main thesis (or theses) of the debate, enabling deliberation and navigable debates between opposing perspectives. A debate is divided into Pro (supporting) and Con (refuting or devaluing) columns where registered users can add arguments and rate the of the parent claim. The arguments .

Its argument tree structure enables detailed scrutiny of claims at all levels of the tree and allows users to for example quickly understand why a decision was made or which of the aggregated arguments swayed it this way. Newcomers can join a debate at any time and look back at the structured discussion history, and then weigh in at the right place with their new argument or their comment on a specific argument. The design presets a structure on debates "that allows participants to easily see, process, and ultimately assess the many facets of competing claims".

The word Kialo is Esperanto for "reason". The platform is the world's largest argument mapping and structured debate site.

Overview

Users can comment on every Pro or Con, for example for requesting sources or expansions. Recent activities of a debate are shown in a panel on the right side of the respective debate. Debates can be found through the search or on the Explore page through their descriptions and topic- tags.

Mere comments that do not make a constructive point (a self-contained argument backed by reasoning) are not allowed and are picked up by other users and moderators. "Civil language and sensible observations from opposing perspectives" can be seen also in debates about controversial topics. The site by-design incentivizes fair, rigorous, open-minded dialogue. Contributors making claims often also write counterpoints to their own contribution. Claims need to be shorter than 500 characters and can link to external sources.

Debate trees can also start off with multiple theses – such as or hypotheses. Claims can link to related debates or include segments of them. In the discussion tab of each claim, users can make edit proposals (e.g. for accuracy, improving sources, or changing scope), decide if the argument should be moved or copied to another branch, call for archiving a claim, and ask for extra evidence or clarification.

Debates can grow large and complex for which a sunburst diagram and the search functionality can be useful. Each debate also has a chat-box. In cases where e.g. a "Con" is a point against multiple in the "Pros", users – through moderators – can link these arguments at the respective places to avoid duplication of content and allowing a clean chain for people to understand which points are arguments against each other. Contributions of users are tracked, enabling a board of thought-leaders for every debate. Other gamification elements include a feature to thank users for their contributions.

The "Perspectives" feature allows users to see 'Impact' ratings of supporters and opposers of a thesis as well as of the debate's moderators and individual contributors. It thereby enables participants to see a debate from other participants' perspectives and to sort by them. In Kialo Edu, this feature lets teachers view votes for a whole class, individuals, or supporters/opponents of a specific thesis. Users in both versions of Kialo can vote on the overall debate topic as well as on individual claims to express their perspectives or conclusions, with the rationale (i.e. the main causal arguments) why they voted on the veracity of the thesis as they did not being captured. Voting can be done by any registered user while navigating through any debate that has voting enabled or via using the Guided Voting wizard user interface that automatically walks through branches.

As of 2021, Kialo doesn't have a mobile app.

Contents

A 2018 report stated the collaborative argument platform hosts more than 10,000 debates in various languages. It also hosts private debates. The website claims that it has over 18,000 public debates as of July 2023, as well as over 1 million votes and over 720,000 claims. Debates can be found via the site's internal search and up to six tags per debate.

Preprint studies have scraped public debates on over 1.4K issues with over 130K statements as of October 2019 and 1628 debates, related to over 1120 categories, with 124,312 unique claims as of June 26, 2020.

Kialo Inc.

The site is run by Kialo Inc. It was founded by German-born entrepreneur and London School of Economics and Political Science graduate Errikos Pitsos in August 2017 and is based in Brooklyn and Berlin. According to a 2018 report, the site does not show advertisements and does not sell user's data. The for-profit company was founded in 2011, Pitsos began to develop the concept in 2012 and described various specifics of the system in 2014. In 2018, he stated that they intend to make money by selling the platform to companies as a deliberation and decision-making tool. The site is free to use for the public and in education. According to the site, as of 2023 Kialo.com is a non-revenue generating site with no ads and no reselling of user data.

Applications and adoption

Adopted applications

Applications of its content or the platform in society include:
* Teachers and professors, especially in high schools – including the universities Harvard and Princeton, are using Kialo for class discussions and exercises in critical thinking and reasoning, as consolidating understanding of materials covered in recent classes, more useful and engaging learning experiences, for remote/e-learning, for clearing up misconceptions, teaching logical fallacies and rational argumentation, for academic dialogue, teaching media literacy, and for teaching to sufficiently reflect or research before posting online. Like for debaters of the main site, access for schools and universities is free. is the custom version of Kialo specifically designed for classroom use where debates are private and locked to invited students.
**Kialo allows teachers to provide feedback to students on their ideas, argument structure, and research quality while it is left to other students to rate the impacts of their peers' arguments.
**Students can be allowed to contribute anonymously which may be useful for controversial issues as well as for safeguarding privacy in education.
**Students are or can be encouraged to back up their claims with evidence which can foster digital literacy and research skills.
**Students and teachers can use it to arrange their thoughts when structuring an essay or project.
* The site's name was decided on internally using the software.

Prototypical and theoretical applications

Potential, theoretical, prototypical or little-used applications include:
;Education
* Improving critical thinking skills of society at large as well as facilitating deep or efficient thinking and deepening research and debates where e.g. discussions are less shallow and the well-known or many arguments have already been made and in many cases aren't unreasonably over- or underrated.
** Pitsos claimed that "we're training students to be very good test-takers instead of critical thinkers", suggesting teaching people to think things through may be more important or neglected compared to essay writing skills.
* Many young people and adults are "submerged into a sea of dispersed information", " owsing and engaging in superficial thinking activities". Kialo could counteract this issue and help people develop good sane reasoning.

;Academia, R&D and policy
* Three scholars from three prestigious U.S. universities outlined possible benefits in this domain, including applications beyond higher education such as for academic communication. They suggest the debate platform could be used for structuring the communication of open peer-review by helping those giving feedback to "hone in on iccore arguments and pieces of evidence in an even more direct way" than annotated commenting.
* It could be used to evaluate extracted argument structures and sequences from raw texts, as in a Semantic Web for arguments. Such "argument mining", to which Kialo is the largest structured source so far, could e.g. be used to assess the completeness and effectiveness of an argumentative discussion or to augment it (with additional arguments, contextual information, assessments, refuting evidence or supporting data).
* A security studies paper suggested it could be used for "managing arguments more effectively than traditional paragraph/bullet-point approaches". It claims that "complexity demands adaptation" but also notes that "Kialo's simplicity does pose some weaknesses and limitations, and in general current systems cannot reliably automate analysis or synthesis of arguments in the same way that statistical packages can automate analysis of data".
* The site could be used by companies and government organizations as "intuitive debate software for internal discussions and decision-making".
* It could aid in the search for the best policies and course of action, including for 'wicked problems' and issues where there is a large polarization. This may include "experiments of deliberative democracy inside local governments".
* With a platform like Kialo, users provide "both data on what they see is in the landscape of relevant arguments but also some indication of what they think is important priority">prioritization.html" ;"title="r has prioritization">priorityin determining their policy preferences" and "also shows which arguments the individual did not find persuasive, and possibly which rebuttals to a particular argument [was] used to discard it." Current functionality of the site may still be insufficient for the latter outside of experiments.
* It could increase efficiency in knowledge acquisition, including concerning information overload on social media.
* Policy-makers and scientists could use platforms and debates like these to engage with each other as well as the public if they were aware of it and used it. Considering only argument trees beneath theses, its arguments-crowdsourcing and revision principles are not or less vulnerable to framing-issues, intentionally placed attackable segments, weak or missing arguments, straw man points, oversimplification, agenda-setting and other issues that may be common in contemporary public political debates.
* The debate trees can be used to identify arguments that are seen as most credible, as well as reveal which areas of argumentation lack support, precedent, or evidence, which may be useful for subsequent work or more efficient and useful science (as in identifying little-supported assumptions, providing key missing data, or researching key open questions).

;General
* Writers in general, as well as possibly major other opinion leaders, could populate a Kialo debate with their arguments and release it alongside the traditional linear written format, albeit such would mean the arguments would be open to scrutiny, with such being more accessible than large and fans-dominated unstructured comment sections or may already be part of an existing debate tree. They could also use the site in other ways such as for selecting questions to pose to interviewees or for selecting unexplored questions to investigate and report on.
* It could be used for legal cases.
* Websites could embed read-only argument trees (or branches) from the site.
* More broadly, the site's content could be used for reflective brainstorming, and as a crowdsourcing resource for points to use in other media (e.g. long-form text). It enables detailed exploration of some theses or topics as the visual reasoning through tree-based structure allows for many levels of depth and for follow-up questions in the discussion tab of each claim. The founder stated that "The public debates are basically supposed to become a site where people can go and inform themselves. If a debate has over 2,000 unique arguments, it's going to be hard to find an argument that's not in there already. You can go there, similar to Wikipedia, and read."

Research

Kialo is a subject of research studies and its data has been used in research as there are datasets of its contents and the site allows exporting CSV files as well as crawling and filtering debates.

;Computational research on argumentation
The platform has gained attention in computational research on argumentation because of its high-quality arguments and elaborate argument trees. Its data has been used to train and to evaluate natural language processing AI systems such as, most commonly, BERT and its variants. This includes argument extraction, conclusion generation, argument assessment, machine argumentative debate generation or participation, surfacing most relevant previously overlooked viewpoints or arguments, argumentative writing support (incl. sentence attackability scores), automatic real-time evaluation of how truthful or convincing a sentence is (similar to fact-checking), language model fine tuning (incl. chatbots), argument impact prediction, argument classification and polarity prediction.

;Content analysis in social science and belief studies
The contents can also be analyzed to e.g. show the most common Con rationale-types and factors in general, or reveal the most contested arguments where ratings diverge the most for a given topic.

The site's founder proposed the types of arguments and ways people reason could be investigated as well as the "performance of Kialo versus long-form text in making people change their minds". One study suggests arguers seem to change their viewpoints more readily when a fact they believe has evidence and is undermined when compared to prior beliefs without .

;The platform as a subject

A study showed that when evaluating policies via Kialo debates, "reading comments from most to least liked, on average, displays more inning argumentsthan reading comments earliest first". Kialo has a set of different permissions that participants can have in a given debate. A preprint study makes suggestions regarding "interface design as a scalable solution to conflict management" to prevent adversarial beliefs and values of moderators to have negative impacts on the site.

Reception, motivation and distinction from alternatives

In 2022, MakeUseOf named the site as one of the five best "debate sites to civilly and logically argue online about opinions" and in 2019 as one of the "100+ best websites on the Internet".

;Online discourse quality
The site aims to be a hub for civilized debate where shouting, rudeness or irrationality aren't allowed. This has been described as remarkable in an "age of Trumpian tweeting". The site's founder stated that he noticed early on that the Web became "ideal for bad conversations, with prominence given to the most outrageous conversations" and that he "wondered if there wasn't a better method of online discourse", claiming the site's mission is to "empower reason and to make the world more thoughtful", describing it as a "platform where people with opposing views can meet and understand each other's thinking". As of 2023, there are major concerns about online irrational or misinformation-fueled debate – for example, a researcher affirmed that "Twitter was not designed or intended to be a digital town square" as part of a "functioning democracy", addressing Elon Musk's comments about the site in 2022. Instead, she claims it to be a "space for millions of town criers, but not a town square for people to come together and debate". Reports suggest the site may present a more complete and complex view of reality than some other sites where "it's easy to get trapped in echo-chambers of like-minded people where your beliefs are never eaningfullychallenged" as it shows you "the best arguments on both sides of a debate".

;Communication formats
e.g. "tend to only allow a linear progression of arguments in a stream-of-discussion format". On many websites, "circuitous comment threads ftenrender meaningful discussion impossible" and "formats that we use to communicate shape the way we communicate". On the site, users contribute to a debate tree rather than engaging in argumentative back-and-forth commenting.

Kialo may be more appropriate especially for discussions that are relatively complex and hard to visualize or oversee otherwise and allows for public ideation and structured interaction among different types of stakeholders. Linking to supporting evidence is encouraged, but not as strictly required as for example on Wikipedia. Kialo has advantages over structured knowledge bases and Wikipedia in "that it includes many debatable statements; many attacked sentences are subjective judgments, so fact-based knowledge sources may have limited utility". Chains of reasoning can be followed "from beginning to end" with relatively little text to read, nearly no repetition or unexplained statements and without having it derailed by for example "name-calling and directionless ranting". Online debates "have grown so large and acrimonious that no one realistically has the time to read everything and hence get a sense of the actually winning arguments (winners) after all points have been considered" and there is research into how to efficiently calculate the winning arguments or arguments weights and the overall conclusions. Moreover, argumentations on the site are less fleeting and repetitive than debates on social media sites – they are commonly read and actively contributed to over the span of years.

;Criticisms and current limitations

One preprint study stated that " ough kialo is designed for scale, and therefore has to be not only robust but also both easy and appealing to use, it has simplified its notion of argument structure so much that there is very little flexibility left. As a commercial entity, its data ot reusableand platform open source] are also closed, making wide-scale application at the science-policy Evidence-based policy#Scholarly communication in policy, interface more challenging."

One study found that "Kialo's simplicity does pose some weaknesses and limitations" and found the functionality of current systems including Kialo for "synthesis of arguments" to be insufficient. One study suggests the platform is structured in a way that gives insufficient capacity for users to do anything else other than to either agree or disagree with a side, with there e.g. only being options to rate the veracity of the main thesis but not for proposing concrete alternatives and middle-grounds such as more nuanced policies or specifying conditional critical considerations (e.g. exceptions, applicable scopes and limitations) of one's veracity rating of the main thesis, which tend to be very brief and rarely revised.

One study points out that without 'Writer' permissions in a debate, the arguments have "to get past the gatekeepers" of it, which can in some cases be problematic as moderators' beliefs and values may play a role. For instance, such can lead to some users feeling like certain perspectives (or arguments) are being excluded from a debate or getting positioned inappropriately (such as not being visible at the level most relevant). There may be issues relating to framing and argument positioning, whereby for example a false claim (with or without a source) can be added as supporting a thesis which is then only addressed by a later countering claim stating the opposite beneath it – which may reduce the former's 'Impact' rating but is not shown directly at the tree level above as an 'countering' argument. Instead, only the false or weak supporting argument can be seen at the level above in such a case. Impact rating votes do not require reading the arguments beneath but voting can be turned off until the argument map has had time to sufficiently develop.

;Complementarity
The founder clarified key distinctions and complementarity of the site saying "We're going to just be an added place. We're not competing with anybody out there with regards to thoughtful discourse. There are a couple of sites that are question-and-answer sites, or commenting sites, or sharing sites, but there's not a single ajorsite for collaborative reasoning — a repository of the why". He states that Wikipedia – another peer production site to which Kialo is sometimes compared with due to argumentative discussions on Talk pages and its public collaborative knowledge integration – "tells you the what and we tell you the why".

See also

*
*
*
* Evidence-based practices – potential uses
* Public awareness of science – platform use can expose people to most relevant counterarguments and data
* Internet manipulation#Countermeasures – related risks
* Knowledge integration – argument integration
* List of logical fallacies – potential way to classify arguments or removals
* Socratic method – related educational concept
* The medium is the message – importance of platform structure-design
* Causal inference – related to identification of data needs
* r/changemyview – an unstructured debate website
* Project Debater – an AI system

References

External links

Kialo Edu blog
guides and ideas for applications in education
*
* Structured online debate and conclusion-making, images and related projects

The Role of Pragmatic and Discourse Context in Determining Argument Impact
2019, R&D on determining argument impact

{{Mindmaps

2017 establishments in New York City
2017 in science
Argument mapping
Argument technology
Companies based in Brooklyn
Software companies established in 2017
Computational linguistics
Collaborative projects
Collective intelligence
Crowdsourcing
Debate websites
Educational software
Government by algorithm
Online companies of the United States
Open government
Philosophy websites
Semantic Web
Virtual communities
Web 2.0