HOME

TheInfoList



OR:

Internet manipulation refers to the co-optation of digital technology, such as social media algorithms and automated scripts, for commercial, social or political purposes. Such tactics may be employed with the explicit intent to manipulate public opinion, polarise citizens, silence political dissidents, harm corporate or political adversaries, and improve personal or
brand A brand is a name, term, design, symbol or any other feature that distinguishes one seller's good or service from those of other sellers. Brands are used in business, marketing, and advertising for recognition and, importantly, to create an ...
reputation. Hackers, hired professionals and private citizens have all been reported to engage in internet manipulation using software typically
Internet bot An Internet bot, web robot, robot or simply bot, is a software application that runs automated tasks ( scripts) over the Internet, usually with the intent to imitate human activity on the Internet, such as messaging, on a large scale. An Internet ...
s such as
social bot A social bot, or also described as a social AI or social algorithm, is a software agent that communicates autonomously on social media. The messages (e.g. Twitter, tweets) it distributes can be simple and operate in groups and various configurati ...
s,
votebots A votebot is a software automation built to fraudulently participate in online polls, elections, and to upvote and downvote on social media. Simple votebots are easy to code and deploy, yet they are often effective against many polls online, as ...
and clickbots. ''Cognitive hacking'' refers to a
cyberattack A cyberattack is any offensive maneuver that targets computer information systems, computer networks, infrastructures, or personal computer devices. An attacker is a person or process that attempts to access data, functions, or other restricted ...
that aims to change users' perceptions and corresponding behaviors. Internet manipulation is sometimes also used to describe selective
Internet censorship Internet censorship is the legal control or suppression of what can be accessed, published, or viewed on the Internet. Censorship is most often applied to specific internet domains (such as Wikipedia.org) but exceptionally may extend to all Inte ...
or violations of net neutrality.


Issues

* Behavior Manipulation: Fake news, disinformation, and AI can secretly affect behavior. This is a different issue from affecting cognitive beliefs, as this can operate outside of awareness, making it harder to detect. * High-arousal emotion virality: It has been found that content that evokes high-arousal emotions (e.g. awe, anger, anxiety or with hidden sexual meaning) is more viral and that content that holds one or many of these elements: surprising, interesting, or useful is taken into consideration. * Simplicity over complexity: Providing and perpetuating simple explanations for complex circumstances may be used for online manipulation. Often such are easier to believe, come in advance of any adequate investigations and have a higher virality than any complex, nuanced explanations and information. (See also: Low-information rationality) * Peer-influence: Prior collective ratings of an web content influences ones own perception of it. In 2015 it was shown that the perceived beauty of a piece of artwork in an online context varies with external influence as confederate ratings were manipulated by opinion and credibility for participants of an experiment who were asked to evaluate a piece of artwork. Furthermore, on Reddit, it has been found that content that initially gets a few down- or upvotes often continues going negative, or vice versa. This is referred to as "bandwagon/snowball voting" by reddit users and administrators. * Filter bubbles: Echo chambers and filter bubbles might be created by Website administrators or moderators locking out people with altering viewpoints or by establishing certain rules or by the typical member viewpoints of online sub/communities or Internet "tribes" * Confirmation bias & manipulated prevalence:
Fake news Fake news is false or misleading information presented as news. Fake news often has the aim of damaging the reputation of a person or entity, or making money through advertising revenue.Schlesinger, Robert (April 14, 2017)"Fake news in reality ...
does not need to be read but has an effect in quantity and emotional effect by its headlines and
sound bites A sound bite or soundbite is a short clip of speech or music extracted from a longer piece of audio, often used to promote or exemplify the full length piece. In the context of journalism, a sound bite is characterized by a short phrase or sentence ...
alone. Specific points, views, issues and people's apparent prevalence can be amplified, stimulated or simulated. (See also:
Mere-exposure effect The mere-exposure effect is a psychological phenomenon by which people tend to develop a preference for things merely because they are familiar with them. In social psychology, this effect is sometimes called the familiarity principle. The effect ...
) * Information timeliness and uncorrectability: Clarifications, conspiracy busting and fake news exposure often come late when the damage is already done and/or do not reach the bulk of the audience of the associated misinformation * Psychological targeting: Social media activities and other data can be used to analyze the personality of people and predict their behaviour and preferences. Dr
Michal Kosinski Michal Kosinski is a Professor at Stanford University, a computational psychologist, and a psychometrician. He studies humans in a digital environment using computational methods, AI and Big Data. He has co-authored the textbook Modern Psychom ...
developed such a procedure. Such can be used for media or information tailored to a person's psyche e.g. via Facebook. According to reports such may have played an integral part in Donald Trump's win. (See also: Targeted advertising,
Personalized marketing Personalized marketing, also known as one-to-one marketing or individual marketing, is a marketing strategy by which companies leverage data analysis and digital technology to deliver individualized messages and product offerings to current or pr ...
)


Algorithms, echo chambers and polarization

Due to overabundance of online content, social networking platforms and search engines have leveraged
algorithm In mathematics and computer science, an algorithm () is a finite sequence of rigorous instructions, typically used to solve a class of specific problems or to perform a computation. Algorithms are used as specifications for performing ...
s to tailor and personalize users' feeds based on their individual preferences. However, algorithms also restrict exposure to different viewpoints and content. This is commonly referred to as "echo-chambers" and " filter-bubbles". With the help of algorithms, filter bubbles influence users' choices and perception of reality by giving the impression that a particular point of view or representation is widely shared. Following the 2016 referendum of membership of the European Union in the United Kingdom and the
United States presidential election The election of the president and the vice president of the United States is an indirect election in which citizens of the United States who are registered to vote in one of the fifty U.S. states or in Washington, D.C., cast ballots not dire ...
s, this gained attention as many individuals confessed their surprise at results that seemed very distant from their expectations. The range of pluralism is influenced by the personalized individualization of the services and the way it diminishes choice. Five manipulative verbal influences were found in media texts. There are self-expression, semantic speech strategies, persuasive strategies, swipe films and information manipulation. The vocabulary toolkit for speech manipulation includes euphemism, mood vocabulary, situational adjectives, slogans, verbal metaphors, etc. Research on echo chambers from Flaxman, Goel, and Rao, Pariser,Pariser, Eli. 2011. The filter bubble: What the Internet is hiding from you. Penguin UK. Available at https://books.google.co.uk/?hl=en&lr=&oi=fnd&pg=PT3&dq=eli+pariser+filter&ots=g3PrCprRV2&sig=_FI8GISLrm3WNoMKMlqSTJNOFw Accessed 20 May 2017. and Grömping suggest that use of social media and search engines tends to increase ideological distance among individuals. Comparisons between online and off-line
segregation Segregation may refer to: Separation of people * Geographical segregation, rates of two or more populations which are not homogenous throughout a defined space * School segregation * Housing segregation * Racial segregation, separation of humans ...
have indicated how segregation tends to be higher in face-to-face interactions with neighbors, co-workers, or family members, and reviews of existing research have indicated how available empirical evidence does not support the most pessimistic views about
polarization Polarization or polarisation may refer to: Mathematics *Polarization of an Abelian variety, in the mathematics of complex manifolds *Polarization of an algebraic form, a technique for expressing a homogeneous polynomial in a simpler fashion by ...
. A study conducted by Bakshy, Messing, and Adamic from Facebook and the University of Michigan, for example, has suggested that individuals’ own choices drive algorithmic filtering, limiting exposure to a range of content. While algorithms may not be causing polarization, they could amplify it, representing a significant component of the new information landscape.


Research and use by intelligence and military agencies

The
Joint Threat Research Intelligence Group The Joint Threat Research Intelligence Group (JTRIG) is a unit of the Government Communications Headquarters (GCHQ), the British intelligence agency. The existence of JTRIG was revealed as part of the global surveillance disclosures in documents le ...
unit of the Government Communications Headquarters (GCHQ), the British intelligence agency was revealed as part of the
global surveillance disclosures Global means of or referring to a globe and may also refer to: Entertainment * ''Global'' (Paul van Dyk album), 2003 * ''Global'' (Bunji Garlin album), 2007 * ''Global'' (Humanoid album), 1989 * ''Global'' (Todd Rundgren album), 2015 * Bruno ...
in documents leaked by the former National Security Agency contractor Edward Snowden and its mission scope includes using "dirty tricks" to "destroy, deny, degrade nddisrupt" enemies. Core-tactics include injecting false material onto the Internet in order to destroy the reputation of targets and manipulating online discourse and
activism Activism (or Advocacy) consists of efforts to promote, impede, direct or intervene in social, political, economic or environmental reform with the desire to make changes in society toward a perceived greater good. Forms of activism range fro ...
for which methods such as posting material to the Internet and falsely attributing it to someone else, pretending to be a victim of the target individual whose reputation is intended to be destroyed and posting "negative information" on various forums may be used. Known as "Effects" operations, the work of JTRIG had become a "major part" of GCHQ's operations by 2010. The unit's online propaganda efforts (named "Online Covert Action") utilize "mass messaging" and the "pushing fstories" via the medium of Twitter, Flickr, Facebook and YouTube. Online "
false flag A false flag operation is an act committed with the intent of disguising the actual source of responsibility and pinning blame on another party. The term "false flag" originated in the 16th century as an expression meaning an intentional misr ...
" operations are also used by JTRIG against targets. JTRIG have also changed photographs on social media sites, as well as emailing and texting colleagues and neighbours with "unsavory information" about the targeted individual. In June 2015, NSA files published by Glenn Greenwald revealed new details about JTRIG's work at covertly manipulating online communities. The disclosures also revealed the technique of "credential harvesting", in which journalists could be used to disseminate information and identify non-British journalists who, once manipulated, could give information to the intended target of a secret campaign, perhaps providing access during an interview. It is unknown whether the journalists would be aware that they were being manipulated. Furthermore, Russia is frequently accused of financing "trolls" to post pro-Russian opinions across the Internet. The
Internet Research Agency The Internet Research Agency (IRA; russian: Агентство интернет-исследований, translit=Agentstvo internet-issledovaniy), also known as ''Glavset'' (russian: link=no, Главсеть) and known in Russian Internet sl ...
has become known for employing hundreds of Russians to post propaganda online under fake identities in order to create the illusion of massive support. In 2016 Russia was accused of sophisticated propaganda campaigns to spread
fake news Fake news is false or misleading information presented as news. Fake news often has the aim of damaging the reputation of a person or entity, or making money through advertising revenue.Schlesinger, Robert (April 14, 2017)"Fake news in reality ...
with the goal of punishing Democrat Hillary Clinton and helping Republican Donald Trump during the 2016 presidential election as well as undermining faith in American democracy. In a 2017 report Facebook publicly stated that its site has been exploited by governments for the manipulation of public opinion in other countries – including during the presidential elections in the US and France. It identified three main components involved in an information operations campaign: targeted data collection, content creation and false amplification and includes stealing and exposing information that's not public; spreading stories, false or real, to third parties through fake accounts; and fake accounts being coordinated to manipulate political discussion, such as amplifying some voices while repressing others.


In politics

In 2016
Andrés Sepúlveda Andres or Andrés may refer to: * Andres, Illinois, an unincorporated community in Will County, Illinois, US * Andres, Pas-de-Calais, a commune in Pas-de-Calais, France * Andres (name) * Hurricane Andres * "Andres" (song), a 1994 song by L7 See ...
disclosed that he manipulated public opinion to rig elections in Latin America. According to him with a budget of $600,000 he led a team of hackers that stole campaign strategies, manipulated social media to create false waves of enthusiasm and derision, and installed
spyware Spyware (a portmanteau for spying software) is software with malicious behaviour that aims to gather information about a person or organization and send it to another entity in a way that harms the user—for example, by violating their privac ...
in opposition offices to help
Enrique Peña Nieto Enrique Peña Nieto (; born 20 July 1966), commonly referred to by his initials EPN, is a Mexican politician who served as the 64th president of Mexico from 1 December 2012 to 30 November 2018. A member of the Institutional Revolutionary Party ...
, a right-of-center candidate, win the election. In the run up to India's 2014 elections, both the Bharatiya Janata party (BJP) and the Congress party were accused of hiring "political trolls" to talk favourably about them on blogs and social media. The Chinese government is also believed to run a so-called " 50-cent army" (a reference to how much they are said to be paid) and the " Internet Water Army" to reinforce favourable opinion towards it and the Chinese Communist Party (CCP) as well as to suppress dissent. In December 2014 the Ukrainian information ministry was launched to counter Russian propaganda with one of its first tasks being the creation of social media accounts (also known as the i-Army) and amassing friends posing as residents of eastern Ukraine. Twitter suspended a number of bot accounts that appeared to be spreading pro- Saudi Arabian tweets about the disappearance of Saudi dissident journalist Jamal Khashoggi.


In business and marketing


Trolling and other applications

In April 2009, Internet trolls of
4chan 4chan is an anonymous English-language imageboard website. Launched by Christopher "moot" Poole in October 2003, the site hosts boards dedicated to a wide variety of topics, from anime and manga to video games, cooking, weapons, television, ...
voted
Christopher Poole Christopher Poole (born ), also known online as moot, is an American internet entrepreneur and developer. Poole is known for founding the anonymous English-language imageboard 4chan in October 2003, when he was a still a teenager; he served as ...
, founder of the site, as the world's most influential person of 2008 with 16,794,368 votes by an open Internet poll conducted by ''Time'' magazine. The results were questioned even before the poll completed, as automated voting programs and manual
ballot stuffing Electoral fraud, sometimes referred to as election manipulation, voter fraud or vote rigging, involves illegal interference with the process of an election, either by increasing the vote share of a favored candidate, depressing the vote share of ...
were used to influence the vote. 4chan's interference with the vote seemed increasingly likely, when it was found that reading the first letter of the first 21 candidates in the poll spelled out a phrase containing two 4chan memes: "Marblecake. Also, The Game". Jokesters and politically oriented
hacktivists In Internet activism, hacktivism, or hactivism (a portmanteau of ''hack'' and ''activism''), is the use of computer-based techniques such as hacking as a form of civil disobedience to promote a political agenda or social change. With roots in hack ...
may share sophisticated knowledge of how to manipulate the Web and social media.


Countermeasures

In ''
Wired ''Wired'' (stylized as ''WIRED'') is a monthly American magazine, published in print and online editions, that focuses on how emerging technologies affect culture, the economy, and politics. Owned by Condé Nast, it is headquartered in San Fran ...
'' it was noted that nation-state rules such as compulsory registration and threats of punishment are not adequate measures to combat the problem of online bots. To guard against the issue of prior ratings influencing perception several websites such as Reddit have taken steps such as hiding the vote-count for a specified time. Some other potential measures under discussion are flagging posts for being likely satire or false. For instance in December 2016 Facebook announced that disputed articles will be marked with the help of users and outside fact checkers. The company seeks ways to identify 'information operations' and fake accounts and suspended 30,000 accounts before the presidential election in France in a strike against information operations. Inventor of the
World Wide Web The World Wide Web (WWW), commonly known as the Web, is an information system enabling documents and other web resources to be accessed over the Internet. Documents and downloadable media are made available to the network through web se ...
Tim Berners-Lee Sir Timothy John Berners-Lee (born 8 June 1955), also known as TimBL, is an English computer scientist best known as the inventor of the World Wide Web. He is a Professorial Fellow of Computer Science at the University of Oxford and a profess ...
considers putting few companies in charge of deciding what is or isn't true a risky proposition and states that openness can make the web more truthful. As an example he points to Wikipedia which, while not being perfect, allows anyone to edit with the key to its success being not just the technology but also the governance of the site. Namely, it has an army of countless volunteers and ways of determining what is or isn't true. Furthermore, various kinds of software may be used to combat this problem such as fake checking software or voluntary
browser extension A browser extension is a small software module for customizing a web browser. Browsers typically allow a variety of extensions, including user interface modifications, cookie management, ad blocking, and the custom scripting and styling of web ...
s that store every website one reads or use the
browsing history Web browsing history refers to the list of web pages a user has visited, as well as associated metadata such as page title and time of visit. It is usually stored locally by web browsers in order to provide the user with a history list to go back ...
to deliver fake revelations to those who read a fake story after some kind of consensus was found on the falsehood of a story. Furthermore, Daniel Suarez asks society to value
critical Critical or Critically may refer to: *Critical, or critical but stable, medical states **Critical, or intensive care medicine * Critical juncture, a discontinuous change studied in the social sciences. *Critical Software, a company specializing ...
analytic thinking and suggests education reforms such as the introduction of 'formal logic' as a discipline in schools and training in media literacy and objective evaluation.


Government responses

According to a study of the Oxford Internet Institute, at least 43 countries around the globe have proposed or implemented regulations specifically designed to tackle different aspects of influence campaigns, including fake news, social media abuse, and election interference.


Germany

In Germany, during the period preceding the elections in September 2017, all major political parties save AfD publicly announced that they would not use social bots in their campaigns. Additionally, they committed to strongly condemning such usage of online bots. Moves towards regulation on social media have been made: three German states Hessen, Bavaria, and Saxony-Anhalt proposed in early 2017 a law that would mean social media users could face prosecution if they violate the terms and conditions of a platform. For example, the use of a pseudonym on Facebook, or the creation of fake account, would be punishable by up to one year's imprisonment.


Italy

In early 2018, the Italian Communications Agency AGCOM published a set of guidelines on its website, targeting the elections in March that same year. The six main topics are: # Political Subjects’s Equal Treatment # Political Propaganda’s Transparency # Contents Illicit and Activities Whose Dissemination Is Forbidden (i.e. Polls) # Social Media Accounts of Public Administrations # Political Propaganda is Forbidden on Election Day and Day Before # Recommendations for stronger fact-checking services


France

In November 2018, a law against the manipulation of information was passed in France. The law stipulates that during campaign periods: * Digital platforms must disclose the amount paid for ads and the names of their authors. Past a certain traffic threshold, platforms are required to have a representative present in France, and must publish the algorithms used. * An interim judge may pass a legal injunction to halt the spread of fake news swiftly. 'Fake news' must satisfy the following: (a)it must be manifest; (b) it must be disseminated on a massive scale; and (c) lead to a disturbance of the peace or compromise the outcome of an election.


Malaysia

In April 2018, the Malaysian parliament passed the Anti-Fake News Act. It defined fake news as 'news, information, data and reports which is or are wholly or partly false.' This applied to citizens or those working at a digital publication, and imprisonment of up to 6 years was possible. However, the law was repealed after heavy criticism in August 2018.


Kenya

In May 2018, President Uhuru Kenyatta signed into law the Computer and Cybercrimes bill, that criminalised cybercrimes including cyberbullying and cyberespionage. If a person “intentionally publishes false, misleading or fictitious data or misinforms with intent that the data shall be considered or acted upon as authentic,” they are subject to fines and up to two years imprisonment.


Research

German chancellor
Angela Merkel Angela Dorothea Merkel (; ; born 17 July 1954) is a German former politician and scientist who served as Chancellor of Germany from 2005 to 2021. A member of the Christian Democratic Union (CDU), she previously served as Leader of the Opp ...
has issued the
Bundestag The Bundestag (, "Federal Diet") is the German federal parliament. It is the only federal representative body that is directly elected by the German people. It is comparable to the United States House of Representatives or the House of Commons ...
to deal with the possibilities of political manipulation by social bots or fake news.


See also


Sources


References


External links


How technology is changing the way we think
Daniel Suarez talk on YouTube
How "Bots" Control Your Life
Daniel Suarez talk on YouTube * * WP:PROMO
Make Putin pout with this creepy face-tracking tech
facial expression manipulation {{media manipulation Deception