History of espionage
   HOME

TheInfoList



OR:

Spying, as well as other intelligence assessment, has existed since ancient times. In the 1980s scholars characterized foreign intelligence as "the missing dimension" of historical scholarship." Since then a largely popular and scholarly literature has emerged. Special attention has been paid to World War II, as well as the
Cold War The Cold War is a term commonly used to refer to a period of geopolitical tension between the United States and the Soviet Union and their respective allies, the Western Bloc and the Eastern Bloc. The term '' cold war'' is used because the ...
era (1947–1989) that was a favorite for novelists and filmmakers.Raymond L. Garthoff, "Foreign intelligence and the historiography of the Cold War." ''Journal of Cold War Studies'' 6.2 (2004): 21–56.


Early history

Efforts to use espionage for military advantage are well documented throughout history. Sun Tzu, 4th century BC, a theorist in ancient China who influenced Asian military thinking, still has an audience in the 21st century for the '' Art of War.'' He advised, "One who knows the enemy and knows himself will not be endangered in a hundred engagements." He stressed the need to understand yourself and your enemy for military intelligence. He identified different spy roles. In modern terms, they included the secret informant or agent in place, (who provides copies of enemy secrets), the penetration agent (who has access to the enemy's commanders), and the disinformation agent (who feeds a mix of true and false details to point the enemy in the wrong direction to confuse the enemy). He considered the need for systematic organization and noted the roles of counterintelligence, double agents (recruited from the ranks of enemy spies), and psychological warfare. Sun Tzu continued to influence Chinese espionage theory in the 21st century with its emphasis on using the information to design active subversion. Chanakya (also called Kautilya) wrote his ''
Arthashastra The ''Arthashastra'' ( sa, अर्थशास्त्रम्, ) is an Ancient Indian Sanskrit treatise on statecraft, political science, economic policy and military strategy. Kautilya, also identified as Vishnugupta and Chanakya, is ...
'' in India in the 4th century BC. It was a 'Textbook of Statecraft and Political Economy' that provides a detailed account of intelligence collection, processing, consumption, and covert operations, as indispensable means for maintaining and expanding the security and power of the state. Ancient Egypt had a thoroughly developed system for the acquisition of intelligence. The Hebrews used spies as well, as in the story of Rahab. Thanks to the Bible (Joshua 2:1–24) we have in this story of the spies sent by
Ancient Hebrews The terms ''Hebrews'' (Hebrew language, Hebrew: / , Modern Hebrew, Modern: ' / ', Tiberian vocalization, Tiberian: ' / '; ISO 259-3: ' / ') and ''Hebrew people'' are mostly considered synonymous with the ancient Semitic-speaking peoples, Sem ...
to
Jericho Jericho ( ; ar, أريحا ; he, יְרִיחוֹ ) is a Palestinian city in the West Bank. It is located in the Jordan Valley, with the Jordan River to the east and Jerusalem to the west. It is the administrative seat of the Jericho Gove ...
before attacking the city one of the earliest detailed reports of a very sophisticated intelligence operation Spies were also prevalent in the Greek and Roman empires. During the 13th and 14th centuries, the Mongols relied heavily on espionage in their conquests in Asia and Europe. Feudal Japan often used
shinobi A or was a covert agent or mercenary in feudal Japan. The functions of a ninja included reconnaissance, espionage, infiltration, deception, ambush, bodyguarding and their fighting skills in martial arts, including ninjutsu.Kawakami, pp. 21– ...
to gather intelligence. A significant milestone was the establishment of an effective intelligence service under King David IV of Georgia at the beginning of the 12th century or possibly even earlier. Called ''mstovaris'', these organized spies performed crucial tasks, like uncovering feudal conspiracies, conducting counter-intelligence against enemy spies, and infiltrating key locations, e.g. castles, fortresses and palaces.
Aztecs The Aztecs () were a Mesoamerican culture that flourished in central Mexico in the post-classic period from 1300 to 1521. The Aztec people included different Indigenous peoples of Mexico, ethnic groups of central Mexico, particularly those g ...
used Pochtecas, people in charge of commerce, as spies and diplomats, and had diplomatic immunity. Along with the pochteca, before a battle or war, secret agents, ''quimitchin'', were sent to spy amongst enemies usually wearing the local costume and speaking the local language, techniques similar to modern secret agents.


Early Modern Europe

Many modern espionage methods were established by Francis Walsingham in Elizabethan England. His staff included the cryptographer
Thomas Phelippes Thomas Phelippes (1556–1625), also known as Thomas Phillips was a linguist, who was employed as a forger and intelligence gatherer. He served mainly under Sir Francis Walsingham, in the time of Elizabeth I, and most notably deciphered the code ...
, who was an expert in deciphering letters and forgery, and Arthur Gregory, who was skilled at breaking and repairing
seals Seals may refer to: * Pinniped, a diverse group of semi-aquatic marine mammals, many of which are commonly called seals, particularly: ** Earless seal, or "true seal" ** Fur seal * Seal (emblem), a device to impress an emblem, used as a means of a ...
without detection. Hutchinson, Robert (2007) ''Elizabeth's Spy Master: Francis Walsingham and the Secret War that Saved England''. London: Weidenfeld & Nicolson. . pp. 84–121. The Catholic exiles fought back when the Welsh exile Hugh Owen created an intelligence service that tried to neutralize that of Walsingham. In 1585, Mary, Queen of Scots was placed in the custody of Sir Amias Paulet, who was instructed to open and read all of Mary's clandestine correspondence. In a successful attempt to expose her, Walsingham arranged a single exception: a covert means for Mary's letters to be smuggled in and out of Chartley in a beer keg. Mary was misled into thinking these secret letters were secure, while in reality they were deciphered and read by Walsingham's agents. He succeeded in intercepting letters that indicated a conspiracy to displace Elizabeth I with Mary. In foreign intelligence, Walsingham's extensive network of "intelligencers", who passed on general news as well as secrets, spanned Europe and the Mediterranean. While foreign intelligence was a normal part of the principal secretary's activities, Walsingham brought to it flair and ambition, and large sums of his own money. He cast his net more widely than anyone had attempted before, exploiting links across the continent as well as in Constantinople and
Algiers Algiers ( ; ar, الجزائر, al-Jazāʾir; ber, Dzayer, script=Latn; french: Alger, ) is the capital and largest city of Algeria. The city's population at the 2008 Census was 2,988,145Census 14 April 2008: Office National des Statistiques ...
, and building and inserting contacts among Catholic exiles.


18th century

The 18th century saw a dramatic expansion of espionage activities. It was a time of war: in nine years out of 10, two or more major powers were at war. Armies grew much larger, with corresponding budgets. Likewise the foreign ministries all grew in size and complexity. National budgets expanded to pay for these expansions, and room was found for intelligence departments with full-time staffs, and well-paid spies and agents. The militaries themselves became more bureaucratised, and sent out military attaches. They were very bright, personable middle-ranking officers stationed in embassies abroad. In each capital, the attached diplomats evaluated the strength, capabilities, and war plans of the armies and navies.


France

The Kingdom of France under King Louis XIV (1643–1715) was the largest, richest, and most powerful nation. It had many enemies and a few friends, and tried to keep track of them all through a well organized intelligence system based in major cities all over Europe. France and England pioneered the
cabinet noir In France, the ''cabinet noir'' ( French for " black room", also known as the "dark chamber" or "black chamber") was a government intelligence-gathering office, usually within a postal service, where correspondence between persons or entities wa ...
whereby foreign correspondence was opened and deciphered, then forwarded to the recipient. France's chief ministers, especially Cardinal Mazarin (1642–1661) did not invent the new methods; they combined the best practices from other states, and supported it at the highest political and financial levels. To critics of authoritarian governments, it appeared that spies were everywhere. Parisian dissidents of the 18th century thought that they were surrounded by as many as perhaps 30,000 police spies. However, the police records indicate a maximum of 300 paid informers. The myth was deliberately designed to inspire fear and hypercaution; the police wanted opponents people to think that they were under close watch. The critics also seemed to like the myth, for it gave them a sense of importance and an aura of mystery. Ordinary Parisians felt more secure believing that the police were actively dealing with troublemakers.


British

To deal with the almost continuous wars with France, London set up an elaborate system to gather intelligence on France and other powers. Since the British had deciphered the code system of most states, it relied heavily on intercepted mail and dispatches. A few agents in the postal system could intercept likely correspondence and have it copied and forwarded to the intended receiver, as well as to London. Active spies were also used, especially to estimate military and naval strength and activities. Once the information was in hand, analysts tried to interpret diplomatic policies and intentions of states. Of special concern in the first half of the century were the activities of
Jacobites Jacobite means follower of Jacob or James. Jacobite may refer to: Religion * Jacobites, followers of Saint Jacob Baradaeus (died 578). Churches in the Jacobite tradition and sometimes called Jacobite include: ** Syriac Orthodox Church, sometimes ...
, English supporters of the House of Stuart who had French support in plotting to overthrow the Hanoverian dynasty in England. It was a high priority to find men in England and Scotland who had secret Jacobite sympathies. One highly successful operation took place in the Russian Empire under the supervision of minister Charles Whitworth (1704 to 1712). He closely observed public events and noted the changing power status of key leaders. He cultivated influential and knowledgeable persons at the royal court, and befriended foreigners in Russia's service, and in turn they provided insights into high-level Russian planning and personalities, which he summarized and sent in code to London.


Industrial espionage

In 1719 Britain made it illegal to entice skilled workers to emigrate. Nevertheless, small-scale efforts continued in secret. At mid century, (1740s to 1770s) the French Bureau of Commerce had a budget and a plan, and systematically hired British and French spies to obtain industrial and military technology. They had some success deciphering English technology regarding plate-glass, the hardware and steel industry. They had mixed success, enticing some workers and getting foiled in other attempts. The Spanish were technological laggards, and tried to jump start industry through systematized industrial espionage. The Marquis of Ensenada, a minister of the king, sent trusted military officers on a series of missions between 1748 and 1760. They focused on current technology regarding shipbuilding, steam engines, copper refining, canals, metallurgy, and cannon-making.


American Revolution, 1775–1783

During the American Revolution, 1775–1783, American General
George Washington George Washington (February 22, 1732, 1799) was an American military officer, statesman, and Founding Father who served as the first president of the United States from 1789 to 1797. Appointed by the Continental Congress as commander of th ...
developed a successful espionage system to detect British locations and plans. In 1778, he ordered Major Benjamin Tallmadge to form the Culper Ring to collect information about the British in
New York New York most commonly refers to: * New York City, the most populous city in the United States, located in the state of New York * New York (state), a state in the northeastern United States New York may also refer to: Film and television * '' ...
. Washington was usually mindful of treachery, but he ignored incidents of disloyalty by
Benedict Arnold Benedict Arnold ( Brandt (1994), p. 4June 14, 1801) was an American military officer who served during the Revolutionary War. He fought with distinction for the American Continental Army and rose to the rank of major general before defect ...
, his most trusted general. Arnold tried to betray West Point to the British Army, but was discovered and barely managed to escape. The British intelligence system was weak; it completely missed the movement of the entire American and French armies from the Northeast to Yorktown, Virginia, where they captured the British invasion army in 1781 and won independence. Washington has been called "Americas First Spymaster".


French Revolution and Napoleonic wars, (1793–1815)

The Kingdom of Great Britain, almost continuously at war with France (1793–1815), built a wide network of agents and funded local elements trying to overthrow governments hostile to Britain. It paid special attention to threats of an invasion of the British Isles, and to a possible uprising in Ireland. Britain in 1794 appointed William Wickham as Superintendent of Aliens in charge of espionage and the new secret service. He strengthened the British intelligence system by emphasizing the centrality of the intelligence cycle – query, collection, collation, analysis and dissemination – and the need for an all-source centre of intelligence. Napoleon made heavy use of agents, especially regarding Russia. Besides espionage, they recruited soldiers, collected money, enforced the Continental System against imports from Britain, propagandized, policed border entry into France through passports, and protected the estates of the
Napoleonic nobility As Emperor of the French, Napoleon I created titles of nobility to institute a stable elite in the First French Empire, after the instability resulting from the French Revolution. Like many others, both before and since, Napoleon found that th ...
. His senior men coordinated the policies of satellite countries.


19th century

Modern tactics of espionage and dedicated government intelligence agencies were developed over the course of the late 19th century. A key background to this development was the Great Game, a period denoting the strategic rivalry and conflict that existed between the British Empire and the Russian Empire throughout Central Asia. To counter Russian ambitions in the region and the potential threat it posed to the British position in India, a system of surveillance, intelligence and counterintelligence was built up in the Indian Civil Service. The existence of this shadowy conflict was popularised in Rudyard Kipling's famous spy book, '' Kim'', where he portrayed the Great Game (a phrase he popularised) as an espionage and intelligence conflict that "never ceases, day or night." Although the techniques originally used were distinctly amateurish – British agents would often pose unconvincingly as
botanist Botany, also called , plant biology or phytology, is the science of plant life and a branch of biology. A botanist, plant scientist or phytologist is a scientist who specialises in this field. The term "botany" comes from the Ancient Greek wo ...
s or
archaeologist Archaeology or archeology is the scientific study of human activity through the recovery and analysis of material culture. The archaeological record consists of artifacts, architecture, biofacts or ecofacts, sites, and cultural landscap ...
s – more professional tactics and systems were slowly put in place. In many respects, it was here that a modern intelligence apparatus with permanent bureaucracies for internal and foreign infiltration and espionage was first developed. A pioneering cryptographic unit was established as early as 1844 in India, which achieved some important successes in decrypting Russian communications in the area. The establishment of dedicated intelligence organizations was directly linked to the colonial rivalries between the major European powers and the accelerating development of military technology. An early source of military intelligence was the diplomatic system of
military attaché A military attaché is a military expert who is attached to a diplomatic mission, often an embassy. This type of attaché post is normally filled by a high-ranking military officer, who retains a commission while serving with an embassy. Opport ...
s (an officer attached to the diplomatic service operating through the embassy in a foreign country), that became widespread in Europe after the Crimean War. Although officially restricted to a role of transmitting openly received information, they were soon being used to clandestinely gather confidential information and in some cases even to recruit spies and to operate ''de facto'' spy rings.


American Civil War 1861–1865

Tactical or battlefield intelligence became very vital to both armies in the field during the American Civil War. Allan Pinkerton, who operated a pioneer detective agency, served as head of the Union Intelligence Service during the first two years. He thwarted the assassination plot in Baltimore while guarding President-elect Abraham Lincoln. Pinkerton agents often worked undercover as Confederate States Army soldiers and sympathizers to gather military intelligence. Pinkerton himself served on several undercover missions. He worked across the
Deep South The Deep South or the Lower South is a cultural and geographic subregion in the Southern United States. The term was first used to describe the states most dependent on plantations and slavery prior to the American Civil War. Following the war ...
in the summer of 1861, collecting information on fortifications and Confederate plans. He was found out in Memphis and barely escaped with his life. Pinkerton's agency specialized in counter-espionage, identifying Confederate spies in the
Washington area The Washington metropolitan area, also commonly referred to as the National Capital Region, is the metropolitan area centered on Washington, D.C. The metropolitan area includes all of Washington, D.C. and parts of the states of Maryland, Virgi ...
. Pinkerton played up to the demands of General George McClellan with exaggerated overestimates of the strength of the
Confederate Army of Northern Virginia The Army of Northern Virginia was the primary military force of the Confederate States of America in the Eastern Theater of the American Civil War. It was also the primary command structure of the Department of Northern Virginia. It was most oft ...
. McClellan mistakenly thought he was outnumbered, and played a very cautious role. Spies and scouts typically reported directly to the commanders of armies in the field. They provided details on troop movements and strengths. The distinction between spies and scouts was one that had life or death consequences. If a suspect was seized while in disguise and not in his army's uniform, the sentence was often to be hanged. Intelligence gathering for the Confederates focused on Alexandria, Virginia, and the surrounding area. Thomas Jordan created a network of agents that included Rose O'Neal Greenhow. Greenhow delivered reports to Jordan via the "Secret Line," the system used to smuggle letters, intelligence reports, and other documents to Confederate officials. The Confederacy's Signal Corps was devoted primarily to communications and intercepts, but it also included a covert agency called the
Confederate Secret Service The Confederate Secret Service refers to any of a number of official and semi-official secret service organizations and operations conducted by the Confederate States of America during the American Civil War. Some of the organizations were under t ...
Bureau, which ran espionage and counter-espionage operations in the North including two networks in Washington. In both armies, the cavalry service was the main instrument in military intelligence, using direct observation, Drafting map, and obtaining copies of local maps and local newspapers. When General
Robert E. Lee Robert Edward Lee (January 19, 1807 – October 12, 1870) was a Confederate general during the American Civil War, towards the end of which he was appointed the overall commander of the Confederate States Army. He led the Army of Nort ...
invaded Pennsylvania in the Gettysburg campaign of June 1863, his cavalry commander
J. E. B. Stuart James Ewell Brown "Jeb" Stuart (February 6, 1833May 12, 1864) was a United States Army officer from Virginia who became a Confederate States Army general during the American Civil War. He was known to his friends as "Jeb,” from the initials of ...
went on a long unauthorized raid, so Lee was operating blind, unaware that he was being trapped by Union forces. Lee later said that his Gettysburg campaign, "was commenced in the absence of correct intelligence. It was continued in the effort to overcome the difficulties by which we were surrounded."


Military Intelligence


Austria

Shaken by the revolutionary years 1848–1849, the Austrian Empire founded the
Evidenzbureau The k.u.k. Evidenzbureau (modernized spelling ''Evidenzbüro'') was the directorate of military intelligence of the Austro-Hungarian Empire, headquartered in Vienna, Austria. Foundation Founded in 1850 as the first permanent military intell ...
in 1850 as the first permanent military intelligence service. It was first used in the 1859 Austro-Sardinian war and the 1866 campaign against Prussia, albeit with little success. The bureau collected intelligence of military relevance from various sources into daily reports to the Chief of Staff ''(Generalstabschef)'' and weekly reports to Emperor Franz Joseph. Sections of the Evidenzbureau were assigned different regions; the most important one was aimed against Russia.


Great Britain

During the Crimean War of 1854, the Topographical & Statistic Department T&SD was established within the British War Office as an embryonic military intelligence organization. The department initially focused on the accurate mapmaking of strategically sensitive locations and the collation of militarily relevant statistics. After the deficiencies in the British Army's performance during the war became known, a large-scale reform of army institutions was overseen by Edward Cardwell. As part of this, the T&SD was reorganized as the
Intelligence Branch The Intelligence Branch (french: links=no, Branche du service du renseignement) is a personnel branch of the Canadian Forces (CF) that is concerned with providing relevant and correct information to enable commanders to make decisions. The branch ...
of the War Office in 1873 with the mission to "collect and classify all possible information relating to the strength, organization etc. of foreign armies... to keep themselves acquainted with the progress made by foreign countries in military art and science..."


France

The French Ministry of War authorized the creation of the Deuxième Bureau on June 8, 1871, a service charged with performing "research on enemy plans and operations."Anciens des Services Spéciaux de la Défense Nationale
( France )
This was followed a year later by the creation of a military counter-espionage service. It was this latter service that was discredited through its actions over the notorious Dreyfus Affair, where a
French Jewish The history of the Jews in France deals with Jews and Jewish communities in France since at least the Early Middle Ages. France was a centre of Jewish learning in the Middle Ages, but persecution increased over time, including multiple expulsio ...
officer was falsely accused of handing over military secrets to the Germans. As a result of the political division that ensued, responsibility for counter-espionage was moved to the civilian control of the Ministry of the Interior.


Germany

Field Marshal Helmuth von Moltke the Younger established a military intelligence unit, Abteilung (Section) IIIb, to the German General Staff in 1889 which steadily expanded its operations into France and Russia.


Italy

The Italian ''Ufficio Informazioni del Comando Supremo'' was put on a permanent footing in 1900.


Russia

After Russia's defeat in the Russo-Japanese War of 1904–05, Russian military intelligence was reorganized under the 7th Section of the 2nd executive board of the great imperial headquarters.


Naval Intelligence

It was not just the army that felt a need for military intelligence. Soon, naval establishments were demanding similar capabilities from their national governments to allow them to keep abreast of technological and strategic developments in rival countries. The Naval Intelligence Division was set up as the independent intelligence arm of the
British Admiralty The Admiralty was a department of the Government of the United Kingdom responsible for the command of the Royal Navy until 1964, historically under its titular head, the Lord High Admiral – one of the Great Officers of State. For much of it ...
in 1882 (initially as the Foreign Intelligence Committee) and was headed by Captain
William Henry Hall Captain (Royal Navy), Captain William Henry Hall (20 April 1842 – 10 March 1895) was the first Naval Intelligence Division (United Kingdom), Director of Naval Intelligence of the Royal Navy. Hall was thought of highly by John Fisher, 1st Baron ...
. The division was initially responsible for fleet mobilization and war plans as well as foreign intelligence collection; in the 1900s two further responsibilities – issues of strategy and defence and the protection of merchant shipping – were added. In the United States the Naval intelligence originated in 1882 "for the purpose of collecting and recording such naval information as may be useful to the Department in time of war, as well as in peace." This was followed in October 1885 by the Military Information Division, the first standing military intelligence agency of the United States with the duty of collecting military data on foreign nations. In 1900, the Imperial German Navy established the Nachrichten-Abteilung, which was devoted to gathering intelligence on Britain. The navies of Italy, Russia and Austria-Hungary set up similar services as well.


Counterintelligence

As espionage became more widely used, it became imperative to expand the role of existing police and internal security forces into a role of detecting and countering foreign spies. The Austro-Hungarian Evidenzbureau was entrusted with the role from the late 19th century to counter the actions of the Pan-Slavist movement operating out of Serbia. Russia's
Okhrana The Department for Protecting the Public Security and Order (russian: Отделение по охранению общественной безопасности и порядка), usually called Guard Department ( rus, Охранное отд ...
was formed in 1880 to combat political terrorism and left-wing revolutionary activity throughout the Russian Empire, but was also tasked with countering enemy espionage. Its main concern was the activities of revolutionaries, who often worked and plotted subversive actions from abroad. It created an antenna in Paris run by Pyotr Rachkovsky to monitor their activities. The agency used many methods to achieve its goals, including covert operations, undercover agents, and "perlustration" — the interception and reading of private correspondence. The Okhrana became notorious for its use of agents provocateurs who often succeeded in penetrating the activities of revolutionary groups including the Bolsheviks. In the 1890s
Alfred Dreyfus Alfred Dreyfus ( , also , ; 9 October 1859 – 12 July 1935) was a French artillery officer of Jewish ancestry whose trial and conviction in 1894 on charges of treason became one of the most polarizing political dramas in modern French history. ...
, a Jewish artillery captain in the French Army, was twice falsely convicted of passing military secrets to the Germans. The case convulsed France regarding antisemitism and xenophobia for a decade until he was fully exonerated. It raised public awareness of the rapidly developing world of espionage. Responsibility for military counter-espionage was passed in 1899 to the Sûreté générale – an agency originally responsible for order enforcement and public safety – and overseen by the Ministry of the Interior. In Britain the Second Boer War (1899–1902) saw a difficult and highly controversial victory over hard-fighting Boer Commandos in South Africa. One response was to build up counterinsurgency policies. After that came the "Edwardian Spy-Fever," with rumors of German spies under every bed.


20th century


Civil intelligence agencies

In Britain, the
Secret Service Bureau The Secret Intelligence Service (SIS), commonly known as MI6 ( Military Intelligence, Section 6), is the foreign intelligence service of the United Kingdom, tasked mainly with the covert overseas collection and analysis of human intelligenc ...
was split into a foreign and counter-intelligence domestic service in 1910. The latter, headed by Sir Vernon Kell, originally aimed at calming public fears of large-scale German espionage. As the Service was not authorized with police powers, Kell liaised extensively with the
Special Branch Special Branch is a label customarily used to identify units responsible for matters of national security and Intelligence (information gathering), intelligence in Policing in the United Kingdom, British, Commonwealth of Nations, Commonwealth, ...
of
Scotland Yard Scotland Yard (officially New Scotland Yard) is the headquarters of the Metropolitan Police, the territorial police force responsible for policing Greater London's 32 boroughs, but not the City of London, the square mile that forms London's ...
(headed by Basil Thomson), and succeeded in disrupting the work of Indian revolutionaries collaborating with the Germans during the war. Integrated intelligence agencies run directly by governments were also established. The British
Secret Service Bureau The Secret Intelligence Service (SIS), commonly known as MI6 ( Military Intelligence, Section 6), is the foreign intelligence service of the United Kingdom, tasked mainly with the covert overseas collection and analysis of human intelligenc ...
(SIS from ) was founded in 1909 as the first independent and interdepartmental agency fully in control over all British government espionage activities. At a time of widespread and growing anti-German feeling and fear, plans were drawn up for an extensive offensive intelligence system to be used as an instrument in the event of a European war. Due to intense lobbying by William Melville after he obtained German mobilization plans and proof of German financial support to the Boers, the government authorized the creation of a new intelligence section in the War Office, MO3 (subsequently re-designated "M05"), headed by Melville, in 1903. Working under cover from a flat in London, Melville ran both counterintelligence and foreign-intelligence operations, capitalizing on the knowledge and foreign contacts he had accumulated during his years running
Special Branch Special Branch is a label customarily used to identify units responsible for matters of national security and Intelligence (information gathering), intelligence in Policing in the United Kingdom, British, Commonwealth of Nations, Commonwealth, ...
. Due to its success, the Government Committee on Intelligence, with support from
Richard Haldane Richard Burdon Haldane, 1st Viscount Haldane, (; 30 July 1856 – 19 August 1928) was a British lawyer and philosopher and an influential Liberal and later Labour politician. He was Secretary of State for War between 1905 and 1912 during whi ...
(the Secretary of State for War) and from
Winston Churchill Sir Winston Leonard Spencer Churchill (30 November 187424 January 1965) was a British statesman, soldier, and writer who served as Prime Minister of the United Kingdom twice, from 1940 to 1945 Winston Churchill in the Second World War, dur ...
(the President of the Board of Trade), established the Secret Service Bureau in 1909. It consisted of nineteen military-intelligence departments – MI1 to MI19, but MI5 and MI6 came to be the most recognized as they are the only ones to have remained active to this day. The Bureau was a joint initiative of the Admiralty, the War Office and the
Foreign Office Foreign may refer to: Government * Foreign policy, how a country interacts with other countries * Ministry of Foreign Affairs, in many countries ** Foreign Office, a department of the UK government ** Foreign office and foreign minister * Unit ...
to control secret-intelligence operations in the UK and overseas, particularly concentrating on the activities of the Imperial German Government. Its first director was Captain Sir George Mansfield Smith-Cumming. In 1910, the bureau was split into naval and army sections which, over time, specialised in foreign espionage and internal counter-espionage activities respectively. The Secret Service initially focused its resources on gathering intelligence on German shipbuilding plans and operations. The SIS onsciously refrained from conducting espionage activity in France so as not to jeopardize the burgeoning alliance between the two countries. For the first time, the government had access to a peacetime, centralized independent intelligence bureaucracy with indexed registries and defined procedures, as opposed to the more ''ad hoc'' methods used previously. Instead of a system whereby rival departments and military services would work on their own priorities with little to no consultation or co-operation with each other, the newly established
Secret Intelligence Service The Secret Intelligence Service (SIS), commonly known as MI6 ( Military Intelligence, Section 6), is the foreign intelligence service of the United Kingdom, tasked mainly with the covert overseas collection and analysis of human intelligenc ...
was interdepartmental, and submitted its intelligence reports to all relevant government departments.


First World War

By the outbreak of the First World War in 1914 all the major powers had highly sophisticated structures in place for the training and handling of spies and for the processing of the intelligence information obtained through espionage. The Dreyfus Affair of 1894-1906, which involved accusations of international espionage and treason, contributed much to public interest in espionage from 1894 onwards. The '' spy novel'' emerged as a distinct genre of fiction in the late-19th century; it dealt with themes such as colonial rivalry, the growing threat of conflict in Europe and the revolutionary and
anarchist Anarchism is a political philosophy and movement that is skeptical of all justifications for authority and seeks to abolish the institutions it claims maintain unnecessary coercion and hierarchy, typically including, though not neces ...
domestic threats. '' The Riddle of the Sands'' (1903) by Erskine Childers defined the genre: the novel played on public fears of a German plan to invade Britain (an amateur spy uncovers the nefarious plot). In the wake of Childers's success there followed a flood of imitators, including William Le Queux and
E. Phillips Oppenheim Edward Phillips Oppenheim (22 October 1866 – 3 February 1946) was an English novelist, a prolific writer of best-selling genre fiction, featuring glamorous characters, international intrigue and fast action. Notably easy to read, they were vie ...
. The First World War (1914–1918) saw the honing and refinement of modern espionage techniques as all the belligerent powers utilized their intelligence services to obtain military intelligence, to commit acts of sabotage and to carry out propaganda. As the battle fronts became static and armies dug down in trenches, cavalry reconnaissance became of very limited effectiveness. Information gathered at the
battlefront In a military context, the term front can have several meanings. According to official US Department of Defense and NATO definitions, a front can be "the line of contact of two opposing forces."Leonard, B. (2011). Department of Defense Diction ...
from the interrogation of prisoners-of-war typically could give insight only into local enemy actions of limited duration. To obtain high-level information on an enemy's strategic intentions, its military capabilities and deployment, required undercover spy-rings operating deep in enemy territory. On the Western Front the advantage lay with the Western Allies, as for most of the war the
Imperial German Army The Imperial German Army (1871–1919), officially referred to as the German Army (german: Deutsches Heer), was the unified ground and air force of the German Empire. It was established in 1871 with the political unification of Germany under the l ...
occupied Belgium and parts of northern France amidst a large and disaffected native population that agents could organize into collecting and transmitting vital intelligence. British and French intelligence services recruited Belgian or French refugees and infiltrated these agents behind enemy lines via the Netherlands – a neutral country. Many collaborators were then recruited from the local population, who were mainly driven by patriotism and hatred of the harsh German occupation. By the end of the war the Allies had set up over 250 networks, comprising more than 6,400 Belgian and French citizens. These rings concentrated on infiltrating the German railway network so that the Allied powers could receive advance warning of strategic movements of troops and ammunition. In 1916 Walthère Dewé founded the Dame Blanche ("White Lady") network as an underground intelligence group which became the most effective Allied spy-ring in German-occupied Belgium. It supplied as much as 75% of the intelligence collected from occupied Belgium and northern France to the Allies. By the end of the war, its 1,300 agents covered all of occupied Belgium, northern France and, through a collaboration with the Alice Network led by
Louise de Bettignies Louise Marie Jeanne Henriette de Bettignies (; 15 July 1880 - 27 September 1918) was a French secret agent who spied on the Germans for the British during World War I using the pseudonym of Alice Dubois. She was arrested in October 1915 and impr ...
, occupied Luxembourg. The network was able to provide a crucial few days warning before the launch of the German 1918 Spring Offensive. German intelligence was only ever able to recruit a very small number of spies. These were trained at an academy run by the Kriegsnachrichtenstelle (War Intelligence Office) in
Antwerp Antwerp (; nl, Antwerpen ; french: Anvers ; es, Amberes) is the largest city in Belgium by area at and the capital of Antwerp Province in the Flemish Region. With a population of 520,504,
and headed by Elsbeth Schragmüller, known as "Fräulein Doktor". These agents were generally isolated and unable to rely on a large support network for the relaying of information. The most famous German spy was Margaretha Geertruida Zelle, a Dutch exotic dancer with the stage name Mata Hari. As a Dutch subject, she was able to cross national borders freely. In 1916 she was arrested and brought to London where she was interrogated at length by Sir Basil Thomson, Assistant Commissioner at New Scotland Yard. She eventually claimed to be working for French intelligence. In fact, she had entered German service from 1915, and sent her reports to the mission in the German embassy in Madrid. In January 1917, the German
military attaché A military attaché is a military expert who is attached to a diplomatic mission, often an embassy. This type of attaché post is normally filled by a high-ranking military officer, who retains a commission while serving with an embassy. Opport ...
in Madrid transmitted radio messages to Berlin describing the helpful activities of a German spy code-named H-21. French intelligence-agents intercepted the messages and, from the information contained, identified H-21 as Mata Hari. She was executed by firing squad on 15 October 1917. German spies in Britain did not meet with much success – the German spy-ring operating in Britain was successfully disrupted by MI5 under Vernon Kell on the day after the declaration of the war. Home Secretary, Reginald McKenna, announced that "within the last twenty-four hours no fewer than twenty-one spies, or suspected spies, have been arrested in various places all over the country, chiefly in important military or naval centres, some of them long known to the authorities to be spies", One exception was Jules C. Silber, who evaded MI5 investigations and obtained a position at the British censor's office in 1914. Using mailed window-envelopes that had already been stamped and cleared he was able to forward microfilm to Germany that contained increasingly important information. Silber was regularly promoted and ended up in the position of chief censor, which enabled him to analyze all suspect documents. The British economic blockade of Germany was made effective through the support of spy networks operating out of the neutral Netherlands. Agents on the ground determined points of weakness in the naval blockade and relayed this information to the Royal Navy. The blockade led to severe food deprivation in Germany contributed greatly to the collapse of the Central Powers' war effort in 1918.


Codebreaking

Two new methods for intelligence collection developed over the course of the war – aerial reconnaissance and photography; and the interception and decryption of radio signals. The British rapidly built up great expertise in the newly emerging field of signals intelligence and codebreaking. In 1911, a subcommittee of the
Committee of Imperial Defence The Committee of Imperial Defence was an important ''ad hoc'' part of the Government of the United Kingdom and the British Empire from just after the Second Boer War until the start of the Second World War. It was responsible for research, and som ...
on cable communications concluded that in the event of war with Germany, German-owned submarine cables should be destroyed. On the night of 3 August 1914, the cable ship ''Alert'' located and cut Germany's five trans-Atlantic cables, which ran under the English Channel. Soon after, the six cables running between Britain and Germany were cut. As an immediate consequence, there was a significant increase in messages sent via cables belonging to other countries, and by radio. These could now be intercepted, but codes and ciphers were naturally used to hide the meaning of the messages, and neither Britain nor Germany had any established organisations to decode and interpret such messages. At the start of the war, the navy had only one wireless station for intercepting messages, at
Stockton-on-Tees Stockton-on-Tees, often simply referred to as Stockton, is a market town in the Borough of Stockton-on-Tees in County Durham, England. It is on the northern banks of the River Tees, part of the Teesside built-up area. The town had an estimated ...
. However, installations belonging to the Post Office and the Marconi Company, as well as private individuals who had access to radio equipment, began recording messages from Germany. Room 40, formed in October 1914 under Director of Naval Education Alfred Ewing, was the section in the British Admiralty most identified with the British crypto analysis effort during the war. The basis of Room 40 operations evolved around an Imperial German Navy codebook, the ''Signalbuch der Kaiserlichen Marine'' (SKM), and around maps (containing coded squares), which were obtained from three different sources in the early months of the war. Alfred Ewing directed Room 40 until May 1917, when direct control passed to Captain (later Admiral) Reginald "Blinker" Hall, assisted by
William Milbourne James Admiral Sir William Milbourne James, (22 December 1881 – 17 August 1973) was a British naval commander, politician and author. He served in the Royal Navy from the early 20th century to the Second World War. During the First World War, he wa ...
. A similar organization began in the Military Intelligence department of the War Office, which become known as MI1b, and Colonel Macdonagh proposed that the two organizations should work together, decoding messages concerning the Western Front in France. A sophisticated interception system (known as 'Y' service), together with the post office and Marconi receiving stations, grew rapidly to the point it could intercept almost all official German messages. As the number of intercepted messages increased it became necessary to decide which were unimportant and should just be logged, and which should be passed on to Room 40. The German fleet was in the habit each day of wirelessing the exact position of each ship and giving regular position-reports when at sea. It was possible to build up a precise picture of the normal operation of the High Seas Fleet, indeed to infer from the routes they chose where defensive minefields had been placed and where it was safe for ships to operate. Whenever the British detected a change to the normal pattern, it immediately signalled that some operation was about to take place and a warning could be given. Detailed information about submarine movements was also available. Both the British and German interception services began to experiment with direction-finding radio equipment at the start of 1915. Captain
H. J. Round Captain Henry Joseph Round (2 June 1881 – 17 August 1966) was an English engineer and one of the early pioneers of radio. He was the first to report observation of electroluminescence from a solid state diode, leading to the discovery of the l ...
, working for Marconi, had been carrying out experiments for the army in France, and Hall instructed him to build a direction-finding system for the navy. Stations were built along the coast, and by May 1915 the Admiralty was able to track German submarines crossing the North Sea. Some of these stations also acted as 'Y' stations to collect German messages, but a new section was created within Room 40 to plot the positions of ships from the directional reports. The German fleet made no attempts to restrict its use of wireless until 1917, and then only in response to perceived British use of direction finding, not because it believed messages were being decoded. Room 40 played an important role in several naval engagements during the war, notably in detecting major German sorties into the North Sea that led to the battles of Dogger Bank (1915) and Jutland (1916) when the British fleet was sent out to intercept them. However its most important contribution was probably in
decrypting In cryptography, encryption is the process of encoding information. This process converts the original representation of the information, known as plaintext, into an alternative form known as ciphertext. Ideally, only authorized parties can decip ...
the Zimmermann Telegram, a telegram from the German Foreign Office sent via Washington to its
ambassador An ambassador is an official envoy, especially a high-ranking diplomat who represents a state and is usually accredited to another sovereign state or to an international organization as the resident representative of their own government or sov ...
Heinrich von Eckardt Heinrich von Eckardt (20 July 1861, in Riga, Russian Empire – 3 March 1944, in Jena, Germany) was a Baltic German diplomat in the service of the German Empire. Life and work After studying jurisprudence at the University of Jena from 1881 to 1 ...
in Mexico in January 1917. In the telegram's plain text, Nigel de Grey and William Montgomery learned of the German Foreign Minister
Arthur Zimmermann Arthur Zimmermann (5 October 1864 – 6 June 1940) was State Secretary for Foreign Affairs of the German Empire from 22 November 1916 until his resignation on 6 August 1917. His name is associated with the Zimmermann Telegram during World War ...
's offer to Mexico to join the war as a German ally. The telegram was made public by the United States, which declared war on Germany on 6 April 1917. This event demonstrated how the course of a war could be changed by effective intelligence operations. The British were reading the Americans' secret messages by late 1915.


Russian Revolution

The outbreak of revolution in Russia in March 1917 and the subsequent seizure of power in November 1917 by the Bolsheviks, a party deeply hostile towards the capitalist powers, was an important catalyst for the development of modern international espionage techniques. A key figure was Sidney Reilly, a Russian-born adventurer and secret agent employed by
Scotland Yard Scotland Yard (officially New Scotland Yard) is the headquarters of the Metropolitan Police, the territorial police force responsible for policing Greater London's 32 boroughs, but not the City of London, the square mile that forms London's ...
and the
Secret Intelligence Service The Secret Intelligence Service (SIS), commonly known as MI6 ( Military Intelligence, Section 6), is the foreign intelligence service of the United Kingdom, tasked mainly with the covert overseas collection and analysis of human intelligenc ...
. He set the standard for modern espionage, turning it from a gentleman's amateurish game to a ruthless and professional methodology for the achievement of military and political ends. Reilly's career culminated in a failed attempt to depose the Russian Soviet Federative Socialist Republic and assassinate
Vladimir Ilyich Lenin Vladimir Ilyich Ulyanov. ( 1870 – 21 January 1924), better known as Vladimir Lenin,. was a Russian revolutionary, politician, and political theorist. He served as the first and founding head of government of Soviet Russia from 1917 to 19 ...
in 1918.Richard B. Spence, ''Trust No One: The Secret World Of Sidney Reilly''; 2002, Feral House, . Another pivotal figure was Sir
Paul Dukes Sir Paul Henry Dukes (10 February 1889 – 27 August 1967) was a British MI6 officer and author. Early life and family Paul Henry Dukes was born the third of five children on 10 February 1889 in Bridgwater, Somerset, England. He was the ...
(1889-1967), arguably the first professional spy of the modern age. Recruited personally by Mansfield Smith-Cumming to act as a secret agent in
Imperial Russia The Russian Empire was an empire and the final period of the List of Russian monarchs, Russian monarchy from 1721 to 1917, ruling across large parts of Eurasia. It succeeded the Tsardom of Russia following the Treaty of Nystad, which ended th ...
, he set up elaborate plans to help prominent White Russians escape from Soviet prisons after the October Revolution and smuggled hundreds of them into Finland. Known as the "Man of a Hundred Faces", Dukes continued his use of disguises, which aided him in assuming a number of identities and gained him access to numerous Bolshevik organizations. He successfully infiltrated the
Communist Party of the Soviet Union "Hymn of the Bolshevik Party" , headquarters = 4 Staraya Square, Moscow , general_secretary = Vladimir Lenin (first) Mikhail Gorbachev (last) , founded = , banned = , founder = Vladimir Lenin , newspaper ...
, the
Comintern The Communist International (Comintern), also known as the Third International, was a Soviet Union, Soviet-controlled international organization founded in 1919 that advocated world communism. The Comintern resolved at its Second Congress to ...
, and the political police, or
CHEKA The All-Russian Extraordinary Commission ( rus, Всероссийская чрезвычайная комиссия, r=Vserossiyskaya chrezvychaynaya komissiya, p=fsʲɪrɐˈsʲijskəjə tɕrʲɪzvɨˈtɕæjnəjə kɐˈmʲisʲɪjə), abbreviated ...
. Dukes also learned of the inner workings of the
Politburo A politburo () or political bureau is the executive committee for communist parties. It is present in most former and existing communist states. Names The term "politburo" in English comes from the Russian ''Politbyuro'' (), itself a contraction ...
, and passed the information to British intelligence. In the course of a few months in 1918-1919, Dukes, Hall, and Reilly succeeded in infiltrating Lenin's inner circle, and gaining access to the activities of the
Cheka The All-Russian Extraordinary Commission ( rus, Всероссийская чрезвычайная комиссия, r=Vserossiyskaya chrezvychaynaya komissiya, p=fsʲɪrɐˈsʲijskəjə tɕrʲɪzvɨˈtɕæjnəjə kɐˈmʲisʲɪjə), abbreviated ...
and the Communist International at the highest level. This helped to convince the British government of the importance of a well-funded secret-intelligence service in peacetime as a key component in formulating foreign policy. Churchill, once again a member of the UK cabinet in this period, argued that intercepted communications were more useful "as a means of forming a true judgment of public policy than any other source of knowledge at the disposal of the State."


Interwar


Nazi Germany

The intelligence gathering efforts of Nazi Germany (1933-1945) were largely ineffective. Berlin operated two espionage networks against the United States. Both suffered from careless recruiting, inadequate planning, and faulty execution. The FBI captured bungling spies, while poorly-designed sabotage efforts all failed. Adolf Hitler's anti-Semitic prejudices about Jewish control of the U.S. interfered with objective evaluation of American capabilities. Hitler's propaganda chief
Joseph Goebbels Paul Joseph Goebbels (; 29 October 1897 – 1 May 1945) was a German Nazi politician who was the ''Gauleiter'' (district leader) of Berlin, chief propagandist for the Nazi Party, and then Reich Minister of Propaganda from 1933 to 19 ...
deceived top officials who repeated his propagandistic exaggerations.


Soviet Union

The Soviet GRU (military intelligence), originating in 1918, started operating throughout the world. Communist sympathisers and fellow-travellers in groups aligned with the
Comintern The Communist International (Comintern), also known as the Third International, was a Soviet Union, Soviet-controlled international organization founded in 1919 that advocated world communism. The Comintern resolved at its Second Congress to ...
(founded in 1919 and operating until 1943) were also widespread.


Second World War


Britain MI6 and Special Operations Executive

Churchill's order to "set Europe ablaze," was undertaken by the British Secret Service or
Secret Intelligence Service The Secret Intelligence Service (SIS), commonly known as MI6 ( Military Intelligence, Section 6), is the foreign intelligence service of the United Kingdom, tasked mainly with the covert overseas collection and analysis of human intelligenc ...
, who developed a plan to train spies and saboteurs. Eventually, this would become the
SOE SOE may refer to: Organizations * State-owned enterprise * Special Operations Executive, a British World War II clandestine sabotage and resistance organisation ** Special Operations Executive in the Netherlands, or Englandspiel * Society of Opera ...
or Special Operations Executive, and to ultimately involve the United States in their training facilities.
Sir William Stephenson Sir William Samuel Stephenson (23 January 1897 – 31 January 1989), born William Samuel Clouston Stanger, was a Canadian soldier, fighter pilot, businessman and spymaster who served as the senior representative of the British Security Coord ...
, the senior British intelligence officer in the western hemisphere, suggested to President Roosevelt that
William J. Donovan William Joseph "Wild Bill" Donovan (January 1, 1883 – February 8, 1959) was an American soldier, lawyer, intelligence officer and diplomat, best known for serving as the head of the Office of Strategic Services (OSS), the precursor to the Bur ...
devise a plan for an intelligence network modeled after the British Secret Intelligence Service or MI6 and Special Operations Executive's (SOE) framework. Accordingly, the first American
Office of Strategic Services The Office of Strategic Services (OSS) was the intelligence agency of the United States during World War II. The OSS was formed as an agency of the Joint Chiefs of Staff (JCS) to coordinate espionage activities behind enemy lines for all branc ...
(OSS) agents in Canada were sent for training in a facility set up by Stephenson, with guidance from English intelligence instructors, who provided the OSS trainees with the knowledge needed to come back and train other OSS agents. Setting
German-occupied Europe German-occupied Europe refers to the sovereign countries of Europe which were wholly or partly occupied and civil-occupied (including puppet governments) by the military forces and the government of Nazi Germany at various times between 1939 an ...
ablaze with sabotage and partisan resistance groups was the mission. Through covert special operations teams, operating under the new Special Operations Executive (SOE) and the OSS' Special Operations teams, these men would be infiltrated into occupied countries to help organize local resistance groups and supply them with logistical support: weapons, clothing, food, money, and direct them in attacks against the Axis powers. Through subversion, sabotage, and the direction of local guerrilla forces, SOE British agents and OSS teams had the mission of infiltrating behind enemy lines and wreaked havoc on the German infrastructure, so much, that an untold number of men were required to keep this in check, and kept the Germans off balance continuously like the French
maquis Maquis may refer to: Resistance groups * Maquis (World War II), predominantly rural guerrilla bands of the French Resistance * Spanish Maquis, guerrillas who fought against Francoist Spain in the aftermath of the Spanish Civil War * The network ...
. They actively resisted the German occupation of France, as did the Greek People's Liberation Army (ELAS) partisans who were armed and fed by both the OSS and SOE during the German occupation of Greece.


MAGIC: U.S. breaks Japanese code

''Magic'' was an American cryptanalysis project focused on Japanese codes in the 1930s and 1940s. It involved the U.S. Army's Signals Intelligence Service (SIS) and the U.S. Navy's Communication Special Unit. Magic combined cryptologic capabilities into the Research Bureau with Army, Navy and civilian experts all under one roof. Their most important successes involved RED, BLUE, and PURPLE. In 1923, a United States Navy officer acquired a stolen copy of the Secret Operating Code codebook used by the Imperial Japanese Navy during World War I. Photographs of the codebook were given to the cryptanalysts at the Research Desk and the processed code was kept in red-colored folders (to indicate its Top Secret classification). This code was called "RED". In 1930, Japan created a more complex code that was codenamed BLUE, although RED was still being used for low-level communications. It was quickly broken by the Research Desk no later than 1932. US Military Intelligence COMINT listening stations began monitoring command-to-fleet, ship-to-ship, and land-based communications for BLUE messages. After Germany declared war in 1939, it sent technical assistance to upgrade Japanese communications and cryptography capabilities. One part was to send them modified Enigma machines to secure Japan's high-level communications with Germany. The new code, codenamed PURPLE (from the color obtained by mixing red and blue), baffled the codebreakers until they realized that it was not a manual additive or substitution code like RED and BLUE, but a machine-generated code similar to Germany's Enigma cipher. Decoding was slow and much of the traffic was still hard to break. By the time the traffic was decoded and translated, the contents were often out of date. A reverse-engineered machine could figure out some of the PURPLE code by replicating some of the settings of the Japanese Enigma machines. This sped up decoding and the addition of more translators on staff in 1942 made it easier and quicker to decipher the traffic intercepted. The Japanese Foreign Office used a cipher machine to encrypt its diplomatic messages. The machine was called " PURPLE" by U.S. cryptographers. A message was typed into the machine, which enciphered and sent it to an identical machine. The receiving machine could decipher the message only if set to the correct settings, or
keys Key or The Key may refer to: Common meanings * Key (cryptography), a piece of information that controls the operation of a cryptography algorithm * Key (lock), device used to control access to places or facilities restricted by a lock * Key (map ...
. American cryptographers built a machine that could decrypt these messages. The PURPLE machine itself was first used by Japan in 1940. U.S. and British cryptographers had broken some PURPLE traffic well before the attack on Pearl Harbor in December 1941, but the Japanese diplomats did not know or transmit any details.. The Japanese Navy used a completely different system, known as JN-25. U.S. cryptographers had decrypted and translated the 14-part Japanese PURPLE message breaking off ongoing negotiations with the U.S. at 1 p.m. Washington time on 7 December 1941, even before the Japanese Embassy in Washington could do so. As a result of the deciphering and typing difficulties at the embassy, the note was formally delivered after the attack began. Throughout the war, the Allies routinely read both German and Japanese cryptography. The Japanese Ambassador to Germany, General
Hiroshi Ōshima Baron was a general in the Imperial Japanese Army, Japanese ambassador to Germany before and during World War II and (unwittingly) a major source of communications intelligence for the Allies. His role was perhaps best summed up by General Geo ...
, routinely sent priceless information about German plans to Tokyo. This information was routinely intercepted and read by Roosevelt, Churchill and Eisenhower. Japanese diplomats assumed their PURPLE system was unbreakable and did not revise or replace it.


United States OSS

President Franklin D. Roosevelt was obsessed with intelligence and deeply worried about German sabotage. However, there was no overarching American intelligence agency, and Roosevelt let the Army, the Navy, the State Department, and various other sources compete against each other, so that all the information poured into the White House, but was not systematically shared with other agencies. The British Secret Service fascinated Roosevelt early on, and to him, an intelligence service modeled on the British was necessary to prevent false reports (e.g. the Germans having designs to take over Latin America). Roosevelt followed MAGIC intercept to Japan religiously, but set it up so that the Army and Navy briefed him on alternating days. Finally he turned to William (Wild Bill) Donovan to run a new agency the Office of the Coordinator of Information (COI) which in 1942 became the
Office of Strategic Services The Office of Strategic Services (OSS) was the intelligence agency of the United States during World War II. The OSS was formed as an agency of the Joint Chiefs of Staff (JCS) to coordinate espionage activities behind enemy lines for all branc ...
or OSS. It became Roosevelt's most trusted source of secrets, and after the war OSS eventually became the CIA. The COI had a staff of 2,300 in June 1942; OSS reached 5,000 personnel by September 1943. In all 35,000 men and women served in the OSS by the time it closed in 1947. The Army and Navy were proud of their long-established intelligence services and avoided the OSS as much as possible, banning it from the Pacific theaters. The Army tried and failed to prevent OSS operations in China. An agreement with Britain in 1942 divided responsibilities, with SOE taking the lead for most of Europe, including the Balkans and OSS took primary responsibility for China and North Africa. OSS experts and spies were trained at facilities in the United States and around the world. The military arm of the OSS, was the Operational Group Command (OGC), which operated sabotage missions in the European and Mediterranean theaters, with a special focus on Italy and the Balkans. OSS was a rival force with SOE in the
Italian Civil War The Italian Civil War (Italian language, Italian: ''Guerra civile italiana'', ) was a civil war in the Kingdom of Italy fought during World War II by Italian Fascists against the Italian resistance movement, Italian partisans (mostly politically ...
in aiding and directing
Italian resistance movement The Italian resistance movement (the ''Resistenza italiana'' and ''la Resistenza'') is an umbrella term for the Italian resistance groups who fought the occupying forces of Nazi Germany and the fascist collaborationists of the Italian Social ...
groups. The "Research and Analysis" branch of OSS brought together numerous academics and experts who proved especially useful in providing a highly detailed overview of the strengths and weaknesses of the German war effort. In direct operations it was successful in supporting
Operation Torch Operation Torch (8 November 1942 – Run for Tunis, 16 November 1942) was an Allies of World War II, Allied invasion of French North Africa during the Second World War. Torch was a compromise operation that met the British objective of secu ...
in French North Africa in 1942, where it identified pro-Allied potential supporters and located landing sites. OSS operations in neutral countries, especially Stockholm, Sweden, provided in-depth information on German advanced technology. The Madrid station set up agent networks in France that supported the Allied invasion of southern France in 1944. Most famous were the operations in Switzerland run by
Allen Dulles Allen Welsh Dulles (, ; April 7, 1893 – January 29, 1969) was the first civilian Director of Central Intelligence (DCI), and its longest-serving director to date. As head of the Central Intelligence Agency (CIA) during the early Cold War, he ov ...
that provided extensive information on German strength, air defenses, submarine production, the
V-1 V1, V01 or V-1 can refer to version one (for anything) (e.g., see version control) V1, V01 or V-1 may also refer to: In aircraft * V-1 flying bomb, a World War II German weapon * V1 speed, the maximum speed at which an aircraft pilot may abort ...
, V-2 rockets,
Tiger tank Tiger tank may refer to: *Tiger I, or ''Panzerkampfwagen'' Tiger ''Ausf. E'', a German heavy tank produced from 1942 to 1944 *Tiger II, or ''Panzerkampfwagen'' Tiger ''Ausf. B'', a German heavy tank produced from 1943 to 1945, also known as ''Kön ...
s and aircraft (
Messerschmitt Bf 109 The Messerschmitt Bf 109 is a German World War II fighter aircraft that was, along with the Focke-Wulf Fw 190, the backbone of the Luftwaffe's fighter force. The Bf 109 first saw operational service in 1937 during the Spanish Civil War an ...
, Messerschmitt Me 163 Komet, etc.). It revealed some of the secret German efforts in chemical and biological warfare. They also received information about mass executions and concentration camps. The resistance group around the later executed priest Heinrich Maier, which provided much of this information, was then uncovered by a double spy who worked for the OSS, the German
Abwehr The ''Abwehr'' (German for ''resistance'' or ''defence'', but the word usually means ''counterintelligence'' in a military context; ) was the German military-intelligence service for the ''Reichswehr'' and the ''Wehrmacht'' from 1920 to 1944. A ...
and even the Sicherheitsdienst of the SS. Despite the Gestapo's use of torture, the Germans were unable to uncover the true extent of the group's success, particularly in providing information for Operation Crossbow and Operation Hydra, both preliminary missions for
Operation Overlord Operation Overlord was the codename for the Battle of Normandy, the Allies of World War II, Allied operation that launched the successful invasion of German-occupied Western Front (World War II), Western Europe during World War II. The operat ...
. Switzerland's station also supported resistance fighters in France and Italy, and helped with the surrender of German forces in Italy in 1945.


Counterespionage

Informants were common in World War II. In November 1939, the German Hans Ferdinand Mayer sent what is called the Oslo Report to inform the British of German technology and projects in an effort to undermine the Nazi regime. The
Réseau AGIR The Réseau AGIR ( en, Network for ACTION) was a World War II espionage group founded by French wartime resister Michel Hollard that provided decisive human intelligence on V-1 flying bomb facilities in the North of France. Thanks to Hollard's r ...
was a French network developed after the fall of France that reported the start of construction of V-weapon installations in
Occupied France The Military Administration in France (german: Militärverwaltung in Frankreich; french: Occupation de la France par l'Allemagne) was an interim occupation authority established by Nazi Germany during World War II to administer the occupied zo ...
to the British. The MI5 in Britain and the FBI in the U.S. identified all the German spies, and "turned" all but one into double agents so that their reports to Berlin were actually rewritten by counterespionage teams. The FBI had the chief role in American counterespionage and rounded up all the German spies in June 1941. Counterespionage included the use of turned Double Cross agents to misinform Nazi Germany of impact points during the Blitz and internment of Japanese in the US against "Japan's wartime spy program". Additional WWII espionage examples include Soviet spying on the US Manhattan project, the German Duquesne Spy Ring convicted in the US, and the Soviet Red Orchestra spying on Nazi Germany.


Cold War Period

After 1990s new memoirs and archival materials have opened up the study of espionage and intelligence during the Cold War. Scholars are reviewing how its origins, its course, and its outcome were shaped by the intelligence activities of the United States, the Soviet Union, and other key countries. Special attention is paid to how complex images of one's adversaries were shaped by secret intelligence that is now publicly known. All major powers engaged in espionage, using a great variety of spies, double agents, and new technologies such as the tapping of telephone cables. The most famous and active organizations were the American
CIA The Central Intelligence Agency (CIA ), known informally as the Agency and historically as the Company, is a civilian intelligence agency, foreign intelligence service of the federal government of the United States, officially tasked with gat ...
, the Soviet KGB, and the British MI6. The East German
Stasi The Ministry for State Security, commonly known as the (),An abbreviation of . was the Intelligence agency, state security service of the East Germany from 1950 to 1990. The Stasi's function was similar to the KGB, serving as a means of maint ...
, unlike the others, was primarily concerned with internal security, but its
Main Directorate for Reconnaissance The Main Directorate for Reconnaissance (german: ; german: , ) was the foreign intelligence service of the Ministry of State Security (''Stasi''), the main security agency of the German Democratic Republic (East Germany), from 1955 to 1990. ...
operated espionage activities around the world. The CIA secretly subsidized and promoted anti-communist cultural activities and organizations. The CIA was also involved in European politics, especially in Italy. Espionage took place all over the world, but Berlin was the most important battleground for spying activity. Enough top secret archival information has been released so that historian Raymond L. Garthoff concludes there probably was parity in the quantity and quality of secret information obtained by each side. However, the Soviets probably had an advantage in terms of HUMINT (espionage) and "sometimes in its reach into high policy circles." In terms of decisive impact, however, he concludes: :We also can now have high confidence in the judgment that there were no successful “moles” at the political decision-making level on either side. Similarly, there is no evidence, on either side, of any major political or military decision that was prematurely discovered through espionage and thwarted by the other side. There also is no evidence of any major political or military decision that was crucially influenced (much less generated) by an agent of the other side. The USSR and East Germany proved especially successful in placing spies in Britain and West Germany. Moscow was largely unable to repeat its successes from 1933 to 1945 in the United States. NATO, on the other hand, also had a few successes of importance, of whom Oleg Gordievsky was perhaps the most influential. He was a senior KGB officer who was a double agent on behalf of Britain's MI6, providing a stream of high-grade intelligence that had an important influence on the thinking of Margaret Thatcher and
Ronald Reagan Ronald Wilson Reagan ( ; February 6, 1911June 5, 2004) was an American politician, actor, and union leader who served as the 40th president of the United States from 1981 to 1989. He also served as the 33rd governor of California from 1967 ...
in the 1980s. He was spotted by
Aldrich Ames Aldrich Hazen "Rick" Ames (; born May 26, 1941) is a former Central Intelligence Agency (CIA) officer turned KGB double agent, who was convicted of espionage in 1994. He is serving a life sentence, without the possibility of parole, in the Federa ...
a Soviet agent who worked for the CIA, but he was successfully exfiltrated from Moscow in 1985. Biographer Ben McIntyre argues he was the West's most valuable human asset, especially for his deep psychological insights into the inner circles of the
Kremlin The Kremlin ( rus, Московский Кремль, r=Moskovskiy Kreml', p=ˈmɐˈskofskʲɪj krʲemlʲ, t=Moscow Kremlin) is a fortified complex in the center of Moscow founded by the Rurik dynasty, Rurik dynasty. It is the best known of th ...
. He convinced Washington and London that the fierceness and bellicosity of the Kremlin was a product of fear, and military weakness, rather than an urge for world conquest. Thatcher and Reagan concluded they could moderate their own anti-Soviet rhetoric, as successfully happened when
Mikhail Gorbachev Mikhail Sergeyevich Gorbachev (2 March 1931 – 30 August 2022) was a Soviet politician who served as the 8th and final leader of the Soviet Union from 1985 to dissolution of the Soviet Union, the country's dissolution in 1991. He served a ...
took power, thus ending the Cold War. In addition to usual espionage, the Western agencies paid special attention to debriefing
Eastern Bloc defectors Eastern may refer to: Transportation *China Eastern Airlines, a current Chinese airline based in Shanghai *Eastern Air, former name of Zambia Skyways *Eastern Air Lines, a defunct American airline that operated from 1926 to 1991 *Eastern Air Li ...
.


Middle East

The United Kingdom's MI6 was involved in the region to protect its interests, notably collaborating with the CIA in Iran, to bring back Shah
Mohammad Reza Pahlavi , title = Shahanshah Aryamehr Bozorg Arteshtaran , image = File:Shah_fullsize.jpg , caption = Shah in 1973 , succession = Shah of Iran , reign = 16 September 1941 – 11 February 1979 , coronation = 26 October ...
to power in a coup in 1953, after the Prime Minister Mohammad Mosaddegh attempted to nationalise the
Anglo-Persian Oil Company The Anglo-Persian Oil Company (APOC) was a British company founded in 1909 following the discovery of a large oil field in Masjed Soleiman, Persia (Iran). The British government purchased 51% of the company in 1914, gaining a controlling number ...
. The CIA operated with the intent to curtail the influence of the USSR known as the Eisenhower Doctrine, by funding anti-communist organisations such as the Grey Wolves in Turkey. Middle Eastern states developed sophisticated intelligence and security agencies referred to as Mukhabarat ( Arabic: المخابرات ''El Mukhabarat''), primarily used domestically for population control and
surveillance Surveillance is the monitoring of behavior, many activities, or information for the purpose of information gathering, influencing, managing or directing. This can include observation from a distance by means of electronic equipment, such as c ...
, notably in Iran, Egypt, Iraq and Syria under Ba'athism, Ba'athist rule and Libya. According to Owen L. Sirrs, the Six-Day War, 1967 War between Israel and the Arab coalition of Egypt, Syria and Jordan, signalled a failure by Egyptian intelligence to adequately evaluate the military capabilities of their foes. The Yom Kippur War can be attributed to intelligence failure on the side of Israel, caused by a over confidence that Egypt and Syria were not reading for an invasion, despite intelligence proving the contrary provided by high ranking Egyptian Official Ashraf Marwan.


Post-Cold War

In the United States, there are seventeen (taking military intelligence into consideration, it's 22 agencies) federal agencies that form the United States Intelligence Community. The Central Intelligence Agency operates the National Clandestine Service (NCS) to collect human intelligence and perform Covert operations. The National Security Agency collects Signals Intelligence. Originally the CIA spearheaded the US-IC. Following the September 11 attacks the Office of the Director of National Intelligence (ODNI) was created to promulgate information-sharing. Since the 19th century new approaches have included professional police organizations, the police state and geopolitics. New intelligence methods have emerged, most recently imagery intelligence, signals intelligence, cryptanalysis and spy satellites.


Counter-terrorism

Western intelligence agencies have progressively turned from traditional state spying to missions resembling international policing: the tracking, spying, arrest and interrogation of high-profile targets in prevention of terrorist threats. During The Troubles, the MI5, British Security Service (MI5) created a counterterrorism cell in response to the activities of the Irish Republican Army, active in Northern Ireland and mainland Britain, including the interception of arms shipment from Libya. In France, the General Directorate for Internal Security (DGSI) engaged in counter-terrorism already in the 1980s in the context of active Basque nationalism, Basque and Corsican nationalism, Corsican nationalist movements, as well as Middle Eastern Organisations such as the Palestinian Abu Nidal Organization and the Lebanese Hezbollah. In the 1990s, Western Intelligence services started to pay increasingly attention to Islamic terrorism, Islamic Terrorism, notably due to the 1993 World Trade Center bombing, bombing of the World Trade Center in 1993 and the attacks on the 1995 France bombings, French Public Transport in 1995 by the Armed Islamic Group of Algeria, Algerian Armed Islamic Group (GIA). Islamic Terrorism became the primary focus of the US Intelligence services after the September 11 attacks, 9/11 Attacks by Al-Qaeda, leading to the United States invasion of Afghanistan, Invasion of Afghanistan and Iraq War, Iraq, and ultimately to the tracking and killing of Osama bin Laden, Osama Ben Laden in 2011. Traditional human intelligence is obsolete when it concerns Islamic terrorist organisations for several reasons: infiltrating such organisations is more difficult than dealing with states, recruiting from within is significantly riskier for loyalty reasons, and working with informants that are engaged in attacks poses ethical concerns. Counter-terrorism information gathering strategies rely on collaboration with foreign intelligence services and prisoner interrogation.


War in Afghanistan 2001 - 2021

In December 2009, Jordanian doctor Humam Khalil Abu-Mulal al-Balawi, Humam al-Balawi performed a suicide bomb attack at the Camp Chapman attack, Camp Chapman American military base near Khost which led to the death of 7 CIA operatives, including the chief of the base, one Jordanian intelligence officer and an afghan driver.


Iraq War 2003 - 2011

The most dramatic failure of intelligence in this era was the false discovery of weapons of mass destruction in Ba'athist Iraq in 2003. American and British intelligence agencies agreed on balance that the WMD were being built and would threaten the peace. They launched a full-scale invasion that overthrew the Iraqi government of Saddam Hussein. The result was decades of turmoil and large-scale violence. There were in fact no weapons of mass destruction, but the Iraqi government had pretended they existed so that it could deter the sort of attack that in fact resulted.


Israel

In Israel, the Shin Bet unit is the agency for homeland security and counter intelligence. The department for secret and confidential counter terrorist operations is called Kidon. It is part of the national intelligence agency Mossad and can also operate in other capacities. Kidon was described as "an elite group of expert assassins who operate under the Kidon, Caesarea branch of the espionage organization." The unit only recruits from "former soldiers from the elite Sayeret, IDF special force units."Yaakov Katz (journalist), Yaakov Katz ''Israel Vs. Iran: The Shadow War'', Potomac Books, Inc, 2012, page 91, By Yaakov Katz, Yoaz Hendel There is almost no reliable information available on this ultra-secret organisation.


Cyber Espionage


The Panama Papers

On May 6, 2016, documents entitled the "Panama Papers" provided by a John Doe were leaked online revealing the operations of over 214,000 shell companies from all over the world. The leak was announced on April 3, 2016, before being published on the International Consortium of Investigative Journalists’ (ICIJ) website. The Panama Papers targeted law firm and offshore service provider Mossack Fonseca, Mossack Fonseca & Co., as well as their clients. In total, 11.5 million confidential documents were published online. The leaked documents exposed how companies used offshore vehicles to evade taxation and to fund bribes that would be used to coerce corruptible countries into contracts. The documents also exposed all parties involved, from shareholders to directors, and their relationships to each other. Individuals using company funds for personal use was also revealed, such as Russian president Vladimir Putin using funds to pay for his daughter’s wedding. The documents revealed that Pakistani prime minister Nawaz Sharif was found to be untruthful regarding how he financed his family homes, which led to his disqualification and removal from power. Other notable people involved include former vice-president of Iraq Ayad Allawi, and former president of Egypt Alaa Mubarak. Since the release of the Panama Papers, expropriation has become harder to disguise and resulted in many companies reducing their tax avoidance. Company values have reduced an average of 0.9%. The documents have sparked new debates on the ethics of offshore vehicles and tax havens. In March 2018, Mossack Fonesca & Co. officially ceased operation.


The Palestine Papers

On the 23rd of January 2011 more than 1600 pages of confidential documents from the peace negotiations between the Israeli government and Palestine Liberation Organization (PLO) were leaked to news channel Al Jazeera, al-Jazeera. These documents contained "memos, emails, maps, minutes of private meetings, accounts of high-level exchanges, strategy papers, and Power Point presentations" that occurred as early as 1991. Topics include the Israeli settlement in East Jerusalem, refugees and their right to return, the United Nations Fact Finding Mission on the Gaza Conflict, Goldstone Report, security cooperation, the Gaza Strip, and Hamas. These documents were shocking to the public as they exposed the failure of the negotiations between Israel and Palestine (region), Palestine. Palestinians were angered due to the amendable nature of the Palestinian negotiators, as well as the condescending attitude the Israelis and Americans had towards said Palestinian negotiators. Another revelation from the leak was the rebuttal of the belief that Palestinians were uncooperative during negotiations with the papers revealing Israel and the Americans were being disruptive. The papers revealed the Palestinian negotiators working against Palestinian popular opinion, such as exchanging land in the Muslim Quarter (Jerusalem), Arab Quarter for land elsewhere or willingness to define Israel as a Jewish state in exchange for refugees. Many interpreted these decisions as evidence of weakness in the negotiators; though some sympathised with the negotiators, believing they did what was required for peace. Palestinian negotiator, Saeb Erekat, Saed Erekat called the documents lies, but also went on to say that the papers were non-binding and that “nothing is agreed until everything is agreed”. People from both parties condemned the release of these documents, some denouncing their authenticity and questioning the motives of whoever released them. Some believe the documents to be fabricated, anti-Israeli propaganda as the leak coincides with al-Jazeera's airing of programs on the Jerusalem settlements. Allegedly, the documents were leaked by multiple members of staff who worked within the negotiations, though some believe French-Palestinian lawyer Ziyad Clot was the source of the leak. Following the leak, protests occurred in Israel and Palestine, as well as in other countries over the world. People began to question whether peace is a possible outcome in Israel and Palestine, and if the United States are capable of being a neutral party during peace talks.


List of famous spies

* Reign of Elizabeth I of England *: Sir Francis Walsingham *: Christopher Marlowe#Spying, Christopher Marlowe *English Commonwealth *: John Thurloe, Cromwell's spy chief * American Revolution *: Thomas Knowlton, first American Spy *: Nathan Hale *: Hercules Mulligan *: John Andre *: James Armistead *: Benjamin Tallmadge, case agent who organized of the Culper spy ring in New York City * Napoleonic Wars *: Karl Schulmeister, Charles-Louis Schulmeister *: William Wickham (spymaster), William Wickham * American Civil War *: One of the innovations in the American Civil War was the use of proprietary companies for intelligence collection by the Union; see Allan Pinkerton. *:
Confederate Secret Service The Confederate Secret Service refers to any of a number of official and semi-official secret service organizations and operations conducted by the Confederate States of America during the American Civil War. Some of the organizations were under t ...
*: Belle Boyd *: Harriet Tubman * Aceh War *: Christiaan Snouck Hurgronje * Second Boer War *: Fritz Joubert Duquesne *: Sidney Reilly * Russo-Japanese War *: Sidney Reilly *: Ho Liang-Shung *: Akashi Motojiro *Arab–Israeli conflict, Arab-Israeli Conflict *: Eli Cohen *: Ashraf Marwan *:


World War I

* Fritz Joubert Duquesne * Jules C. Silber * Mata Hari * Howard Burnham * T.E. Lawrence * Sidney Reilly * Maria de Victorica * Elsbeth Schragmüller * 11 German spies were executed in the Tower of London.


Gender roles

Spying has sometimes been considered a gentlemanly pursuit, with recruiting focused on military officers, or at least on persons of the class from whom officers are recruited. However, the demand for male soldiers, an increase in women's rights, and the tactical advantages of female spies led the British Special Operations Executive (SOE) to set aside any lingering Victorian Era prejudices and begin employing women in April 1942. Their task was to transmit information from Nazi occupied France back to Allied Forces. The main strategic reason was that men in France faced a high risk of being interrogated by Nazi troops but women were less likely to arouse suspicion. In this way they made good couriers and proved equal to, if not more effective than, their male counterparts. Their participation in Organization and Radio Operation was also vital to the success of many operations, including the main network between Paris and London.


See also

* Intelligence agency ** Human intelligence (intelligence gathering), or HUMINT ** Imagery intelligence, or IMINT ** Signals intelligence, or SIGINT * List of German spies, Germany * Kenpeitai, the Japanese Secret Intelligence Services to 1945 ** List of Japanese spies, 1930–45 * KGB, in Soviet Union * Nuclear espionage ** Atomic spies in 1940s * Recruitment of spies ** List of imprisoned spies ** Sexpionage ** Sleeper agent * Soviet espionage in the United States ** List of Americans in the Venona papers * Spy fiction ** List of fictional secret agents * List of British spies, United Kingdom * United States government security breaches ** Espionage Act of 1917 in United States * List of spies in World War II, World War II espionage **
Office of Strategic Services The Office of Strategic Services (OSS) was the intelligence agency of the United States during World War II. The OSS was formed as an agency of the Joint Chiefs of Staff (JCS) to coordinate espionage activities behind enemy lines for all branc ...
, United States, World War II ** Special Operations Executive, of Great Britain in Second World War


References


Further reading

* Andrew, Christopher. ''The Secret World: A History of Intelligence'' (2018) 940pp. covers ancient history to present
excerpt
* Becket, Henry S. A. ''Dictionary of Espionage: Spookspeak into English'' (1986)' covers 2000 terms * Besik, Aladashvili. ''Fearless: A Fascinating Story of Secret Medieval Spies'' (2017
excerpt
* Buranelli, Vincent, and Nan Buranelli. ''Spy Counterspy an Encyclopedia of Espionage'' (1982), 360pp * Burton, Bob. ''Dictionary of Espionage and Intelligence'' (2014) 800+ terms used in international and covert espionage * Dover, R., M.S. Goodman, and C. Hillebrand, eds. ''Routledge Companion to Intelligence Studies'' (2014). * Garthoff, Raymond L. "Foreign intelligence and the historiography of the Cold War." ''Journal of Cold War Studies'' 6.2 (2004): 21–56
abstract
* Haslam,Jonathan and Karina Urbach, eds. ''Secret Intelligence in the European States System, 1918–1989'' (2014) covers USSR, Britain, France, East Germany and West Germany * Hughes-Wilson, John. ''The Secret State: A History of Intelligence and Espionage'' (2017

* Jeffreys-Jones Rhodri. ''In spies we trust: the story of Western intelligence'' (2015)-870190-3. * Kahn, David. ''The Codebreakers: The Comprehensive History of Secret Communication from Ancient Times to the Internet'' (2nd ed. 1996) * Keegan, John. ''Intelligence In War: Knowledge of the Enemy from Napoleon to Al-Qaeda'' (2003) * Knightley, Philip ''The Second Oldest Profession: Spies and Spying in the Twentieth Century'' (1986)
online free to read
* Lerner, K. Lee and Brenda Wilmoth Lerner, eds. ''Encyclopedia of Espionage, Intelligence and Security'' (3 vol. 2003) 1100 pages, 800 entries; emphasis 1990 to present * Owen, David. ''Hidden Secrets: A Complete History of Espionage and the Technology Used to Support It'' (2002) * Polmar, Norman, and Thomas Allen. ''Spy Book: The Encyclopedia of Espionage'' (2nd ed. 2004) 752pp 2000+ entrie
online free to read
* Richelson, Jeffery T. ''A Century of Spies: Intelligence in the Twentieth Century'' (1997) * Trahair, Richard and Robert L. Miller. ''Encyclopedia of Cold War Espionage, Spies, and Secret Operations'' (2nd ed. 2004) 572pp; 300+ entries; * Warner, Michael. ''The Rise and Fall of Intelligence: An International Security History'' (2014
excerpt
* Woods, Brett F. ''Neutral Ground: A Political History of Espionage Fiction'' (2008)


World War I

* Andrew, Christopher. ''The Defence of the Realm: The Authorized History of MI5'' (Allen Lane 2009) Section A * Boghardt, Thomas. ''Spies of the Kaiser: German Covert Operations in Great Britain during the First World War Era'' (2004). * Boghardt, Thomas. ''The Zimmermann telegram: intelligence, diplomacy, and America's entry into World War I'' (2012). * Dockrill, Michael. and David French, eds. ''Strategy and Intelligence: British Policy During the First World War'' (1996). * Debruyne, Emmanuel. "Espionage" In: Ute Daniel, et al. eds. ''1914-1918-online: International Encyclopedia of the First World War'
online
22 page scholarly histor
full text
* Finnegan, Terrance. "The Origins of Modern Intelligence, Surveillance, and Reconnaissance: Military Intelligence at the Front, 1914–18," ''Studies in Intelligence'' 53#4 (2009) pp. 25–40. * Foley, Robert T. "Easy Target or Invincible Enemy? German Intelligence Assessments of France Before the Great War." ''Journal of Intelligence History'' 5#2 (2005): 1–24. * Hiley, Nicholas. "Counter-espionage and Security in Great Britain during the First World War," ''English Historical Review'' 101#3 (1986) pp. 635–70 * Hiley, Nicholas. "The Failure of British Counter-espionage against Germany, 1907–1914," ''Historical Journal'' 28#4 (1985) pp. 835–62. * Hiley, Nicholas. "Entering the Lists: MI5's Great Spy Round-up of August 1914." ''Intelligence and National Security'' 21#1 (2006) pp. 46–76. * Kahn, David. "Codebreaking in World Wars I and II: The Major Successes and Failures, Their Causes and Their Effects", ''Historical Journal'' 23#3 (1980) pp. 617–39. * Larsen, Daniel. "Intelligence in the First World War: The state of the field." ''Intelligence and National Security'' 29.2 (2014): 282–302, comprehensive overview * Larsen, Daniel. "British codebreaking and American diplomatic telegrams, 1914–1915." ''Intelligence and National Security'' 32.2 (2017): 256–263. The British read the American secrets from late 191
online
* May, Ernest R. ed. ''Knowing One's Enemy: Intelligence Assessment Before the two World Wars'' (1984) * Mount, Graeme. ''Canada's Enemies: Spies and Spying in the Peaceable Kingdom'' (1993) ch.3. * Pöhlmann, Markus. "German Intelligence at War, 1914–1918." ''Journal of Intelligence History'' 5.2 (2005): 25–54. * Seligmann, Matthew. ''Spies in Uniform: British Military and Naval Intelligence on the Eve of the First World War''. (2006) * Spence, Richard B. "K.A. Jahnke and the German Sabotage Campaign in the United States and Mexico, 1914–1918," ''Historian'' 59#1 (1996) pp. 89–112. * Witcover, Jules. '' Sabotage at Black Tom: Imperial Germany's Secret War in America, 1914–1917'' (1989).


Interwar and World War II, 1919–1945

* Breuer, William B. ''The Secret War with Germany: Deception, Espionage, and Dirty Tricks, 1939–1945'' (Presidio Press, 1988). * Chambers II, John Whiteclay. ''OSS Training in the National Parks and Service Abroad in World War II'' (NPS, 2008)
online
chapters 1–2 and 8–11 provide a useful summary history of OSS by a scholar. * Crowdy, Terry. ''Deceiving Hitler: Double Cross and Deception in World War II'' (Osprey, 2008). * De Jong, Louis. ''The German Fifth Column in the Second World War'' (1953) covers activities in all major countries.
online
* Drea, Edward J. ''MacArthur's ULTRA: Codebreaking and the War against Japan, 1942–1945'' (1992). * Farago, Ladislas. ''The game of the foxes: the untold story of German espionage in the United States and Great Britain during World War II'' (1971), popular. * Haufler, Hervie. ''Codebreakers' Victory: How the Allied Cryptographers Won World War II'' (2014). * Hinsley, F. H., et al. ''British Intelligence in the Second World War'' (6 vol. 1979). ** Beesly, Patrick, et al. "What You Don't Know by What You Do Know." ''International History Review'' 5#2 (1983): 279–290
online review
* Jackson, Peter, and Joseph Maiolo. "Strategic intelligence, Counter-Intelligence and Alliance Diplomacy in Anglo-French relations before the Second World War." ''Militärgeschichtliche Zeitschrift'' 65.2 (2006): 417–462.
online in English
{cbignore, bot=medic * Jörgensen, Christer. ''Spying for the Fuhrer: Hitler's Espionage Machine'' (2014). * Kahn, David. "Codebreaking in World Wars I and II: The Major Successes and Failures, Their Causes and Their Effects", ''Historical Journal'' 23#3 (1980) pp. 617–39. * Lewin, Ronald. ''The American magic: codes, ciphers, and the defeat of Japan'' (1984). * Masterman, J. C. ''The Double-Cross System: The Incredible True Story of How Nazi Spies Were Turned into Double Agents'' (1972)
excerpt
* Mauch, Christof. ''The Shadow War Against Hitler: The Covert Operations of America's Wartime Secret Intelligence Service'' (2005), scholarly history of OSS. * May, Ernest R. ed. ''Knowing One's Enemy: Intelligence Assessment Before the two World Wars'' (1984) * Murray, Williamson, and Allan Reed Millett, eds. ''Calculations: net assessment and the coming of World War II'' (1992). * Paine, Lauran. ''German Military Intelligence in World War II: The Abwehr'' (1984). * Persico, Joseph E. ''Roosevelt's secret war: FDR and World War II espionage'' (2001) * Smith, Richard. ''OSS: The Secret History of America's First Central Intelligence Agency'' (U of California Press, 1972

* Sexton Jr., Donal J. ''Signals Intelligence in World War II: A Research Guide'' (1996) evaluates 800 primary and secondary sources * Smith, Bradley F. ''The Shadow Warriors: OSS and the Origins of the CIA'' (1983) for U.S.A. * Special Operations Executive. ''How to be a Spy: The World War II SOE Training Manual'' (1943, 2001) How to become a British spy
online free
* Stephan, Robert W. ''Stalin's secret war: Soviet counterintelligence against the Nazis, 1941–1945'' (2004).


France

* Alexander, Martin S. "Did the Deuxième Bureau work? The role of intelligence in French defence policy and strategy, 1919–39." ''Intelligence and National Security'' 6.2 (1991): 293–333. * Bauer, Deborah Susan. ''Marianne is Watching: Knowledge, Secrecy, Intelligence and the Origins of the French Surveillance State (1870–1914).'' (PhD Dissertation, UCLA, 2013.
Online
Bibliography pp 536–59. * Deacon, Richard. ''The French Secret Service ''(1990). * Jackson, Peter. ''France and the Nazi Menace: Intelligence and Policy Making, 1933–1939'' (2000). * Keiger, John. ''France and the World since 1870'' (2001) ch 4: "French Intelligence" pp 80–109. * Porch, Douglas. ''The French Secret Services: A History of French Intelligence from the Dreyfus Affair to the Gulf War'' (2003).

als
online review
* Whitcomb, Edward A. "The Duties and Functions of Napoleon's External Agents." ''History'' 57.190 (1972): 189–204.


England and Great Britain

* Andrew, Christopher. ''The Defence of the Realm: The Authorized History of MI5'' (2009). * Andrew, Christopher. ''Her Majesty's Secret Service: the making of the British intelligence community'' (1986
online free to read
* Budiansky, Stephen. ''Her Majesty's Spymaster: Elizabeth I, Sir Francis Walsingham, and the Birth of Modern Espionage''. (2005
online free to read
* Fergusson, Thomas G. ''British military intelligence, 1870–1914: the development of a modern intelligence organization'' (1984
online free to read
* Foot, M. R. D. ''SOE: the Special Operations Executive 1940–46'' (1990
online free to read
British agents in Europe * Jeffreys-Jones, Rhodri. ''In Spies We Trust: The Story of Western Intelligence'' (2013), covers U.S. and Britain * Johnson, Robert. ''Spying for Empire: The Great Game in Central and South Asia, 1757–1947'' (2006), Britain versus Russia. * Major, Patrick, and Christopher R. Moran, eds. ''Spooked: Britain, Empire and Intelligence since 1945'' (2009)
excerpt
* Moran, Christopher R. "The pursuit of intelligence history: Methods, sources, and trajectories in the United Kingdom." ''Studies in Intelligence'' 55.2 (2011): 33–55. Historiograph
online
* Thomas, Gordon. ''Secret wars: one hundred years of British intelligence inside MI5 and MI6'' (2009
online free to read
* Tuchman, Barbara W. ''The Zimmermann Telegram'' (1966) how Britain broke Germany's code in 1917 * Walton, Calder. ''Empire of Secrets: British Intelligence in the Cold War and the Twilight of Empire'' (2014). * West, Nigel. ''MI6: British Secret Intelligence Service Operations 1909–1945'' (1983).


Russia/USSR

* Al'bats, Evgeniia. ''The State within a State: The KGB and Its Hold on Russia – Past, Present, and Future'' (1994) * Andrew, Christopher and Oleg Gordievsky. ''KGB: The Inside Story of Its Foreign Operations from Lenin to Gorbachev'' (1992) * Daly, Jonathan W. ''The Watchful State: Security Police and Opposition in Russia, 1906–1917'' (2004) * Halsam, Jonathan. ''Near and distant neighbours. A new history of Soviet intelligence'' (2015); 390pp. * Hingley, Ronald. ''The Russian Secret Police: Muscovite, Imperial Russian and Soviet Political Security Operations'' (1971). * Hughes, R. Gerald, and Arne Kislenko. "'Fear Has Large Eyes': The History of Intelligence in the Soviet Union." ''Journal of Slavic Military Studies'' (2017): 639–653.
online
* Macintyre, Ben. ''A Spy Among Friends: Kim Philby and the Great Betrayal'' (2014), Soviet spies in UK. * Marten, Kimberly. "The 'KGB State' and Russian Political and Foreign Policy Culture." ''Journal of Slavic Military Studies'' 30.2 (2017): 131–151. * Pandis, Robert. ''CHEKA – The History, Organization and Awards of the Russian Secret Police & Intelligence Services 1917–2017'' (2017), covers GPU, OGPU, NKVD, MVD, MOOP, KGB, PGU, FSB, SVR, and GRU. * Pringle, Robert W. ''Historical dictionary of Russian and Soviet intelligence'' (2015). * Ruud, Charles A. and Sergei A. Stepanov. ''Fontanka 16: The Tsars' Secret Police'' (1999). * Seliktar, Ofira. ''Politics, Paradigms, and Intelligence Failures: Why So Few Predicted the Collapse of the Soviet Union'' (2015).


United States

* Ambrose, Stephen E. ''Ike's Spies : Eisenhower and the Espionage Establishment'' (1981
online free to read
* Andrew, Christopher. ''For the President's Eyes Only: Secret Intelligence and the American Presidency from Washington to Bush'' (1995), covers each presidency. * Ferris, John. "Coming in from the Cold War: the historiography of American intelligence, 1945–1990." ''Diplomatic History'' 19.1 (1995): 87–115
online
* Fishel, Edwin C. ''The secret war for the Union: the untold story of military intelligence in the Civil War'' (1996
online free to read
* Friedman, George. ''America's Secret War: Inside the Hidden Worldwide Struggle Between the United States and Its Enemies'' (2005). * Goldman, Jan, ed. ''The Central Intelligence Agency: An Encyclopedia of Covert Ops, Intelligence Gathering, and Spies'' (2 vol. 2015). * Jeffreys-Jones, Rhodri. ''American Espionage: From Secret Service to CIA'' (2nd ed 2017
online free to read
* Moran, Christopher R. and Christopher J. Murphy, eds. '' Intelligence Studies in Britain and the US: Historiography since 1945'' (Edinburgh UP, 2013
online
* O'Toole, G. J. A. ''Honorable Treachery: A History of U.S. Intelligence, Espionage, Covert Action from the American Revolution to the CIA'' (1991
online free to read
* O'Toole, G. J. A. ''The Encyclopedia of American Intelligence and Espionage: From the Revolutionary War to the Present'' (1988) * Persico, Joseph E. ''Roosevelt's Secret War: FDR and World War II Espionage'' (2001), 566pp; covers most aspects of American espionage during the war
excerpt
* Prados, John. ''Presidents' Secret Wars: CIA and Pentagon Covert Operations from World War II Through the Persian Gulf War'' (1996). * Richelson, Jeffery T. ''The U.S. Intelligence Community'' (4th ed. 1999) * Rose, Alexander. ''Washington's Spies: The Story of America's First Spy Ring'' (2006) in 1770
online free to read
* Smith Jr., W. Thomas. ''Encyclopedia of the Central Intelligence Agency'' (2003). * Zegart, Amy B. ''Spies, Lies, and Algorithms: The History and Future of American Intelligence'' (2022), university textbook
online reviews


Other countries

* Bezci, Egemen B. "Turkey's intelligence diplomacy during the Second World War." ''Journal of Intelligence History'' 15.2 (2016): 80–95. * Davies, Philip H. J., and Kristian C. Gustafson. eds. ''Intelligence Elsewhere: Spies and Espionage Outside the Anglosphere'' (2013). * Deacon, Richard. ''Kempei Tai: A History of the Japanese Secret Service'' (1983
online free to read
* Lasoen, Kenneth L. "185 years of Belgian security service." ''Journal of Intelligence History'' 15.2 (2016): 96–118. * Sirrs, Owen L. ''Pakistan's inter-services intelligence directorate: covert action and internal operations'' (2016) covers 1947 to 2011. * Stone, James. "Spies and diplomats in Bismarck's Germany: collaboration between military intelligence and the Foreign Office, 1871–1881." ''Journal of Intelligence History'' 13.1 (2014): 22–40. * Thomas, Gordon. ''Gideon's spies: the secret history of the Mossad'' (2007) on Israel
online free to read


External links


''Journal of Intelligence History'' scholarly journal; 4 issues a year since 2001



International Spy Museum
History of espionage