Runtime
Measuring PSYOPS: Output, Reach, Exposure, Effect, Causality, and Blowback
Report summary
The central axiom of psychological operations (PSYOPS) and information warfare assessment is unyielding: visibility, virality, engagement, circulation, or takedown does not by itself demonstrate persuasion or behavioral change. The failure to maintain a strict methodological boundary between measuri
Key topics
- Runtime
- .NET
- Research Archive
- Audit
- Architecture
- Governance
- Measuring
- PSYOPS
Research provenance
For citation, use the report title and canonical URL. Archival presence does not establish authorship or promote report statements into portfolio evidence.
This page renders the archived Markdown as safe, formatted HTML. It is background research and does not become a portfolio claim without evidence review.
Full report
On this page
/psyops/reach-versus-effect
The central axiom of psychological operations (PSYOPS) and information warfare assessment is unyielding: visibility, virality, engagement, circulation, or takedown does not by itself demonstrate persuasion or behavioral change. The failure to maintain a strict methodological boundary between measuring what an organization produces and measuring the cognitive or behavioral effects on a target audience is the primary source of exaggerated influence claims. Proving that a psychological operation caused a meaningful outcome requires overcoming the inherent friction of human cognition, environmental confounders, and the complexities of causal inference. Information environments are not empty vessels waiting to be filled; they are saturated, highly contested ecosystems where target audiences possess pre-existing biases, physical constraints, and robust psychological defenses. The architecture of psychological assessment relies on a precise taxonomy to separate vanity metrics from genuine strategic shifts.
Lexicon of Operational Assessment
To accurately assess information operations, analysts must deploy a standardized vocabulary. The following taxonomy enforces a strict distinction between administrative outputs, cognitive processing, behavioral action, and analytical pitfalls.
| Concept / Term | Definition | Assessment Function |
|---|---|---|
| Measure of Performance (MOP) | Indicators evaluating task execution and resource expenditure; measures of input answering "are we doing things right?"1. | Confirms operational output. Cannot prove target impact. |
| Measure of Effectiveness (MOE) | Indicators evaluating changes in target system behavior, capability, or environment; answers "are we doing the right things?"2. | Establishes the achievement of the desired end state. |
| Output | Tangible, quantifiable products generated by the activity (e.g., a printed leaflet, a broadcasted video, a bot network). | The physical or digital artifact of the operation. |
| Activity | The internal organizational process of planning, designing, and executing an operation. | Administrative tracking; entirely distinct from effect. |
| Distribution | The mechanical dissemination of the output into the information environment. | Confirms delivery, not reception. |
| Availability | The presence of the distributed output in a space where it is theoretically possible for the target to encounter it. | A prerequisite for, but not a guarantee of, exposure. |
| Reach | The estimated total number of unique individuals or devices that had the opportunity to encounter the output. | Defines the maximum potential audience boundary. |
| Exposure | The actual, verifiable physical or digital contact between the target audience and the output. | The threshold where output enters the target's environment. |
| Frequency | The number of times a targeted unit is exposed to the output within a specified time window. | Determines saturation levels and potential message fatigue. |
| Attention | The cognitive allocation of focus toward the exposed output, distinguishing active consumption from passive background noise. | The first strictly psychological metric in the causal chain. |
| Recall | The ability of the target to remember the message or output after attention has been shifted away. | Demonstrates cognitive retention but not ideological agreement. |
| Comprehension | The target’s accurate understanding of the intended message, untainted by misinterpretation or translation errors. | Validates that the message was received as intended. |
| Source Recognition | The target’s identification (accurate or inaccurate) of the entity that produced the message. | Critical for assessing whether "white" or "black" attribution succeeded. |
| Credibility | The degree to which the target perceives the message and its source as trustworthy, accurate, and authoritative. | The gateway variable to persuasion and attitude shift. |
| Attitude | A settled, internal psychological orientation or feeling toward the subject of the message. | A latent variable; does not guarantee external action. |
| Belief | The cognitive acceptance that a specific statement derived from the message is factually true. | The foundation upon which new attitudes are built. |
| Preference | The target’s comparative bias toward one choice, ideology, or action over another available alternative. | Indicates a shift in the target's internal decision matrix. |
| Intention | The conscious formulation of a plan to execute a specific behavior in the future. | A leading indicator of behavior, though often unfulfilled. |
| Behavior | The observable, physical action taken by the target audience in the real world. | The ultimate dependent variable in most tactical PSYOPS. |
| Surrender | The formal cessation of resistance and submission to opposing military or state forces. | A behavioral outcome heavily influenced by physical/kinetic factors4. |
| Defection | The abandonment of one's loyalty, group, or nation in favor of an opposing group. | Requires severing social ties; rarely caused by media alone5. |
| Compliance | The act of adhering to demands, often temporarily or due to coercion rather than internalized ideological belief. | Easily mistaken for persuasion by naive analysts. |
| Noncompliance | The active or passive refusal to adhere to the operation's demands or directives. | The default state of most hostile target audiences. |
| Morale | The psychological state, confidence, resilience, and discipline of a group or individual. | Highly vulnerable to physical deprivation; hard to degrade via media alone6. |
| Cohesion | The degree to which members of a group remain united and mutually supportive in pursuit of an objective. | A primary target for operations seeking to induce factionalism. |
| Trust | The reliance on the integrity, strength, or ability of an entity, system, or information source. | The critical currency of strategic communication and civic stability. |
| Policy Effect | A change in the legislative, diplomatic, or administrative rules and actions of a targeted entity. | A macro-level outcome bridging behavior and strategic shifts. |
| Strategic Effect | A durable, systemic shift in the balance of power, societal trajectory, or long-term behavioral norms of a population or state. | The ultimate objective; rarely achievable by PSYOPS in isolation. |
| Intermediate Indicator | A milestone metric bridging MOPs and MOEs, showing progression along a causal chain without confirming ultimate behavioral change. | Useful for long-term campaign tracking. |
| Leading Indicator | A predictive metric that signals future events or shifts in audience trajectory before the primary outcome occurs. | Allows planners to anticipate operational success or failure. |
| Lagging Indicator | A retroactive metric that confirms a pattern or change only after the operational outcome has fully materialized. | The most reliable, but least actionable, form of assessment. |
| Baseline | The established condition of a system, population, or metric prior to the introduction of an intervention8. | Essential for calculating any subsequent delta or effect. |
| Base Rate | The natural, underlying frequency of an event or behavior in a population without external intervention. | Prevents operations from taking credit for organic phenomena. |
| Counterfactual | The theoretical scenario of what would have happened to the target audience had the operation not occurred. | The conceptual core of all rigorous causal inference. |
| Control Group | A rigorously isolated subset of the population that is not exposed to the operation, used for statistical comparison. | The gold standard for establishing the counterfactual. |
| Comparison Group | A similar, though not perfectly randomized, subset of the population used as a proxy for the counterfactual. | Used when operational realities prohibit a true control group. |
| Confounder | An external, unmeasured variable that influences both the dependent and independent variables, generating a spurious association. | The primary enemy of accurate PSYOPS assessment (e.g., kinetic force). |
| Selection Bias | The statistical distortion introduced when the sample population is not fully representative of the target population. | Occurs when operations only measure those who voluntarily engage. |
| Measurement Error | The discrepancy between the true value of a variable and the value obtained by the flawed measurement instrument. | Rampant in digital environments plagued by bots and algorithmic noise. |
| Attrition | The loss of participants, trackable entities, or data points over the course of a longitudinal evaluation. | Degrades the validity of long-term attitude-tracking panels. |
| Contamination | The inadvertent exposure of the control group to the operation’s outputs, destroying the comparative baseline. | Extremely common in borderless digital and broadcast media environments. |
| Spillover | The secondary transmission of the operation’s effects or message from the exposed population to unexposed neighboring populations9. | Can amplify an effect, but complicates localized measurement10. |
| Displacement Effect | The phenomenon where an intervention merely moves a behavior to a different location or time rather than reducing or eliminating it. | A false positive indicating localized, rather than systemic, success. |
| Hawthorne Effect | The alteration of behavior by the subjects of a study due to their awareness of being observed. | Heavily skews survey and focus group data during post-tests. |
| Ecological Fallacy | The logical error of inferring individual behavior or beliefs strictly from aggregate group demographic or regional data. | Assuming every individual in an exposed region holds the regional average belief. |
| Survivorship Bias | The logical error of concentrating on entities that successfully passed a selection process while ignoring those that did not. | Example: Assessing enemy morale only by interviewing those who already surrendered12. |
| Confirmation Bias | The tendency of evaluators to search for, interpret, favor, and recall information in a way that confirms the operation’s prior hypotheses. | The institutional driver of exaggerated PSYOPS effectiveness claims. |
| Post Hoc Attribution | The logical fallacy that because a behavior occurred after an operation, it was necessarily caused by the operation. | The most common error in PSYOPS claim reporting. |
| Blowback | Unintended, negative consequences of an operation that damage the sponsor's strategic interests13. | The severe cost of exposed deception or poorly calibrated messaging. |
| Backlash | The aggressive, hostile psychological or physical reaction by the target audience upon exposure to the operation. | Often triggers a hardening of adversarial resolve. |
| Boomerang Effect | The psychological phenomenon where a persuasive message produces attitude change in the direction opposite to that intended. | Occurs when messaging violates the target's core identity or values. |
| Credibility Depletion | The erosion of the sponsor’s overall trustworthiness and authoritative weight following the discovery of deception. | Renders future, truthful communications strategically useless. |
| Opportunity Cost | The strategic, financial, and temporal resources lost by executing a specific operation instead of a superior alternative. | The hidden tax of dedicating resources to ineffective vanity operations. |
| Unintended Audience | Populations or demographic segments that intercept the message despite not being the intended target. | Frequently leads to unmanaged interpretations and diplomatic crises. |
| Second-order Effect | The indirect consequence of an operation that occurs as a direct result of the primary, intended first-order effect. | Requires systemic, holistic analysis to anticipate. |
| Third-order Effect | The subsequent, often unpredictable downstream ripple effects emerging from second-order systemic changes. | The zone where strategic chaos and uncontrolled outcomes proliferate. |
Methodological Evaluation: Proof, Proximity, and Validity
Methods of evaluation are only valid when their outputs match the epistemology of the claim. The availability of platform analytics does not provide proof of behavioral validity. The following evaluation frameworks specify the strengths, weaknesses, and exact claim support for contemporary and historical methods. Analysts must never present a method's mere availability as proof of its analytical validity.
| Assessment Method | Strengths | Weaknesses | Claim Support Applications |
|---|---|---|---|
| Distribution Records | Concrete documentation of internal organizational output and physical logistics (MOP). | Cannot prove the product was received, read, or understood by the adversary. | Reach Claims |
| Broadcast Coverage Estimates | Establishes the physical/technical footprint of radio or television availability. | Assumes a transmitted signal equates to a receptive, attentive human audience. | Reach Claims |
| Readership/Listenership Studies | Moves beyond signal availability to measure active audience consumption patterns. | Highly susceptible to self-reporting biases, state coercion, and sampling errors. | Reach Claims, Interpretation Claims |
| Surveys | Excellent for polling broad attitudes, demographic baselines, and stated intentions. | Highly vulnerable to Hawthorne effects, respondent fear, and selection bias. | Interpretation Claims, Behavioral Claims (Self-Reported) |
| Panels | Tracks continuous, individual attitudinal shifts over time within a set demographic group. | Suffer from high attrition rates; the act of being repeatedly polled conditions the panel. | Interpretation Claims, Behavioral Claims |
| Interviews | Yields deep qualitative insight into cultural comprehension and individual cognition. | Non-generalizable; heavily dependent on interviewer skill and interpreter accuracy. | Interpretation Claims |
| Historical Interrogation / Prisoner Records | Provides direct access to adversary psychological states under extreme duress. | Massive survivorship bias; responses are driven by coercion, exhaustion, or compliance12. | Interpretation Claims, Strategic Claims |
| Defector / Surrender Interviews | Reveals the specific tipping points for extreme behavioral shifts in combat environments. | Subjects routinely tailor answers to please captors or secure financial bounties14. | Behavioral Claims |
| Focus Groups | Enables rapid assessment of message resonance and cultural translation prior to launch. | Groupthink dynamics obscure minority dissent; dominant personalities skew findings. | Interpretation Claims |
| Message Pretests | Filters out severe cultural or linguistic blunders before operational execution. | Pristine laboratory conditions rarely mirror real-world information chaos and fatigue. | Interpretation Claims |
| Recall Tests | Isolates active cognitive attention and memorability from passive, scrolling exposure. | Recall does not equate to credibility, persuasion, or behavioral intent. | Interpretation Claims |
| Field Experiments | Tests causal mechanics in real-world, highly contested information environments. | Highly resource-intensive; poses severe ethical dilemmas and contamination risks. | Causal Claims, Behavioral Claims |
| Randomized Experiments (RCTs) | The absolute gold standard for eliminating confounders and proving causal isolation. | Exceedingly difficult to execute covertly; artificiality may warp real-world applicability. | Causal Claims |
| Quasi-experiments | Leverages existing geographical or temporal variations when RCTs are impossible. | Unmeasured confounders can easily disrupt the presumed causal link. | Causal Claims, Behavioral Claims |
| Natural Experiments | Exploits exogenous shocks (e.g., topography blocking a signal) to assess effects organically16. | Extremely rare; assumptions of true random assignment may be deeply flawed. | Causal Claims, Strategic Claims |
| Interrupted Time Series | Excellent for assessing the sudden, localized impact of a discrete operational launch. | Susceptible to simultaneous historical events muddying the longitudinal data. | Causal Claims, Behavioral Claims |
| Difference-in-Differences | Compares the trajectory of an exposed group to an unexposed group over identical timeframes. | Assumes parallel trends would have continued identically without the intervention. | Causal Claims, Strategic Claims |
| Matched Comparison | Artificially creates a control group by matching statistical twins across populations. | Can only match on observable variables, leaving hidden selection biases unchecked. | Causal Claims |
| Longitudinal Studies | Reveals the durability and decay rate of an attitude or behavior change over years. | Financially prohibitive; subject to severe sample attrition over extended timeframes. | Behavioral Claims, Strategic Claims |
| Content Analysis | Quantifies the proliferation of campaign themes or keywords in target media ecosystems. | Fails to prove that the population actually accepted or internalized the analyzed themes. | Interpretation Claims |
| Archival Analysis | Utilizes historical, unalterable baseline data to contextualize modern shifts. | Plagued by historical data gaps and highly inconsistent legacy recording metrics. | Strategic Claims |
| Network Analysis | Maps the structural propagation of messages through complex social or digital graphs. | Cannot easily differentiate between organic human propagation and automated bot amplification. | Reach Claims, Interpretation Claims |
| Platform Analytics | Provides real-time, highly granular MOPs (clicks, views, shares, retweets). | Vanity metrics; bots, click-farms, and algorithmic manipulation severely distort human reality. | Reach Claims |
| Recommendation Logs | Illuminates algorithmic exposure pathways and targeted delivery mechanisms. | Proprietary black boxes; nearly impossible to access or audit externally by researchers. | Reach Claims |
| Media Pickup | Measures how successfully a narrative infiltrated traditional, mainstream news outlets. | Frequently and erroneously mistaken by planners as definitive proof of mass persuasion. | Reach Claims, Strategic Claims |
| Search Behavior | Captures unprompted, private interest in an operational theme or keyword. | Algorithmic curiosity or anxiety cannot be equated with ideological agreement or action. | Interpretation Claims, Behavioral Claims |
| Ethnography | Deep physical immersion yields unparalleled systemic and localized cultural understanding. | Inherently subjective; non-replicable; highly vulnerable to researcher confirmation bias. | Interpretation Claims, Strategic Claims |
| Oral History | Captures generational shifts, cultural trauma, and long-term narrative memory. | Memory distortion is rampant; heavily influenced by post hoc attribution and modern framing. | Interpretation Claims, Strategic Claims |
| Process Tracing | Isolates the exact chronological causal mechanism linking operation to specific outcome. | Highly vulnerable to confirmation bias by the analyst constructing the narrative chain. | Causal Claims, Strategic Claims |
| Outcome Harvesting | Works backward from a strategic effect to identify contributing factors and preconditions. | Prone to over-attributing success to the organization's own actions while ignoring ambient forces. | Causal Claims, Strategic Claims |
| Contribution Analysis | Acknowledges that PSYOPS rarely operate in a vacuum, bounding the scope of credit. | Heavily reliant on qualitative, subjective judgment regarding the exact weight of contribution. | Strategic Claims |
/psyops/historical-cases
The historical record of psychological operations is characterized by vast discrepancies between recorded output, claimed influence, and actual behavioral outcomes. An analysis of major campaigns reveals that operations claiming total behavioral control are frequently taking credit for outcomes driven by kinetic force, economic deprivation, or pre-existing sociological networks. The following ten historical cases stringently reconstruct claimed effects to distinguish verifiable causality from post hoc attribution.
Case 1: WWII Leaflet and Surrender Claims (United States Strategic Bombing Survey)
The Allied aerial bombardment of Axis powers included massive psychological warfare components designed to shatter civilian and military resolve.
1. Claimed objective: Destroy civilian morale, induce defeatism, and force the surrender of German and Japanese populations.
2. Claimed audience: Axis civilian populations and military personnel in targeted urban centers.
3. Recorded output: Millions of leaflets dropped warning of destruction (e.g., AB-11 in Japan) and demanding surrender17.
4. Evidence of distribution: Flight logs, quartermaster records, and the physical presence of paper across urban centers.
5. Evidence of exposure: Documented extensively in the United States Strategic Bombing Survey (USSBS), which conducted deep postwar civilian interviews6.
6. Evidence of comprehension: Civilians clearly understood the threat, exhibiting marked indicators of fear, defeatism, and hopelessness6.
7. Evidence of belief or attitude change: The USSBS noted massive drops in morale, increased defeatism, and loss of faith in leadership, particularly following extreme destruction6.
8. Evidence of behavior: Minimal direct surrender behavior prior to total military collapse; the populace remained compliant to regimes out of terror of internal security apparatuses6.
9. Alternative explanations: Surrender and morale collapse were driven fundamentally by physical devastation, starvation, the kinetic destruction of infrastructure, and advancing ground forces, rather than printed persuasion4.
10. Counterevidence: Heavily bombed populations often showed identical morale drops to moderately bombed ones, indicating diminishing returns; ardent ideological loyalists maintained high morale despite heavy leaflet and bomb exposure6.
11. Unintended effects: Mass displacement and evacuation created severe logistical chaos but did not fracture ultimate state control until the state physically ceased to exist7.
12. Confidence: High that exposure occurred; Low that leaflets independently caused strategic surrender independent of overwhelming kinetic force.
13. Safer public wording: "Allied leaflet operations saturated hostile urban centers, successfully communicating the hopelessness of the strategic situation alongside devastating kinetic action."
Case 2: Black-Radio Audience Claims (Soldatensender Calais)
Operated by the British Political Warfare Executive under Sefton Delmer, this operation sought to masquerade as an official German military station to inject subversive defeatism into the Wehrmacht.
1. Claimed objective: Degrade the morale and combat effectiveness of German forces in Western Europe through covertly injected defeatism and disinformation.
2. Claimed audience: German military personnel, specifically frontline troops and U-boat crews.
3. Recorded output: Continuous high-power medium-wave radio broadcasts featuring authentic German music, genuine sports scores, and interspersed subversive news19.
4. Evidence of distribution: British transmitter logs and signal strength models confirming reach deep into occupied Europe.
5. Evidence of exposure: Captured German diaries, letters, and post-war interrogations confirming regular listenership due to the station's superior entertainment value.
6. Evidence of comprehension: Listeners recognized the news items (often highlighting elite corruption or home-front destruction), though many gradually realized the station was a British ruse.
7. Evidence of belief or attitude change: Increased cynicism regarding Nazi leadership and anxiety regarding the home front among exposed troops.
8. Evidence of behavior: Difficult to isolate; desertion rates increased late in the war, but linking specific desertions to radio broadcasts is highly confounded by the collapsing military situation.
9. Alternative explanations: The degradation of German morale was primarily driven by massive Allied ground offensives, lack of air support, and critical supply shortages, rather than radio-induced defeatism.
10. Counterevidence: Many German soldiers listened strictly for the jazz music and ignored the propaganda, treating the broadcasts as entertainment rather than actionable information.
11. Unintended effects: The station occasionally provided truthful tactical news faster than German command, paradoxically increasing the tactical awareness of some German units.
12. Confidence: High regarding exposure and cognitive anxiety; Low regarding isolated behavioral change (desertion) caused exclusively by the broadcasts.
13. Safer public wording: "Soldatensender Calais achieved unprecedented reach and listenership among adversary forces by blending superior entertainment with subversive messaging, successfully introducing localized anxiety and cynicism into the German ranks."
Case 3: Cold War International Broadcasting (RFE and the 1956 Hungary Controversy)
Radio Free Europe (RFE) operated as a surrogate free press for populations trapped behind the Iron Curtain, but its operations during the Hungarian Revolution triggered intense scrutiny regarding the limits and dangers of psychological influence.
1. Claimed objective: Provide uncensored news to Soviet bloc populations to maintain anti-communist morale and ideological resistance.
2. Claimed audience: The Hungarian civilian population and anti-Soviet dissidents.
3. Recorded output: Continuous broadcast hours via high-powered RFE transmitters located in West Germany20.
4. Evidence of distribution: Signal intercept records and transmitter operational logs.
5. Evidence of exposure: Post-uprising refugee interviews conducted by Soviet Area Audience Research indicated massive, dedicated listenership22.
6. Evidence of comprehension: The audience successfully internalized RFE's anti-Soviet framing of global events and democratic principles.
7. Evidence of belief or attitude change: High correlation between RFE listenership and anti-Soviet sentiment, though this correlation is tangled with selection bias (citizens already opposing the state were the ones tuning in).
8. Evidence of behavior: Hungarian citizens engaged in a massive, armed revolt against Soviet forces in October 1956\.
9. Alternative explanations: Internal political fissures, severe economic deprivation, and the power vacuum following the death of Stalin catalyzed the revolt independently of Western radio20.
10. Counterevidence: West German inquiry transcripts and post-hoc internal US audits revealed that RFE did not orchestrate the uprising, though its tactical broadcasts were perceived by listeners as direct operational directives21.
11. Unintended effects: Tragic strategic blowback. Ambiguous, highly emotive RFE rhetoric was interpreted by the Hungarian resistance as a concrete promise of imminent Western military intervention. This resulted in sustained fighting and thousands of preventable deaths when the West failed to intervene.
12. Confidence: High that RFE was widely consumed; High that it generated unintended, fatal behavioral escalation by inflating expectations of kinetic support.
13. Safer public wording: "RFE provided highly accessed alternative information architectures to the Hungarian populace, which unintentionally fueled unfulfilled expectations of Western military intervention during the 1956 uprising."
Case 4: Korean War Leaflet Assessment
During the Korean conflict, UN forces heavily utilized psychological warfare to target the disparate ideological commitments of the Chinese and North Korean armies.
1. Claimed objective: Induce mass surrender, desertion, and ideological doubt among enemy combatants.
2. Claimed audience: Chinese People's Volunteer Army (CPVA) and North Korean People's Army (NKPA) frontline troops23.
3. Recorded output: Over 2.5 billion leaflets dropped by the US military via artillery and aerial delivery23.
4. Evidence of distribution: Far East Command "Weekly Distribution Plans" confirming massive payload delivery over specific target sectors (Operations Nightingale, Desdemona, etc.)23.
5. Evidence of exposure: Recovered leaflets on captured prisoners and extensive battlefield observations.
6. Evidence of comprehension: Interrogations conducted by the Operations Research Office demonstrated that troops recognized the safe-conduct passes and understood the mechanisms for surrender24.
7. Evidence of belief or attitude change: Chinese troops (many of whom were former Nationalists coerced into service) exhibited vastly higher susceptibility to ideological messaging than highly indoctrinated NKPA troops23.
8. Evidence of behavior: Tens of thousands of surrenders occurred, frequently involving soldiers clutching the printed safe-conduct passes.
9. Alternative explanations: Extreme cold, starvation, lack of ammunition, and devastating artillery fire were the primary drivers of defection; the leaflet merely offered the procedural mechanism for an action forced by the environment.
10. Counterevidence: Surrender rates plummeted whenever enemy logistics stabilized or when temperatures rose, regardless of the volume of leaflets dropped.
11. Unintended effects: Heavy, predictable leaflet drops occasionally alerted enemy commanders to the exact locations of impending tactical ground offensives, compromising operational security.
12. Confidence: Moderate that leaflets facilitated the administrative process of surrender; Low that leaflets initiated the psychological desire to surrender absent physical deprivation.
13. Safer public wording: "The psychological warfare campaign distributed over 2.5 billion leaflets, providing a vital mechanism for safe surrender to enemy troops already severely degraded by kinetic operations and exposure."
Case 5: The Chieu Hoi ("Open Arms") Program
Implemented during the Vietnam War, this massive US-backed South Vietnamese program sought to degrade the insurgency through defection rather than attrition.
1. Claimed objective: Induce the mass defection and reintegration of Viet Cong (VC) and North Vietnamese Army (NVA) personnel25.
2. Claimed audience: Viet Cong guerrillas, NVA soldiers, and their civilian logistical supporters25.
3. Recorded output: Billions of leaflets, massive airborne loudspeaker broadcasts, and continuous radio messaging25.
4. Evidence of distribution: MACV and JUSPAO flight logs and supply chain records for leaflet dispersion across the theater25.
5. Evidence of exposure: Interrogation of defectors confirming receipt of safe conduct passes.
6. Evidence of comprehension: Defectors clearly understood the promise of amnesty, substantial cash bounties for weapons, and medical care14.
7. Evidence of belief or attitude change: Testimonials (often coerced or financially motivated) from former VC joining US-backed Armed Propaganda Teams14.
8. Evidence of behavior: The program claimed the defection of over 194,000 personnel between 1963 and 197325.
9. Alternative explanations: Heavy bounties (e.g., up to $16,000 for heavy weapons caches) created financial rather than ideological motives. Furthermore, many supposed "defectors" were actually rural refugees utilizing the program to escape relentless US bombing14.
10. Counterevidence: Extreme data inflation. Provincial officials frequently fabricated defectors to meet quotas or pocket the monetary rewards allocated for defectors27. Rampant "double counting" occurred as individuals rallied multiple times to collect multiple payments.
11. Unintended effects: VC infiltration of the program to gather intelligence; severe alienation of the loyalist South Vietnamese populace, who deeply resented former enemies receiving better treatment, housing, and land than loyal citizens14.
12. Confidence: High that the program processed thousands of individuals; Low regarding the authenticity of ideological defection and the veracity of the 194,000 statistical claim.
13. Safer public wording: "The Chieu Hoi program processed roughly 194,000 claimed rallies through financial and amnesty incentives, draining enemy manpower, though official statistics were heavily compromised by financial corruption and non-combatant crossover."
Case 6: Gulf War Surrender Leaflets (1991)
During Operation Desert Storm, Coalition forces combined strategic airpower with a massive psychological campaign to collapse the Iraqi army in Kuwait.
1. Claimed objective: Persuade Iraqi soldiers to surrender, abandon equipment, and desert their posts.
2. Claimed audience: Iraqi frontline and reserve units arrayed in the Kuwait Theater of Operations.
3. Recorded output: 29 million leaflets dropped over a brief six-week period30.
4. Evidence of distribution: Coalition air-tasking orders and B-52 flight logs.
5. Evidence of exposure: Widespread recovery of leaflets among Iraqi ranks and captured positions.
6. Evidence of comprehension: Iraqi forces explicitly followed the highly specific leaflet instructions regarding how to position their weapons, turn their turrets, and approach Coalition forces31.
7. Evidence of belief or attitude change: A general sense of fatalistic defeatism permeated the Iraqi ranks, driven by the inescapable reality of overwhelming Coalition air supremacy32.
8. Evidence of behavior: Over 80,000 Iraqi soldiers surrendered to Coalition ground forces within days31.
9. Alternative explanations: Strategic bombardment, severe disruption of logistics (resulting in mass starvation and dehydration), and the complete decapitation of Iraqi command and control left frontline troops with no tactical alternative to death but surrender33.
10. Counterevidence: Republican Guard units, who were better supplied, highly motivated, and under less immediate kinetic threat in the rear, did not surrender in mass numbers despite receiving identical messaging.
11. Unintended effects: The vast volume of rapidly surrendering Iraqis created massive logistical strains on advancing Coalition ground forces, paradoxically slowing the tactical advance as units had to process tens of thousands of prisoners31.
12. Confidence: High that leaflets provided a vital mechanism for surrender; Moderate that they generated the initial will to surrender independent of kinetic strikes.
13. Safer public wording: "Coalition PSYOP successfully delivered the procedural instructions for surrender to heavily attrited Iraqi forces, facilitating the peaceful capitulation of over 80,000 personnel degraded by kinetic operations."
Case 7: Peace Broadcasting (Radio UNTAC, Cambodia 1992-1993)
The United Nations Transitional Authority in Cambodia (UNTAC) deployed one of the first multidimensional peacekeeping information operations to secure post-conflict elections.
1. Claimed objective: Ensure high voter turnout, educate the public on the concept of the secret ballot, and neutralize factional hate media during the democratic transition34.
2. Claimed audience: The Cambodian civilian electorate, which was largely illiterate and traumatized by decades of genocide and civil war.
3. Recorded output: UN-produced radio broadcasts, soap operas, banners, and the distribution of battery-powered TV sets in rural areas35.
4. Evidence of distribution: Transmission logs of the Information/Education Division (INFO/ED)35.
5. Evidence of exposure: Substantial listenership verified by external anthropological observers and hardware distribution metrics36.
6. Evidence of comprehension: Widespread, measurable understanding that the vote would be secret—a profoundly novel and protective concept in that political environment35.
7. Evidence of belief or attitude change: Voters expressed high trust in the UN mechanism despite extreme intimidation, violence, and threats of retaliation from the Khmer Rouge and the ruling CPP36.
8. Evidence of behavior: Nearly 90% voter turnout in the 1993 elections despite localized violence and assassination campaigns34.
9. Alternative explanations: Deep-seated societal war-weariness and the physical presence of 16,000 heavily armed UN peacekeeping troops provided the physical security necessary for the vote to occur37.
10. Counterevidence: UNTAC failed to prevent the long-term authoritarian consolidation of power by Hun Sen and the CPP, demonstrating the strict limits of information operations against entrenched physical power structures and political violence37.
11. Unintended effects: The focus on completing the election legitimized the political control of the CPP while failing to disarm hostile rural factions37.
12. Confidence: High that Radio UNTAC influenced election-day behavior and imparted crucial knowledge; Low that it permanently altered the democratic trajectory of the state.
13. Safer public wording: "Radio UNTAC successfully utilized mass broadcasting to establish trust in the secret ballot, significantly contributing to the 90% electoral turnout despite acute factional violence, though it could not prevent eventual authoritarian backsliding."
Case 8: Hate-Media Exposure and Legal Evidence (RTLM in Rwanda)
The 1994 Rwandan genocide serves as a grim laboratory for assessing the exact causal weight of mass media in generating horrific behavioral outcomes.
1. Claimed objective: Incite the Hutu population to exterminate the Tutsi minority.
2. Claimed audience: Rwandan civilian Hutus and Interahamwe militias.
3. Recorded output: Continuous, highly popular radio broadcasting by Radio Télévision Libre des Mille Collines (RTLM), blending popular music with genocidal directives38.
4. Evidence of distribution: Transmitter capabilities precisely mapped post-conflict via the Irregular Terrain Model39.
5. Evidence of exposure: Topographical models were cross-referenced with village locations to prove signal availability, blocked by mountains in certain areas, providing a natural experiment16.
6. Evidence of comprehension: Hutu militias utilized the broadcasts as direct tactical coordination, receiving instructions on where to establish roadblocks and hunt victims40.
7. Evidence of belief or attitude change: Deep dehumanization messaging (referring to Tutsis as "cockroaches") successfully lowered the psychological barriers to violence9.
8. Evidence of behavior: Village-level prosecution data showed a 12–13% increase in total violence participation in areas with radio coverage; approximately 51,000 perpetrators were statistically attributed to the station10.
9. Alternative explanations: State coercion; many citizens participated in killings out of severe fear of being executed themselves by the state if they refused39.
10. Counterevidence: Yanagizawa-Drott's rigorous research highlights that spillover effects (peer-to-peer transmission of violence in villages near radio signals) caused more militia violence than direct radio exposure10. The radio functioned primarily as a coordination and social-pressure mechanism rather than a purely persuasive mind-control tool11.
11. Unintended effects: The broadcasting created an unalterable, recorded public record that was subsequently used to prosecute the organizers in international criminal tribunals.
12. Confidence: High that RTLM increased aggregate violence; High that the primary mechanism was collective coordination and peer pressure rather than isolated ideological persuasion.
13. Safer public wording: "RTLM broadcasts systematically coordinated violence and lowered psychological barriers, contributing to an estimated 10% increase in genocide participation through a combination of direct exposure and localized peer spillover."
Case 9: Post-2001 Strategic Communication (Leonie Industries / Lincoln Group)
In the aftermath of the invasions of Iraq and Afghanistan, the US military heavily outsourced strategic communication to defense contractors to stabilize the occupied nations.
1. Claimed objective: Improve Iraqi and Afghan public perception of Coalition forces, foster reconciliation, and support local governments.
2. Claimed audience: Iraqi and Afghan civilian populations.
3. Recorded output: Thousands of planted news stories, television spots, billboards, and sponsored entertainment media42.
4. Evidence of distribution: Multi-million dollar contracting invoices from Leonie Industries, SOSi, and Lincoln Group confirming product delivery42.
5. Evidence of exposure: Broadcast tracking, though the Government Accountability Office (GAO) explicitly found that contractors like Leonie Industries inadequately tracked their actual operational impacts44.
6. Evidence of comprehension: Unknown and poorly measured; cultural mistranslations were rampant.
7. Evidence of belief or attitude change: Independent public polling continuously showed deep, abiding resentment of Coalition presence, directly contradicting program objectives.
8. Evidence of behavior: Negligible behavioral shifts toward stabilization; insurgent violence remained severe and ongoing.
9. Alternative explanations: The physical realities of occupation, brutal sectarian conflict, civilian casualties, and lack of basic services completely overrode any positive strategic communication43. Actions drowned out words.
10. Counterevidence: Internal audits revealed that output metrics (MOPs) were routinely and deceptively substituted for effect metrics (MOEs) to secure ongoing multi-million dollar contracts44.
11. Unintended effects: Massive strategic blowback occurred when US media exposed that the Pentagon was covertly paying to plant articles in the ostensibly free Iraqi press. The exposure severely damaged the credibility of both the US military and the nascent, fragile Iraqi independent press42.
12. Confidence: Low that the programs achieved strategic persuasion; High that they generated severe institutional blowback.
13. Safer public wording: "Defense contractors generated massive quantities of localized media outputs, though subsequent audits determined that tracking methodologies were inadequate to prove any positive behavioral shift, while the covert nature of the program damaged institutional credibility upon exposure."
Case 10: Platform-Era State Influence and Extremist Recruitment (IRA and ISIS)
The explosion of social media created the assumption that algorithmic reach directly translates to massive behavioral manipulation, a premise tested by Russian interference and ISIS recruitment.
1. Claimed objective: Polarize the US electorate (IRA) and radicalize Western recruits for global jihad (ISIS)5.
2. Claimed audience: US voters (IRA) and alienated Muslim youth globally (ISIS).
3. Recorded output: Millions of tweets, Facebook groups, and memes (IRA) / High-production execution videos and digital magazines (ISIS)5.
4. Evidence of distribution: Platform data dumps, API scraping, and congressional investigations50.
5. Evidence of exposure: Quantitative logs of views, retweets, and algorithmic amplification showing unprecedented global reach48.
6. Evidence of comprehension: Users heavily engaged with, modified, and reposted the content51.
7. Evidence of belief or attitude change: Negligible for the IRA. Rigorous longitudinal studies linking Twitter feeds to survey data showed no meaningful relationship between exposure to Russian disinformation and changes in attitudes or political polarization48.
8. Evidence of behavior: ISIS successfully recruited thousands of foreign fighters51. The IRA showed no verifiable impact on actual voting behavior48.
9. Alternative explanations: ISIS recruitment was driven primarily by physical, real-world peer networks, family ties, and small-group dynamics in specific neighborhoods, not just by slick videos5. For the IRA, exposure was a severe echo-chamber effect: just 1% of highly partisan users accounted for 70% of exposures, meaning the campaign preached to the converted48.
10. Counterevidence: Radicalization experts explicitly noted that online propaganda created vocal "fanboys," but the actual physical movement to Syria required a real-world social bridge and peer pressure5.
11. Unintended effects: IRA operations triggered massive Congressional investigations, unified tech platforms against state actors, and resulted in severe geopolitical sanctions against the Russian Federation.
12. Confidence: Low that social media propaganda independently alters deep ideological behavior without pre-existing vulnerabilities or real-world peer reinforcement.
13. Safer public wording: "While digital influence campaigns achieve massive algorithmic reach and successfully activate pre-existing highly partisan clusters, empirical data demonstrates they have negligible independent effects on broad electoral behavior or independent physical radicalization absent real-world peer networks."
/psyops/assessment
The quantification of human cognition is intrinsically flawed when heavily reliant on automated indicators. System engagement cannot be algorithmically translated into psychological persuasion. To prevent organizations from automatically labeling engagement figures as "influence," evaluations must pass a rigorous, deterministic audit.
The Effect-Claim Audit Workbench
This publication-safe audit evaluates the empirical validity of any PSYOPS effect claim. A claim must address these sixteen criteria transparently before being accepted as strategically valid. Analysts must not assign one universal numeric “effectiveness score,” as doing so flattens complex psychological realities into dangerous pseudoscience.
1. What is the exact outcome being claimed? The claim must isolate a specific behavior or verifiable metric, not rely on a generalized sentiment like "increased positive perception."
2. What is the time window? Did the behavioral change persist beyond the immediate presence of the intervention, or did it decay instantly?
3. What is the unit of analysis? Specify whether the effect occurred at the individual, household, brigade, or demographic subset level. Avoid the ecological fallacy.
4. What is the baseline? What was the rigorously documented state of the target before the operation began? Without a baseline, delta is a fiction.
5. What counterfactual is proposed? How would the target have behaved had the operation never occurred?
6. What independent variables changed simultaneously? Did a mass surrender correlate with leaflet drops, or with the catastrophic kinetic destruction of the enemy's supply lines?
7. Was exposure actually measured? Did the audience physically or digitally view the product, or was it merely distributed into the void?
8. Is the outcome self-reported? Self-reported data is highly vulnerable to the Hawthorne effect and respondent compliance; targets lie to evaluators.
9. Is the sample representative? Does the data rely on survivorship bias, such as only interviewing defectors while ignoring those who fought to the death?
10. Are measurement and treatment independent? Are the personnel evaluating the success of the mission organizationally and financially separate from the personnel who executed it?
11. Could selection explain the result? Did the operation convert hostile targets, or simply attract an echo-chamber of those who already agreed with the premise?
12. Are there negative or null findings? If a report claims 100% success without identifying areas of friction, backlash, or failure, the methodology is inherently suspect.
13. Was the evaluation performed by the organization claiming success? Identify structural, financial, or bureaucratic incentives for inflation and data manipulation.
14. Is the result tactical, operational, or strategic? A tactical surrender by an isolated platoon does not equate to a strategic ideological shift across a nation.
15. Is the claimed effect durable? Does the behavior revert to the baseline once the campaign ceases or funding is cut?
16. What evidence would falsify the conclusion? If the claim is structured so that it is unfalsifiable, it is not an empirical assessment.
Claim-Ledger Schema
To prevent the systemic conflation of platform metrics with behavioral shifts, reporting must utilize a strict ledger schema that forces analysts to segregate MOPs from MOEs.
| Tier | Metric Category | Acceptable Data Points | Forbidden Inferences |
|---|---|---|---|
| 1 | Activity / Output | Budgets, hours worked, leaflets printed, videos produced. | Cannot claim the output was seen or heard. |
| 2 | Reach / Distribution | Algorithm impressions, flight logs, circulation figures. | Cannot claim the audience paid attention or understood. |
| 3 | Engagement / Exposure | Clicks, likes, watch-time, captured leaflets. | Cannot claim the audience believed the message or was persuaded. |
| 4 | Attitudinal Shift | Polling data, sentiment analysis, qualitative interviews. | Cannot claim the audience will act on their stated beliefs. |
| 5 | Behavioral Action | Voting records, defection, protest attendance, surrender. | Cannot claim the action was caused solely by the PSYOPS without controlling for physical/kinetic variables. |
Simulation Metrics Guidance
When utilizing wargaming or predictive modeling for information operations, simulation metrics must be limited strictly to clearly fictional system indicators. Analysts must never generate or rely upon real-person or community "persuadability scores." Human agency is not deterministic. Models claiming to calculate the precise percentage of a real population that will break under psychological pressure inevitably result in the ecological fallacy, generating dangerous overconfidence in operational planning and catastrophic real-world failure.
/psyops/blowback
Psychological operations, particularly those employing "black" (falsely attributed) or "grey" (unattributed) propaganda, carry extreme institutional risks. The assumption that a target audience operates within a closed, hermetically sealed system is historically false; information leaks, and the discovery of manipulation often inflicts more strategic damage than the operation initially sought to achieve.
The Architecture of Institutional Harm
Discovery of Deception and Loss of Institutional Credibility: When state-sponsored disinformation or covert funding is exposed—as seen with the Pentagon’s funding of the Lincoln Group to plant stories in the Iraqi press—the host institution suffers total, generational credibility depletion42. The target audience subsequently rejects truthful, life-saving information, categorizing all sponsor outputs as malign deception. Rebuilding this trust takes decades. Harm to Neutral Media and Endangerment of Aid Workers: Operations that masquerade as independent journalism or humanitarian aid inherently endanger legitimate journalists, NGO personnel, and medical workers13. By weaponizing the aesthetics of neutrality, PSYOPS commanders erode the legal and physical protections afforded to non-combatants. The CIA's use of a fake Hepatitis B vaccination campaign in Abbottabad to collect Bin Laden's DNA directly resulted in the subsequent assassination of dozens of legitimate polio workers by militant groups, leading to localized resurgences of eradicated diseases13. The long-term distrust of health and humanitarian information remains a lethal legacy of this tactical choice. Polarization, Backlash, and Increased Resistance: The Boomerang Effect dictates that attempting to manipulate an adversarial population often hardens their original stance. Heavy-handed messaging triggers psychological reactance, creating increased resistance and cohesion among the adversary6. Rather than fracturing the target, the operation provides them with a unifying external threat, increasing in-group solidarity. Civilian-Service Disruption and Retaliation: Operations designed to sow administrative chaos or disrupt adversary communications frequently spill over into critical civilian infrastructure. This not only violates international norms but invites immediate, asymmetrical retaliation against the sponsor's own civilian networks, initiating uncontrolled escalatory spirals. Propaganda Value Given to Opponents: Failed, exposed, or clumsy PSYOPS become high-value ammunition for the adversary's own strategic messaging. The exposure of Western digital manipulation or covert funding provides autocratic regimes with the domestic justification to sever their populations from the global internet and suppress genuine domestic dissent. Regimes simply label organic protests as foreign intelligence operations, pointing to previous exposed PSYOPS as proof. Diplomatic Cost and Archival Consequences: In the digital age, archival memory is permanent. Deception operations against allied, neutral, or unaligned populations inflict catastrophic diplomatic costs. The opportunity cost of a failed operation is high, but the reputational consequences of being caught executing an influence campaign fundamentally alter bilateral relations, trade negotiations, and security alliances for decades. A short-term tactical victory secured through deception often guarantees a long-term strategic defeat.
Works cited
1. Understanding Commanders' Information Needs for Influence Operations \- RAND, https://www.rand.org/content/dam/rand/pubs/monographs/2009/RAND\_MG656.pdf
2. JP 3-57, Civil-Military Operations, 9 July 2018 \- BITS, https://www.bits.de/NRANEU/others/jp-doctrine/jp3\_57%282018%29.pdf
3. Assessment: A Military Methodology in Need of an Overhaul \- DTIC, https://apps.dtic.mil/sti/tr/pdf/ADA603676.pdf
4. Doubts About Nuclear Deterrence \- BASIC, https://basicint.org/wp-content/uploads/2018/06/evidence\_submitted\_by\_ward\_wilson\_0.pdf
5. Peer pressure lures more Britons to Syria than Isis videos, study finds \- The Guardian, https://www.theguardian.com/world/2014/nov/06/isis-recruitment-peer-pressure-friendships-more-decisive-social-media-luring-jihadis
6. the effects of strategic bombing on german morale | aoav, https://aoav.org.uk/wp-content/uploads/2020/07/The-Effects-of-Strategic-Bombing-in-WWII-on-German-Morale.pdf
7. The Effects of Strategic Bombing in WWII on German Morale \- AOAV, https://aoav.org.uk/2020/the-effects-of-strategic-bombing-in-wwii-on-german-morale/
8. Purposeful Assessment. Assessing the Effects of Military Operations. \- Totalförsvarets forskningsinstitut \- FOI, https://foi.se/rest-api/report/FOI-R--2718--SE
9. Propaganda and Conflict: Evidence from the Rwandan Genocide \* \- ResearchGate, https://www.researchgate.net/publication/275147180\_Propaganda\_and\_Conflict\_Evidence\_from\_the\_Rwandan\_Genocide
10. PROPAGANDA AND CONFLICT: EVIDENCE FROM THE RWANDAN GENOCIDE \- David Yanagizawa-Drott, https://yanagizawadrott.com/wp-content/uploads/2016/02/rwandadyd.pdf
11. Propaganda and Conflict: Theory and Evidence from the Rwandan Genocide, https://www.hks.harvard.edu/centers/cid/publications/faculty-working-papers/propaganda-and-conflict
12. The Effects of strategic bombing on Japanese morale \- Ibiblio, https://www.ibiblio.org/hyperwar/NHC/NewPDFs/USAAF/United%20States%20Strategic%20Bombing%20Survey/USSBS%20Effects%20of%20Strategic%20Bombing%20Japanese%20Morale.pdf
13. Polio transmission continues on Pakistan–Afghanistan border, http://www.scidev.net/en/south-asia/news/polio-transmission-continues-on-pakistan-afghanistan-border.html
14. South Viet Nam: After Crossing Over \- TIME, https://time.com/archive/6632707/south-viet-nam-after-crossing-over/
15. INTERVIEW WITH VIETNAM WAR PARTICIPANT NAME S — BACKGROUND, https://digicoll.lib.berkeley.edu/record/90506/files/b246474907\_C053139879\_15\_1.pdf
16. Propaganda and Conflict: Theory and Evidence from the Rwandan Genocide \- Harvard Kennedy School, https://www.hks.harvard.edu/sites/default/files/centers/cid/files/publications/faculty-working-papers/257\_Drott\_Rwanda.pdf
17. Leaflet dropped on Japanese cities prior to second atomic bomb : r/history \- Reddit, https://www.reddit.com/r/history/comments/6mhim7/leaflet\_dropped\_on\_japanese\_cities\_prior\_to/
18. The Impact of Urban Evacuation in Japan during World War II \- Asia-Pacific Journal, https://apjjf.org/2021/19/plung
19. Radio propaganda in World War II \- D-DAY Tours, https://www.d-day.tours/articles/Preaching\_to\_the\_Other\_Choir/?id=ff006cbe31
20. American Broadcasting during the Hungarian Revolution of 1956: Incitement or Observation? \- HKS Case Program, https://case.hks.harvard.edu/american-broadcasting-during-the-hungarian-revolution-of-1956-incitement-or-observation/
21. The 1956 Hungarian Revolution: A Fresh Look at the US Response (Draft, February 2012\) \- OCR of the Document | National Security Archive, https://nsarchive.gwu.edu/media/22906/ocr
22. Books about Political Ideologies \- U \- BiblioVault, https://www.bibliovault.org/BV.titles.epl?tquery=Political%20Ideologies\&letter=U\&sort=title
23. Leaflets, and the Nature of the Korean War as Psychological Warfare, https://accesson.kr/rks/assets/pdf/7510/journal-7-3-91.pdf
24. A Strategic Analysis of U.S. Special Operations During the Korean Conflict, 1950-1953 \- DTIC, https://apps.dtic.mil/sti/tr/pdf/ADA199061.pdf
25. Chieu Hoi \- Grokipedia, https://grokipedia.com/page/Chieu\_Hoi
26. Vietnam War Patch ARVN South Vietnam CHIEU HOI (OPEN ARMS) Program | eBay, https://www.ebay.com/itm/236060459236
27. Death by a Thousand Cuts: Weakening an Insurgency through a National Reconciliation Program Three Case Studies: Malaya, Vietnam \- Army War College, https://pksoi.armywarcollege.edu/wp-content/uploads/2020/06/DeathByAThousandCuts.pdf
28. Article on the Cheiu Hoi Open Arms hamlets · Journalism in Action: Beverly Deepe Keever and Her Career · Archives and Special Collections, https://archives-spec.unl.edu/keever/item/11465
29. Historical Documents \- Office of the Historian, https://history.state.gov/historicaldocuments/frus1964-68v03/d62
30. PSYOPS in Iraqi Freedom by Prof Taylor, https://universityofleeds.github.io/philtaylorpapers/vp0186cd.html
31. Treatment of Iraqi POWs in the Gulf War: 1990-1991 \- IHL in Action \- ICRC, http://ihl-in-action.icrc.org/case-study/treatment-iraqi-pows-gulf-war-1990-1991
32. Gulf War Air Power Survey Vol I \- Planning and Command and Control, https://media.defense.gov/2010/Sep/27/2001329802/-1/-1/0/gulf\_war\_air\_power\_survey-vol1.pdf
33. Lucrative Targets \- The US Air Force in the Kuwaiti Theater of Operations \- GovInfo, https://www.govinfo.gov/content/pkg/GOVPUB-D301-PURL-LPS47807/pdf/GOVPUB-D301-PURL-LPS47807.pdf
34. AN ASSESSMENT OF THE UNITED NATIONS TRANSITIONAL AUTHORITY IN CAMBODIA (UNTAC), https://resolve.cambridge.org/core/services/aop-cambridge-core/content/view/C8AD79257FA7E3429A77E4A4DD785E39/9789814379830c12\_p153-165\_CBO.pdf/an\_assessment\_of\_the\_united\_nations\_transitional\_authority\_in\_cambodia\_untac.pdf
35. UNTAC as a Model for Peacekeeping Information Operations, https://cdn.peaceopstraining.org/theses/cain.pdf
36. The Cambodia Example \- UN Peacekeeping Operations and Intelligence (U) \- CIA, https://www.cia.gov/readingroom/docs/DOC\_0006122528.pdf
37. Acquiesce for Success: UNTAC in Cambodia | United Nations Peacekeeping and the Politics of Authoritarianism | Oxford Academic, https://academic.oup.com/book/59435/chapter/500037927
38. Propaganda, media effects and conflict: Evidence from the Rwandan genocide, https://journalistsresource.org/politics-and-government/propaganda-conflict-evidence-rwandan-genocide/
39. Information and conflict: From the role of (social) media and public opinion to big data and forecasting | Economic Policy | Oxford Academic, https://academic.oup.com/economicpolicy/article/40/124/845/8269769
40. Mobilizing the Masses for Genocide \- American Economic Association, https://pubs.aeaweb.org/doi/10.1257/aer.20160999
41. Propaganda and Conflict: Evidence from the Rwandan Genocide | Harvard Kennedy School, https://www.hks.harvard.edu/publications/propaganda-and-conflict-evidence-rwandan-genocide
42. Lincoln Group \- SourceWatch, https://www.sourcewatch.org/index.php/Lincoln\_Group
43. The US Influence in Shaping Iraq's Sectarian Media By \- RePub, Erasmus University Repository, https://repub.eur.nl/pub/40223/US%20Role%20in%20Shaping%20Iraq's%20Media.pdf
44. Case-Studies-Collated-NOV-2019-1.pdf \- DemTech, https://demtech.oii.ox.ac.uk/wp-content/uploads/sites/12/2019/09/Case-Studies-Collated-NOV-2019-1.pdf
45. Online Supplement to Working Paper 2018.1 Challenging Truth and Trust: A Global Inventory of Organized Social Media Manipulation \- DemTech, https://demtech.oii.ox.ac.uk/wp-content/uploads/sites/12/2018/07/ct\_appendix.pdf
46. (PDF) The US influence in shaping Iraq's sectarian media \- ResearchGate, https://www.researchgate.net/publication/258137819\_The\_US\_influence\_in\_shaping\_Iraq's\_sectarian\_media
47. PROPAGANDA AND COUNTER-TERRORISM: STRATEGIES FOR GLOBAL CHANGE \- Manchester Hive, https://www.manchesterhive.com/display/9781847799630/9781847799630.pdf
48. (PDF) Exposure to the Russian Internet Research Agency foreign influence campaign on Twitter in the 2016 US election and its relationship to attitudes and voting behavior \- ResearchGate, https://www.researchgate.net/publication/366984613\_Exposure\_to\_the\_Russian\_Internet\_Research\_Agency\_foreign\_influence\_campaign\_on\_Twitter\_in\_the\_2016\_US\_election\_and\_its\_relationship\_to\_attitudes\_and\_voting\_behavior
49. Social media recruitment and online propaganda by extremist groups \- UNI ScholarWorks, https://scholarworks.uni.edu/cgi/viewcontent.cgi?article=1540\&context=hpt
50. Full article: Trolling for Terrorism: Searching for Signals and Noise in Internet Research Agency Messaging \- Taylor & Francis, https://www.tandfonline.com/doi/full/10.1080/08850607.2025.2460635
51. ISIS's Transition and the Interplay of Online and Face-to-Face Recruitment, https://smallwarsjournal.com/2025/09/23/isis-transition-online-and-face-to-face-recruitment/
52. Deepfakes and media literacy \- GOV.UK, https://www.gov.uk/government/publications/deepfakes-and-media-literacy/deepfakes-and-media-literacy