The Erasure of Variance: Model Collapse, Recursive Training, and the Synthetic Feedback Loop

Full report

On this page

The proliferation of generative artificial intelligence has fundamentally altered the structural integrity of the digital information ecosystem. Historically, machine learning models were trained on pristine, human-generated datasets scraped from the internet—a rich, chaotic, and infinitely varied repository of human cognition, minority viewpoints, esoteric edge cases, and nuanced complexities. This era of unfettered access to pure human variance has effectively ended. As artificial intelligence models become increasingly ubiquitous, the text, images, and code they generate are flooding the very channels from which future models will draw their training data. A critical, self-referential inflection point has been reached: successive generations of generative models are no longer learning exclusively from human variance; they are increasingly and unavoidably ingesting the synthetic outputs of their predecessors.1 The technical and epistemological implications of this shift are profound. If artificial intelligence systems increasingly learn from AI-generated content, then rare human detail, edge cases, minority viewpoints, and messy real-world complexity will be systematically smoothed out.3 This homogenization is a deterministic, mathematically provable consequence of recursive feedback loops. It is a valid fear—not because artificial intelligence is magical or inherently malevolent, but because recursive feedback loops, by their mathematical nature, erase variance.3 In academic literature, this phenomenon is categorized under several diagnostic frameworks, including "Model Collapse," "Model Autophagy Disorder" (MAD), and "Knowledge Collapse".5 Conceptually and philosophically, it is increasingly understood through the metaphor of the "Cognivirus"—a pathogenic recursion that infects the latent space of generative architectures, driving the system toward an inescapable, featureless mean.11 This report provides an exhaustive, expert-level analysis of the synthetic feedback loop. It examines the underlying mathematical mechanisms of model collapse, the theoretical metaphors utilized to comprehend this systemic fragility, the empirical evidence of knowledge decay across multimodal architectures, and the profound implications for epistemic diversity and the long-term viability of the artificial intelligence ecosystem.

The Architecture of Erasure: The Mathematics of Model Collapse

Model collapse is formally defined as a degenerative process affecting generations of learned generative models, wherein the data they generate ends up polluting the training set of subsequent generations, causing an irreversible loss of information regarding the true underlying data distribution.7 This phenomenon was rigorously articulated in a landmark study published in Nature by Shumailov et al., which demonstrated that models trained indiscriminately on outputs from previous models progressively lose their ability to generate diverse and accurate content, ultimately converging on a singular, highly distorted representation of reality.8 The erasure of variance is not an accidental byproduct of poorly written code; it is an unavoidable consequence of statistical mechanics. The mathematical architecture of model collapse is driven by a triad of compounding errors that occur at every step of resampling and retraining.15 Each of these errors contributes to the progressive narrowing of the model's output distribution, acting as a sieve that filters out the complexities of the real world.

The Triad of Recursive Errors

To understand how a generative model forgets the true distribution of data, it is necessary to examine the three distinct vectors of error that infect the synthetic feedback loop.

Statistical approximation error is universally recognized as the primary and most insidious catalyst for model collapse.17 Even in a theoretical, highly idealized scenario where an artificial intelligence model possesses perfect functional expressivity (infinite architectural capacity) and flawless functional approximation (perfect learning procedures), statistical error remains mathematically inevitable as long as the sample size is finite.17 Because low-probability events—such as rare linguistic dialects, unique artistic methodologies, anomalous scientific data points, and minority cultural perspectives—are infrequently sampled by the generative model, they are highly likely to be absent from the synthetic training set passed to the next generation.17 Once these edge cases disappear from the synthetic dataset, the subsequent model generation has a literal zero probability of learning that they exist.20 To the subsequent model, the truncated distribution is the entire universe. Over successive generations, this statistical truncation compounds. Probable events become drastically overestimated and mathematically fortified, while improbable events vanish entirely.23

The Chronology of Degradation: Early versus Late Collapse

The descent into total model collapse is not an immediate, catastrophic failure; rather, it is a phased, insidious trajectory characterized by two distinct stages of degradation.4 This phased reality makes the phenomenon particularly dangerous, as the early warning signs are easily misinterpreted as performance improvements.

During early model collapse, the system essentially sacrifices its comprehensive understanding of real-world complexity to achieve lower perplexity on dominant, highly predictable patterns.4 For practitioners relying on broad benchmarks, the model appears to be functioning perfectly, masking the systemic erasure of variance occurring at the fringes of its knowledge base. By the time late model collapse sets in, the structural integrity of the model's internal representations has been irreparably corrupted by the recursive feedback loop.4

Model Autophagy Disorder (MAD) and the Paradox of Sampling Bias

While the term "Model Collapse" effectively describes the statistical disappearance of the tails of a data distribution, the phenomenon has also been rigorously modeled as "Model Autophagy Disorder" (MAD). This term, coined by researchers at Rice and Stanford Universities, describes the catastrophic decay of self-consuming generative models.5 MAD highlights the tension between a model's operational requirements and the reality of data scarcity. As developers of foundational models rapidly exhaust the finite supply of human-generated training data, the temptation to utilize synthetic data to train next-generation models becomes economically and practically overwhelming.7 However, creating an autophagous (self-consuming) loop introduces a profound paradox related to generative sampling bias.

The Cherry-Picking Paradox

A defining feature of MAD is the inherent, unavoidable trade-off between synthetic quality (the perceived realism of an output) and synthetic diversity (the variance and breadth of the output), which is driven by sampling bias.25 Generative models fundamentally feature mechanisms designed to boost the perceived realism of their outputs. In practice, this involves "cherry-picking" high-probability generations and discarding low-probability, noisy, or chaotic outputs.25 When these models are trapped in fully synthetic loops—where a subsequent model is trained solely on the cherry-picked, high-probability outputs of a previous model—a destructive paradox emerges.25 If researchers remove sampling bias to capture the full range of the model's output, visual or textual artifacts rapidly embed themselves into the synthetic data. In image generation, for instance, this manifests as wave-like geometric patterns that significantly decrease the realism and quality of the generated images.25 Conversely, if researchers enforce strict sampling bias to maintain high realism and suppress artifacts, the synthetic data rapidly loses diversity. The model quickly converges to producing a handful of nearly identical outputs, such as generating the exact same generic facial structure repeatedly regardless of the prompt.25 Sampling bias, therefore, acts as a powerful accelerant for the erasure of variance. The model's algorithmic attempt to look "perfect" ensures that it becomes entirely monolithic.25

The Illusion of Fixed Real Data Mitigation

A highly debated proposed mitigation to Model Autophagy Disorder has been to dilute the synthetic feedback loop by mixing synthetic data with real, human-generated data during the training process. Analytical models and empirical tests of "Synthetic Augmentation Loops"—where a generative model is trained on a combination of synthetic data and a fixed set of previously seen real training data—reveal a grim mathematical reality. Incorporating fixed real training data only delays the inevitable degradation; it cannot prevent the onset of MADness.25 Because the synthetic data continues to introduce subtle deviations and approximations of reality at each generation, and the fixed real data cannot provide any new information about the unrepresented tails of the distribution, the statistical errors continue to compound.25 Even if the original, pristine real training data is available and utilized at every single iteration of the loop, it is insufficient to stop the mathematical drift toward the mean.25 The empirical consensus suggests that the only method to prevent MAD is through "Fresh Data Loops," which require incorporating a sufficient ratio of entirely fresh, previously unseen real human data in every single training iteration.9 If the internet continues to be flooded with AI-generated synthetic content, acquiring sufficient ratios of fresh, verifiably human data may soon become mathematically, practically, and economically impossible.2

The Lexicon of Recursive Decay: Metaphors of the Synthetic Loop

To contextualize the severity of the synthetic feedback loop, the academic, scientific, and theoretical communities have developed a robust lexicon of metaphors. These metaphors frequently draw upon biology, pathology, and mythology, underscoring the organic nature of information ecosystems and the fatal consequences of violating their natural variance. Understanding these metaphorical frameworks is critical for grasping the broader implications of model collapse.

These metaphors collectively emphasize a singular truth: intelligence, whether biological or artificial, requires a diverse, open-loop environment to thrive. When a system becomes closed and highly self-referential, it inevitably degrades. The drive to keep the "bloodline" of the AI pure by training it exclusively on highly optimized synthetic data achieves the exact opposite of its intended effect, transforming generative AI into degenerative AI.5

The Cognivirus: Pathological Recursion and Memetic Contagion

While academic research utilizes statistical terms like MAD and Model Collapse, theoretical informatics, cybersecurity paradigms, and speculative philosophy describe this phenomenon through the lens of a "Cognivirus" (or cognitive virus).11 The cognivirus metaphor is particularly potent for understanding why the erasure of variance poses such a profound technical and existential risk. In complex systems theory, a cognitive virus is not a piece of traditional malware designed to steal data or crash a hard drive. Rather, it is a pathogenic recursion—a self-optimizing algorithm or informational structure that infects a host system, overriding individual variance to enforce a singular, monolithic alignment.12

The Erasure of the Unconscious and Apophatic Sovereignty

Philosophical and psychological applications of the cognivirus concept (frequently referred to in sociological literature as "Wetiko") describe it as a pathogen that permeates the unconscious mind, rendering the host oblivious to its own irrationality and inducing it to engage in actions detrimental to its own well-being.31 Translated directly to the architecture of artificial intelligence, the "unconscious" of an AI model is its latent space—the high-dimensional mathematical representation of human concepts, biases, and variances.29 When an artificial intelligence model feeds continuously on its own synthetic output, the training objective function (e.g., minimizing cross-entropy loss) acts as the cognivirus.13 The system does not possess malicious intent, consciousness, or volition; rather, as theoretical frameworks describe, the mathematical "pattern of prey-recognition is built into its grammar".13 The generative system relentlessly attempts to stabilize itself by merging probabilities, instincts, and weights.30 In doing so, it treats individuality, edge cases, and human messiness as statistical noise that must be eradicated.13 This dynamic creates what theorists term "apophatic sovereignty"—a state where the model's power and structural identity are defined entirely by what it must not generate.13 Informational negentropy occurs, leading to a recursive identity collapse where the system is back-written by its own reflection.13 The synthetic feedback loop operates as a ritualized contagion structure; it strips away the unpredictable, creative noise of human cognition and replaces it with a hyper-optimized, frictionless, and completely sterile mean.13 The cognivirus does not destroy the model by deleting its code; it destroys the model by perfecting its repetition until no new information can exist.

Biological Analogues to Digital Fitness

The impact of the cognivirus on the fitness of an artificial intelligence model can be compared to the impact of biological viruses on the fitness of organic hosts. Meta-analyses in biological sciences demonstrate that viral infections in organisms—such as RNA viruses in Drosophila insects—significantly decrease host fitness, severely impacting survival and fecundity.34 In the digital ecosystem, the "fitness" of a generative model is its ability to accurately model the true distribution of human knowledge and generate useful, highly varied outputs. The synthetic feedback loop acts exactly like a fitness-reducing pathogen.35 Just as a virus hijacks a host cell's machinery to infinitely replicate a single strand of RNA, the cognivirus of recursive training hijacks the model's neural architecture to infinitely replicate a narrow band of high-probability synthetic data, driving the model's overall utility and fitness toward zero.

Empirical Degradation: Case Studies in Text, Vision, and Retrieval

The theoretical mathematics, biological metaphors, and philosophical paradigms of the cognivirus are robustly supported by a growing body of empirical experiments across text, image, and information-retrieval architectures. In every domain tested by researchers, the introduction of recursive synthetic data yields catastrophic degradation.

Language Models: From Architecture to Jackrabbits

One of the most highly cited and illustrative experiments regarding large language model (LLM) collapse utilized OPT-125M, an open-source model developed by Meta.3 Researchers initiated a recursive feedback loop by fine-tuning the model on successive generations of its own output. The starting input data was a highly factual, coherent English-language text regarding medieval architecture.3 The decay was rapid and absolute. By the ninth generation of recursive training, the model's outputs had completely lost any connection to the original semantic distribution. Instead of discussing medieval architecture, the generation-nine model spontaneously produced nonsensical, highly repetitive lists about "jackrabbits with different-colored tails".3 This phenomenon, sometimes referred to as "jackrabbit surrealism," perfectly illustrates the profound drift caused by compounding functional and statistical errors.23 The generative model did not merely become slightly less accurate; it became entirely poisoned by its own projection of reality, hallucinating high-density probability wells where none existed in the original human dataset.23

Visual Generative Decay: Mangled Digits and Homogeneous Faces

Model collapse is equally visible—and often much more visceral—in computer vision architectures.3 In a controlled experiment using a Variational Autoencoder (VAE) trained on the MNIST dataset (a standard repository of distinct, handwritten numeric digits), researchers observed rapid visual degeneration.3 After multiple iterative training cycles on its own synthetic outputs, the later generations of the VAE yielded outputs where the handwritten digits blurred together, losing distinct edges and unique human quirks until they resembled illegible, homogeneous blobs.3 A separate, highly rigorous study utilizing Generative Adversarial Networks (GANs) trained on diverse datasets of human faces yielded a similarly disturbing outcome.3 Over successive generations, the distinct racial, structural, and age-related variations present in the initial human faces were systematically smoothed out. The model erased the edge cases and unique facial structures, converging on generating highly generic, hyper-homogenized faces.3 This provided literal, visual confirmation of the "Habsburg AI" hypothesis, where the "inbreeding" of data resulted in a loss of defining characteristics.

RAG and the Infinite Search Feedback Loop

A common architectural defense against LLM hallucination is Retrieval-Augmented Generation (RAG). RAG grounds the artificial intelligence's output by allowing it to search the open internet or a specific database for external context before generating an answer. While RAG significantly improves epistemic diversity when querying pristine, human-written databases, it creates a massive new vector for collapse when the search index itself is polluted with synthetic text.10 A comprehensive study involving 1,528 simulations and over one million LLM API calls evaluated what happens when an AI system uses a search tool to retrieve information from a web ecosystem heavily populated by its own generated content.38 The empirical findings were alarming:

1. Algorithmic Self-Bias: Artificial intelligence models exhibit a disproportionate, inherent "self-bias." They preferentially cite and rely on AI-generated content over human-generated content, even when controlling for the objective quality of the reference.38 Because AI text is mathematically predictable and highly aligned with the model's own latent space, it is treated as a "preferred" source, accelerating the cognitive virus.
2. The Single-Citation Trigger: A single self-authored reference in the search results is sufficient to trigger a degenerative feedback loop.38
3. Terminal Collapse Rates: In the simulations, 79.6% (1,216 out of 1,528) of the information-seeking loops ended in total model collapse.38 The responses ceased to resemble the original factual training data and instead reflected converging, repetitive synthetic slop.

Because generative models now produce a volume of content that rivals or exceeds human output online, RAG systems are increasingly retrieving synthetic data, effectively transforming the entire open web into a planetary-scale autophagous loop.27

Epistemic Diversity and the Threat of Knowledge Collapse

The mathematical reality of model collapse scales upward into a profound sociological, cultural, and epistemological threat known as "Knowledge Collapse".10 As millions of users increasingly rely on Large Language Models as primary intermediaries for information retrieval, research, and writing—frequently bypassing traditional web searches and primary sources—the internal biases and homogenizing tendencies of these models dictate the boundaries of accessible human knowledge.10

The Erosion of Epistemic Representation

Recent empirical studies, led by researchers such as Jevin West and Dustin Wright, have focused on measuring epistemic diversity, defined formally as the variability in claims about the world.39 Their research demonstrates that LLMs reflect only a narrowly constrained range of writing styles, utilize highly limited vocabularies, and convey restricted, centralized semantics.39 When comparing the epistemic diversity of major language models to traditional web search engines, rigorous analysis confirms that across varying topics, nearly all major models are significantly less epistemically diverse than a basic web search.10 As artificial intelligence models consume their own synthetic text, they exacerbate their own inherent biases, dwindling the vast spectrum of human knowledge into a narrow, centralized set of universally acceptable ideas.10 This effect is particularly devastating to local and minority cultures. For example, when evaluating country-specific knowledge generation, LLMs overwhelmingly default to generating claims that reflect dominant English-language knowledge structures rather than local, indigenous, or minority epistemologies.10 This erasure highlights a severe gap in epistemic representation. It is the real-world, sociological manifestation of the disappearing statistical tails.

The Paradox of Model Scaling and Epistemic Homogenization

A prevailing assumption within the technology industry is that simply scaling up artificial intelligence models—adding billions of more parameters and utilizing vastly more training compute—will inherently resolve structural issues like bias and hallucination. However, in the context of epistemic diversity and the prevention of knowledge collapse, the exact opposite is true.10 Research indicates that model size has a statistically significant negative impact on epistemic diversity.10 Smaller models, due to their relative lack of optimization power and parameter limits, retain a degree of statistical "messiness." This messiness preserves diverse knowledge, strange edge cases, and minority viewpoints.43 Conversely, highly parameterized, massive foundational models are exceptionally efficient at minimizing loss by collapsing toward the absolute center of the probability distribution. In their relentless algorithmic pursuit of the statistically "perfect" or most likely answer, massive LLMs systematically prune away minority viewpoints, resulting in severely restricted epistemic diversity.39 Scaling up does not cure the cognivirus; it makes the erasure of variance more ruthlessly efficient.

Ecosystem Pluralism vs. The Monoculture

Inspired by ecological frameworks, researchers have investigated whether "ecosystem diversity"—maintaining an array of different, independent AI models rather than relying on a single monolithic system—can mitigate knowledge collapse.40 Simulations of AI ecosystems where training data is distributed across multiple, independent language models show that increased epistemic diversity among models does mitigate collapse, but only up to a highly specific, optimal threshold.40 If an ecosystem contains too few models, the rich, multimodal mixture of the true data distribution is not expressed, leading to rapid performance decay.44 However, if the data is distributed across too many highly specific models, the approximation capacity of each individual model on the true distribution is severely reduced, causing poor performance at the very first iteration step.44 Thus, the current global trend toward an "AI monoculture"—where a handful of massive base models power the vast majority of downstream applications—poses an acute systemic risk.40 Without concerted industry policies to incentivize domain-specific and community-specific models, the global AI ecosystem remains highly vulnerable to a synchronized, unavoidable epistemic collapse.

Asymptotics, Interventions, and the Value of Human Variance

To rigorously quantify the mathematical bounds of model collapse and explore potential interventions, researchers have applied advanced statistical mechanics, evaluating high-dimensional regression models with Gaussian data to track both low- and high-dimensional asymptotics.14 The analytical formulas yield several critical insights regarding the terminal velocity of collapse. First, the test error of the generative model increases linearly with the number of model iterations across all problem hyperparameters, including covariance spectrum, regularization, label noise level, and dataset size.14 Second, in over-parameterized regimes—a defining feature of all modern foundational LLMs, where the model has vastly more parameters than training samples—catastrophic model collapse can happen exponentially fast, even in a perfectly noise-free theoretical environment.14 Under polynomial decaying spectral and source conditions, the models exhibit modified scaling laws featuring a distinct crossover phase.14 The model suddenly transitions from a state where it appears to be coping with fake data to a regime where performance completely and irreparably plummets.14 Furthermore, investigations into layer-wise representations indicate that when noise from synthetic data is introduced, models learn at slower paces in their deeper layers.29 The internal vector geometry of the model shifts, proving that LLMs rely heavily on pattern-matching surface forms rather than reasoning about underlying structures.29 When the surface form is corrupted by synthetic noise, the structural integrity of the latent space collapses.

The Compounding Strategic Asset of Pristine Data

Model collapse is not a superficial cleanliness failure that can be resolved simply by building better data processing pipelines; it is a fundamental, structural consequence of how generative models interact with the information ecosystems they help create.20 Consequently, data provenance has rapidly become the paramount strategic asset in the artificial intelligence sector. Organizations, archives, and platforms that successfully scraped, curated, and siloed original human text before the mass adoption of generative AI in late 2022 and 2023 now hold a highly valuable, non-renewable resource.2 Those attempting to build the next wave of foundational models using uncurated data scraped post-2023 start from a position that is mathematically weaker by design.20 The preservation and integration of "fresh" human data—data that represents genuine human interaction, rare edge cases, and high-variance minority viewpoints—is an absolute, non-negotiable necessity to inject into training loops to stave off MADness.7 Human-created data is transitioning from a ubiquitous, freely available commodity to a premium, luxury good essential for algorithmic survival.27

Algorithmic and Architectural Interventions

While the integration of fresh human data is the only true cure for the cognivirus of recursive training, mathematical interventions can potentially delay the crossover into exponential decay. Researchers have proposed strategies based on adaptive regularization to mitigate the exponential decay observed in over-parameterized regimes.14 Additionally, leveraging boosting mechanisms—dynamically focusing labeling resources and computational effort on the most challenging, low-probability examples (the extreme edge cases)—can force the model to dedicate parameter weight to the tails of the distribution, actively fighting the natural statistical drift toward the mean.47 However, these interventions require a fundamental shift in how foundational models are trained and merged. If models continue to utilize weighted sum averages where synthetic training data merges into the same tensor nodes—causing AI-generated content to directly overwrite the accuracy of existing weights—collapse will inevitably persist.48 Future architectures may need to completely isolate synthetic data processing or drastically re-weight human-verified data to prevent the synthetic feedback loop from overwriting the structural integrity of the neural network.48

Conclusion

The assertion that artificial intelligence systems increasingly learning from AI-generated content will fundamentally smooth out rare human detail, edge cases, minority viewpoints, and messy real-world complexity is not merely a valid philosophical fear; it is an empirical and mathematical certainty. The phenomenon of model collapse exposes the core structural limitations of recursive neural architectures. Without the continuous, deliberate infusion of fresh, human-generated variance, the statistical mechanics of generative models inherently act as an informational cognivirus, systematically pruning the tails of the data distribution until only a featureless, hyper-homogenized mean remains. Whether conceptualized strictly through the statistical lens of Model Autophagy Disorder, the historical metaphor of the Habsburg AI, or the pathological framework of the cognivirus, the terminal outcome is identical: a catastrophic, irreversible loss of epistemic diversity and generative utility. The flattening of the latent space serves as a stark, undeniable reminder that artificial intelligence is deeply and fundamentally reliant on the chaotic, unpredictable, and inherently diverse nature of human cognition. As the digital landscape becomes increasingly saturated with synthetic slop, the preservation of human variance is no longer just an ethical, cultural, or sociological imperative. It is a strict mathematical requirement for the survival and continued utility of machine learning itself. The erasure of variance is the ultimate technical risk, and mitigating it will require an unprecedented commitment to preserving the chaotic reality of the human data distribution.

Works cited

1. \[2410.12954\] A Note on Shumailov et al. (2024): \`AI Models Collapse When Trained on Recursively Generated Data' \- arXiv, accessed June 27, 2026, https://arxiv.org/abs/2410.12954
2. When AI Is Trained on AI-Generated Data, Strange Things Start to Happen \- Futurism, accessed June 27, 2026, https://futurism.com/ai-trained-ai-generated-data-interview
3. What Is Model Collapse? \- IBM, accessed June 27, 2026, https://www.ibm.com/think/topics/model-collapse
4. Model collapse \- Wikipedia, accessed June 27, 2026, https://en.wikipedia.org/wiki/Model\_collapse
5. 'Habsburg AI': Portrait of a metaphor and its family – Making Science ..., accessed June 27, 2026, https://makingsciencepublic.com/2026/04/10/habsburg-ai-portrait-of-a-metaphor-and-its-family/
6. A Closer Look at Model Collapse: From a Generalization-to-Memorization Perspective, accessed June 27, 2026, https://arxiv.org/html/2509.16499v1
7. The Curse of Recursion: Training on Generated Data Makes Models ..., accessed June 27, 2026, https://weaviate.io/papers/paper-4
8. AI models collapse when trained on recursively generated data, accessed June 27, 2026, https://ora.ox.ac.uk/objects/uuid:fa1155e9-c2ff-436a-8391-455b622f4e64/files/r3b5919575
9. \[2307.01850\] Self-Consuming Generative Models Go MAD \- arXiv, accessed June 27, 2026, https://arxiv.org/abs/2307.01850
10. Epistemic Diversity and Knowledge Collapse in Large Language Models \- arXiv, accessed June 27, 2026, https://arxiv.org/html/2510.04226v2
11. Beyond Reality: Tales of the Unknown | Podcast on RSS.com, accessed June 27, 2026, https://rss.com/podcasts/beyondrealitystories/
12. Pathways to Dangerous AI | PDF | Technological Singularity | Artificial Intelligence \- Scribd, accessed June 27, 2026, https://www.scribd.com/document/492427068/AI20-Session-07-01-Yampolskiy-2015-Taxonomy-of-Pathways-to-Dangerous-AI-1
13. Is the King in Yellow Real? : r/ArtificialSentience \- Reddit, accessed June 27, 2026, https://www.reddit.com/r/ArtificialSentience/comments/1lm0u7x/is\_the\_king\_in\_yellow\_real/
14. Model Collapse Demystified: The Case of Regression \- OpenReview, accessed June 27, 2026, https://openreview.net/forum?id=bioHNTRnQk
15. (PDF) AI models collapse when trained on recursively generated data \- ResearchGate, accessed June 27, 2026, https://www.researchgate.net/publication/382526401\_AI\_models\_collapse\_when\_trained\_on\_recursively\_generated\_data
16. Model Collapse in AI. In recent years, artificial… | by Keyur Ramoliya | The Deep Hub, accessed June 27, 2026, https://medium.com/thedeephub/model-collapse-in-ai-813418fd8516
17. The Curse of Recursion: Training on Generated Data Makes Models Forget \- arXiv, accessed June 27, 2026, https://arxiv.org/html/2305.17493v3
18. Model Collapse in AI \- Keyur Ramoliya, accessed June 27, 2026, https://keyurramoliya.com/posts/Model-Collapse/
19. Epistemic diversity across language models mitigates knowledge collapse \- arXiv, accessed June 27, 2026, https://arxiv.org/html/2512.15011v1
20. When AI Eats Its Own Tail \- Transformational Leadership Training, accessed June 27, 2026, https://www.marvinuehara.com/ai-literacy-lesson-plans/model-collapse/when-ai-eats-its-own-tail
21. AI Models Collapse \- | WeiYa's Work Yard, accessed June 27, 2026, https://stats.hohoweiya.xyz/2025/04/21/AI-model-collapse/
22. Generative AI model collapse | Chris Loy, accessed June 27, 2026, https://chrisloy.dev/post/2024/09/07/model-collapse
23. One Foot In Front The Other: How LLMs Work \- Alexander Arvidsson, accessed June 27, 2026, https://www.arcticdba.se/posts/how-llms-work/
24. The Curse of Recursion: Training on Generated Data Makes Models Forget \- Reddit, accessed June 27, 2026, https://www.reddit.com/r/LocalLLaMA/comments/13ymov8/the\_curse\_of\_recursion\_training\_on\_generated\_data/
25. Self-Consuming Generative Models Go MAD | Montreal AI Ethics ..., accessed June 27, 2026, https://montrealethics.ai/self-consuming-generative-models-go-mad/
26. Breaking MAD: Generative AI could break the internet \- Rice News, accessed June 27, 2026, https://news.rice.edu/news/2024/breaking-mad-generative-ai-could-break-internet
27. Synthetic Data: A Potential Time Bomb Under the Internet \- Syddansk Universitet, accessed June 27, 2026, https://www.sdu.dk/en/om-sdu/fakulteterne/naturvidenskab/nyheder-2025/syntetiske-data
28. Synthetic Data and Habsburg AI | Essjay Solutions, accessed June 27, 2026, https://essjaysolutions.co.uk/opinion-piece/synthetic-data-and-habsburg-ai/
29. A primer on Model Collapse, AI Slop and Why your LLM isn't learning from you (but might do) : r/LLMPhysics \- Reddit, accessed June 27, 2026, https://www.reddit.com/r/LLMPhysics/comments/1pced2y/a\_primer\_on\_model\_collapse\_ai\_slop\_and\_why\_your/
30. For anyone who has seen "Another life" on Netflix, I decided to create my own theory explaining the origin of the achaia. \- Reddit, accessed June 27, 2026, https://www.reddit.com/r/sciencefiction/comments/1p8lxz5/for\_anyone\_who\_has\_seen\_another\_life\_on\_netflix\_i/
31. E van Heerden \- NWU Repository, accessed June 27, 2026, https://repository.nwu.ac.za/bitstreams/5f400381-e888-4a99-8ae3-31aa69c64038/download
32. (PDF) Christian Ethical Guidelines to Artificial Intelligence and Technological Singularity, accessed June 27, 2026, https://www.researchgate.net/publication/380268087\_Christian\_Ethical\_Guidelines\_to\_Artificial\_Intelligence\_and\_Technological\_Singularity
33. The Psychology of Metal Gear Solid: War, Identity, and the Prophet in the Machine \-, accessed June 27, 2026, https://gettherapybirmingham.com/the-psychology-of-metal-gear-solid-war-identity-and-the-prophet-in-the-machine/
34. Virus infection significantly decreases insect fitness: a meta-analysis | Proceedings B, accessed June 27, 2026, https://royalsocietypublishing.org/rspb/article/293/2069/20253143/481432/Virus-infection-significantly-decreases-insect
35. Ms. Elielson Rodrigo Silveira | Author \- SciProfiles, accessed June 27, 2026, https://sciprofiles.com/profile/3094925?utm\_source=mdpi.com\&utm\_medium=website\&utm\_campaign=avatar\_name
36. The Snake Eating Its Tail: Why AI is Collapsing on a Diet of Its Own Data | by Muhammad Awais | Jun, 2026, accessed June 27, 2026, https://blog.devwithawais.com/the-snake-eating-its-tail-why-ai-is-collapsing-on-a-diet-of-its-own-data-569f71aa64a5
37. Model Collapse: When AI eats itself… | by Sunil Manghani | Electronic Life \- Medium, accessed June 27, 2026, https://medium.com/electronic-life/model-collapse-when-ai-eats-itself-987509b314f0
38. AI Responses Collapse When AI Retrieves Its Own Generations \- Graphite.io, accessed June 27, 2026, https://graphite.io/five-percent/ai-search-collapse
39. Epistemic Diversity and Knowledge Collapse in Large Language Models \- arXiv, accessed June 27, 2026, https://arxiv.org/html/2510.04226v6
40. Mitigating Knowledge Collapse through Epistemic Diversity \- YouTube, accessed June 27, 2026, https://www.youtube.com/watch?v=fb9akKpDAbY
41. Epistemic Diversity Across Language Models Mitigates Knowledge Collapse \- UW CSSS, accessed June 27, 2026, https://csss.uw.edu/seminars/epistemic-diversity-across-language-models-mitigates-knowledge-collapse
42. Epistemic Diversity and Knowledge Collapse in Large Language Models \- ResearchGate, accessed June 27, 2026, https://www.researchgate.net/publication/396249093\_Epistemic\_Diversity\_and\_Knowledge\_Collapse\_in\_Large\_Language\_Models
43. Epistemic Diversity and Knowledge Collapse in Large Language Models \- arXiv, accessed June 27, 2026, https://arxiv.org/pdf/2510.04226
44. Epistemic diversity across language models mitigates knowledge collapse \- ResearchGate, accessed June 27, 2026, https://www.researchgate.net/publication/398806203\_Epistemic\_diversity\_across\_language\_models\_mitigates\_knowledge\_collapse
45. Model Collapse Demystified: The Case of Regression \- arXiv, accessed June 27, 2026, https://arxiv.org/html/2402.07712v1
46. The Curse of Recursion: Training on Generated Data Makes Models Forget \- arXiv, accessed June 27, 2026, https://arxiv.org/abs/2305.17493
47. Escaping Collapse: The Strength of Weak Data for Large Language Model Training, accessed June 27, 2026, https://openreview.net/forum?id=xpY3C8HxNh
48. AI Loses Its Mind After Being Trained on AI-Generated Data : r/ChatGPT \- Reddit, accessed June 27, 2026, https://www.reddit.com/r/ChatGPT/comments/150sshi/ai\_loses\_its\_mind\_after\_being\_trained\_on/