Semantic Systems / Language / Glyphs
Security and Abuse Threat Model for Embedded Semantics
Report summary
Embedded Semantics should be treated as a semantic certificate authority plus package registry plus resolver , not merely as a searchable ontology. Its own architecture makes stable ConceptCode records, definitions, reviewed expression evidence, provenance, and registry state authoritative, while em
Key topics
- Semantic Systems / Language / Glyphs
- Semantic Systems
- Language
- Glyphs
- AI
- Agentic Web
- SEO
- Runtime
- Privacy
Research provenance
For citation, use the report title and canonical URL. Archival presence does not establish authorship or promote report statements into portfolio evidence.
Source availability: 107 citation markers in the source export have no recoverable source links. Those markers are omitted from this reader; any supplied bibliography and ordinary links remain. Check the original sources before relying on the cited claims.
This page renders the archived Markdown as safe, formatted HTML. It is background research and does not become a portfolio claim without evidence review.
Full report
On this page
Executive assessment and research basis
Executive summary
Embedded Semantics should be treated as a semantic certificate authority plus package registry plus resolver, not merely as a searchable ontology. Its own architecture makes stable ConceptCode records, definitions, reviewed expression evidence, provenance, and registry state authoritative, while embedding vectors are explicitly non-authoritative evidence. The production design currently resolves only reviewed exact expressions and abstains when exact authority is unavailable; model-backed semantic generalization is explicitly described as experimental.
That distinction is security-positive, but it raises the stakes of the registry itself. If autonomous agents, applications, or models eventually treat a ConceptCode as the canonical meaning of text, then a successful registry mutation may be more consequential than ordinary content defacement: an attacker could cause downstream software to interpret legitimate text as the wrong concept while all systems continue functioning normally. The most dangerous failures are therefore silent integrity failures—poisoned mappings, forged provenance, malicious merges, malicious deprecations, compromised reviewers, resolver equivocation, stale-state attacks, or a poisoned semantic candidate model—rather than conventional outages.
The public deployment examined on August 23, 2026 is still materially pre-release. Its status endpoint reports zero published concepts, zero reviewed exact expressions, zero active embedding profiles, a reviewed_exact_registry_first resolver, and a semantic runtime that is not configured. It also reports that all eleven expected bootstrap concepts and all fifty-five expected expressions are absent from the deployed registry. Separately, the published pre-release bundle manifest declares eleven concepts and fifty-five expressions across two source packs and includes SHA-256 digests. This is explicitly described by the project as an incomplete deployment rather than a completed registry.
That live discrepancy is important to this threat model. It is not evidence of a security vulnerability, but it demonstrates that “repository-governed state,” “bundle state,” and “deployed resolver state” can diverge. In a mature registry, the security design must make such divergence cryptographically visible to clients and must define which state is authoritative, how freshness is established, and how rollback, freeze, mix-and-match, and partial-deployment states are handled. TUF was created specifically to protect update systems against rollback, indefinite freeze, mix-and-match, wrong-artifact, and key-compromise scenarios of this class.
The public manifest observed during this research exposes SHA-256 hashes for the bundle and component packs, but the manifest response itself does not expose a cryptographic signature or signer identity. A digest detects accidental or adversarial modification only when the expected digest is obtained through a trusted channel; it does not by itself authenticate who authorized a registry state. This threat model therefore recommends signed, versioned, expiring registry snapshots rooted in an offline threshold trust anchor, combined with an append-only transparency log and independent monitoring.
The highest inherent risks under the user's stipulated “critical infrastructure” deployment model are:
| Priority | Risk | Inherent severity |
|---|---|---|
| R1 | Compromise of registry mutation authority or administrator credentials | Critical |
| R2 | Reviewer-account compromise or collusive approval of poisoned semantics | Critical |
| R3 | Malicious or unauthorized Concept merge/deprecation | Critical |
| R4 | Resolver, replica, or federation state equivocation | Critical |
| R5 | Registry/provenance signing-key compromise | Critical |
| R6 | Semantic supply-chain or build-pipeline compromise | Critical |
| R7 | Malicious federation member injecting authoritative-looking concepts | Critical |
| R8 | Corpus/model/embedding poisoning after semantic generalization is enabled | Critical |
| R9 | Namespace squatting, semantic impersonation, or deceptive near-neighbor concepts | High |
| R10 | Unicode/confusable/language-tag deception bypassing human review | High |
| R11 | Prompt injection embedded in descriptions/provenance consumed by AI agents | High |
| R12 | Rollback, replay, stale replicas, cache poisoning, or signature downgrade | High |
These rankings are prospective. Because the public registry currently contains no published concepts and the arbitrary-query semantic runtime is inactive, several risks cannot presently have the same downstream consequence they would have after public expansion.
Scope and limitations
This is a black-box architecture and threat-model review. No source code was available or used. Research covered public pages, the public concept and status APIs, llms.txt, the pre-release bundle manifest, public registry status, and public architectural descriptions. The site advertises its Concept API, status endpoint, resolver endpoint, registry-pack schema, and registry packs for machine use; robots.txt currently allows crawling by all user agents.
The reviewed public documentation describes reviewed expressions, provenance, equivalence evidence, versions, and an exact registry-first resolver, but it does not publicly establish the production mechanics of registrant authentication, reviewer assignment, administrator authorization, signing-key custody, quorum policy, transparency logging, federation trust, or mutation endpoints. Accordingly, controls in those areas below are required-design recommendations, not claims about missing implementation.
The threat analysis uses STRIDE for system-security threats, LINDDUN for privacy, OWASP for web/API/LLM threats, MITRE ATT&CK for applicable adversary techniques, SLSA for artifact/provenance threats, TUF for signed-distribution and anti-rollback properties, Sigstore and Certificate Transparency for transparency concepts, DNSSEC for federated trust discovery, and Unicode/IETF standards for multilingual identifier safety. Microsoft defines STRIDE as Spoofing, Tampering, Repudiation, Information Disclosure, Denial of Service, and Elevation of Privilege; LINDDUN focuses on Linking, Identifying, Non-repudiation, Detecting, Disclosure, Unawareness, and Non-compliance.
System model: assets, boundaries, actors, and attack surfaces
Assets
Semantic identities are the primary protected asset. A ConceptCode is intended to remain stable while models and language expressions change. The registry records, definitions, reviewed multilingual expressions, equivalence strength, provenance, and registry version collectively determine authoritative meaning.
The complete high-value asset inventory should include:
| Asset | Why compromise matters |
|---|---|
| ConceptCode identities | Reassignment or impersonation changes what downstream consumers believe a stable identifier means. |
| Concept definitions | A definition can be subtly altered while the stable identifier remains unchanged. |
| Expression-to-Concept mappings | Poisoning directly changes deterministic exact resolution. |
| Equivalence evidence | False “equivalent” claims can collapse distinct meanings. |
| Language/locale annotations | Incorrect tags can cause cross-language semantic misresolution. |
| Relationships between Concepts | Poisoning broader/narrower/related/equivalent links can contaminate reasoning graphs. |
| Merge history | Unauthorized merges can permanently collapse semantic distinctions. |
| Deprecation and supersession records | Malicious deprecation can redirect consumers away from legitimate concepts. |
| Provenance records | Forgery makes malicious semantics appear reviewed or authoritative. |
| Reviewer decisions and identities | Reviewer authority is part of the semantic chain of custody. |
| Administrative control plane | Can rewrite policy, trust roots, reviewer membership, or publication state. |
| Registry versions and snapshots | Determine freshness and enable historical reconstruction. |
| Signing keys and federation trust anchors | Compromise permits apparently authentic malicious state. |
| Audit/transparency records | Necessary to prove who authorized which change and detect equivocation. |
| Resolver implementation/state | A compromised resolver can return false semantics without modifying canonical storage. |
| CDN/cache/replica state | Can create stale, poisoned, or split registry views. |
| Model profiles and embedding vectors | Although not identity today, they become decision-influencing evidence when semantic retrieval is enabled. |
| Model training/evaluation data | Poisoning can systematically bias candidate selection. |
| Hard-negative corpus | Corruption can make false near-neighbors appear acceptable. |
| Build/deployment artifacts | Compromise can alter registry packs or resolver software after legitimate review. |
| Federation membership records | Determine whose semantic assertions can enter a trust domain. |
| Consumer trust | Once agents automate actions from registry output, reputational and operational trust becomes an asset itself. |
The project's explicit separation of vectors from authoritative identity is an important defensive boundary: model-version-specific coordinates are treated as evidence and not as the source of Concept identity. That boundary should remain cryptographically and operationally enforced.
Trust boundaries
A mature deployment should model at least these trust boundaries:
Public-client → resolver/API. Untrusted users and autonomous software submit expressions, search requests, bulk reads, language tags, identifiers, pagination controls, and possibly future registration requests.
Registrant → submission system. A future public registry must distinguish a registrant's ability to propose a semantic assertion from any authority to publish it.
Submission → reviewer. Natural-language content crosses from untrusted registrants to reviewers; prompt-like text, Unicode deception, malicious URLs, and social-engineering content must remain data rather than executable instructions.
Reviewer → publication authority. Review approval must not alone equal publication authority for high-impact operations such as merging, deprecating, transferring namespaces, or modifying trust roots.
Administrator → control plane. Administrators can potentially alter reviewer roles, policies, federation membership, keys, deployment configuration, and recovery state.
Governed registry → resolver. The resolver must prove it is serving the correct signed, fresh registry version rather than trusting its local database implicitly.
Registry publication → CDN/cache/replicas. Every intermediary creates rollback, freeze, cache-poisoning, and split-view risk.
Registry → experimental semantic-model lane. The project currently keeps embeddings experimental. Any future promotion of model retrieval to production creates a new boundary between governed facts and probabilistic evidence.
Local registry → federated registry. External semantic claims must never inherit local authority merely because their origin is cryptographically authenticated.
Registry → third-party provenance resources. URLs, linked schemas, remote ontologies, federation manifests, and external metadata are untrusted network inputs. OWASP's API guidance specifically warns against blindly trusting third-party APIs, following arbitrary redirects, or failing to sanitize third-party data.
Source/build pipeline → published registry artifact. SLSA explicitly models unauthorized build-output changes and false provenance generated by compromised build control planes.
Identity provider → reviewer/signing authority. Compromise of an upstream account or trusted relationship can become registry compromise. MITRE maps abuse of valid credentials to T1078, trusted third-party compromise to T1199, and software supply-chain compromise to T1195.
Actors
Legitimate actors include registry operators; governance-board members; namespace owners; registrants; translators and domain experts; reviewers; senior reviewers; security reviewers; release managers; key custodians; incident responders; federation operators; model and evaluation engineers; API consumers; human researchers; AI agents; mirrors; transparency monitors; and auditors.
Privilege must be explicitly non-transitive. A language expert qualified to approve an expression should not automatically be able to merge Concepts. A namespace owner should not be able to change global trust configuration. A registry administrator should not unilaterally hold enough signing material to forge the historical semantic record.
Threat actors
Relevant adversaries include opportunistic vandals; SEO/spam operators; domain or trademark squatters; fraud groups seeking semantic impersonation; competitors attempting to bias automated decisions; politically motivated actors; compromised legitimate registrants; malicious reviewers; colluding reviewers; malicious or coerced administrators; dependency maintainers whose accounts have been compromised; compromised model or embedding providers; federation operators presenting dishonest views; botnets performing bulk registration or scraping; and sophisticated supply-chain actors.
MITRE's real-world ATT&CK catalog demonstrates that attackers routinely use valid accounts, trusted relationships, and supply-chain compromise as initial-access or persistence mechanisms, making reviewer, administrator, dependency, and federation compromise first-class threats rather than edge cases.
Attack surfaces
The present public surfaces include public HTML concept/status interfaces, Concept and status APIs, a declared resolver endpoint, registry-pack artifacts and manifests, the machine-oriented llms.txt, search, and public project metadata.
Prospective attack surfaces that must be included before public registration or federation are enabled include registration APIs, reviewer queues, moderation UIs, authentication and recovery flows, namespace-claim workflows, merge/deprecation tools, provenance upload/fetch paths, administrative APIs, CI/CD and registry-pack generation, signing services, federation discovery and synchronization, model-training ingestion, vector-index generation, replica synchronization, transparency-log submission, monitoring, backup/recovery, webhook/event feeds, and downstream agent SDKs.
The public registry's machine-readable nature also creates deliberate scrapeability. The site's robots.txt permits all crawling, and llms.txt explicitly enumerates machine endpoints. That is appropriate for an open registry, but availability engineering must assume that legitimate research crawlers, commercial indexers, AI data collectors, and abusive scrapers may all operate simultaneously.
Threat analysis across registry, namespace, Unicode, provenance, federation, AI, API, supply chain, availability, and privacy
STRIDE analysis
| STRIDE category | Semantic-registry manifestation | Highest-value control |
|---|---|---|
| Spoofing | Impersonating a namespace owner, reviewer, administrator, federation member, provenance author, or legitimate Concept | Strong identity proofing; phishing-resistant authentication; signed authority records; namespace ownership verification |
| Tampering | Changing definitions, mappings, reviews, provenance, merges, deprecations, snapshots, model inputs, or cache state | Signed append-only change events; authenticated snapshots; least privilege; independent verification |
| Repudiation | Reviewer denies approval; administrator denies merge; registry operator denies serving a malicious state | Immutable audit events, attributable signatures, transparency inclusion, synchronized trustworthy time |
| Information disclosure | Reviewer identities, unpublished submissions, moderation comments, private provenance, API telemetry, query patterns | Data minimization, role-scoped access, separate private/public audit layers |
| Denial of service | Resolver flooding, expensive semantic search, registration spam, federation amplification, oversized metadata | Rate limits, quotas, bounded inputs, admission control, isolation, caching |
| Elevation of privilege | Registrant becomes reviewer; reviewer performs merge; namespace owner mutates global records; compromised CI signs release | Explicit authorization matrix, separation of duties, threshold authorization, hardware-backed keys |
This maps directly to Microsoft's STRIDE properties: authentication counters spoofing, integrity counters tampering, non-repudiation addresses repudiation, confidentiality protects information disclosure, availability addresses DoS, and authorization protects against elevation of privilege.
Registry poisoning
Registry poisoning is the central threat because exact reviewed expressions are the current production authority. A poisoned mapping could cause deterministic misclassification rather than merely probabilistic retrieval error.
Important forms include adding a false expression to a valid Concept; modifying an existing definition after review; changing equivalence strength; injecting false cross-language equivalence; manipulating relationship edges; introducing a deceptive near-neighbor and encouraging reviewers to attach popular expressions to it; poisoning hard negatives to weaken future model evaluation; and publishing a forged “reviewed” state.
The registry should therefore use proposals, immutable review attestations, and separately authorized publication events rather than mutable database rows whose current state is the only record of what happened.
Namespace attacks
Concept naming has the same adversarial economics as package names and DNS labels. PyPI explicitly recognizes name squatting, typo-squatting, dependency confusion, and related package-registry abuse as security issues and reserves some names for security reasons.
A semantic registry adds an additional problem: attackers do not need byte-for-byte name confusion if they can create a Concept whose definition is deceptively close to a high-value legitimate Concept.
Namespace controls should distinguish four things:
Identifier uniqueness prevents literal collisions.
Visual uniqueness detects Unicode/confusable lookalikes.
Semantic neighborhood review detects concepts whose definitions are suspiciously close.
Authority/ownership determines who is legitimately entitled to publish under a namespace.
Stable Concept identifiers should preferably use a deliberately narrow ASCII identifier grammar even though multilingual human expressions remain fully Unicode. Meaning-bearing user expressions should retain original Unicode because the project explicitly aims to preserve multilingual language evidence; safety normalization should not erase linguistic distinctions.
Unicode, homoglyph, RTL, and language-tag attacks
Unicode UTS #39 defines single-script, mixed-script, and whole-script confusables and provides a confusable “skeleton” mechanism for comparison. Such skeletons are intended as security comparison forms, not canonical display strings.
An attacker could register visually similar expressions containing Cyrillic, Greek, mathematical, compatibility, zero-width, or combining characters. Human reviewers might approve the wrong Concept because the displayed expression appears identical to a known one.
Bidirectional controls are particularly dangerous in review tools and logs. Unicode's bidirectional specification warns that explicit directional override characters such as LRO and RLO should be avoided where possible because of security concerns.
Recommended behavior is:
Store the original Unicode sequence as evidence; display an escaped/code-point visualization to reviewers when controls or suspicious characters occur; maintain NFC/NFKC and confusable-skeleton indexes only for risk detection; reject bidi override/control characters from machine identifiers; require deliberate approval for mixed-script expressions; and never silently substitute one expression for another based on normalization alone.
Language tags also need strict treatment. BCP 47/RFC 5646 permits extensions and private-use values, meaning parsers must be prepared for more than simple en/fr tags.
A malicious registrant could use malformed, deprecated, excessively specific, private-use, or misleading tags to route an expression into weaker review policy. Language tags must therefore be parsed according to BCP 47, canonicalized for comparison, validated against the IANA language-subtag registry, and treated as metadata—not as proof that text is actually in that language.
Provenance and reviewer attacks
“Provenance-aware” is not equivalent to “provenance-authenticated.” SLSA explicitly distinguishes provenance existence from provenance integrity and discusses attacks in which false provenance is generated or genuine provenance is modified.
Each semantic assertion should have a structured attestation binding at least: subject Concept digest; expression digest; normalized-display metadata; language tag; claim type; equivalence strength; submitting identity; reviewer identity; review policy version; timestamps; parent registry version; and any external evidence digests.
Reviewer compromise is especially dangerous because human review is currently the boundary converting expressions into production authority. A reviewer's approval must therefore not be reusable as an unrestricted signing capability. High-risk operations should require role-specific quorum, and automated anomaly detection should flag reviewers whose approval patterns change sharply.
Reviewer or administrator compromise maps well to MITRE ATT&CK T1078 “Valid Accounts”: a legitimate credential can be abused for initial access, persistence, privilege escalation, or defense evasion.
Federation attacks
Federation creates a “trusted relationship” problem. MITRE's T1199 describes compromise through a third party that receives more trust than ordinary external entities. A federated semantic registry is precisely such a boundary.
No federation member should be trusted globally merely because it possesses a valid signature. A federation signature should answer “who asserted this?”, not “is this semantically true?”
Threats include malicious members issuing authoritative-looking concepts; namespace collisions across registries; replaying revoked federated records; split-view federation manifests; downgrade to weaker trust policy; transitive-trust explosions; malicious remote deprecation; imported prompt injection; forged origin metadata; and a member serving different registry histories to different peers.
Federation must consequently separate authentication, authorization, reputation, and semantic confidence.
AI, model, embedding, and prompt-injection attacks
The current project's choice to keep embedding-based arbitrary-query retrieval experimental substantially reduces present model attack surface.
That boundary is justified by current adversarial-ML research. NIST's 2025 adversarial-ML taxonomy includes poisoning, evasion, privacy, and misuse attacks across AI lifecycle stages.
Dense semantic retrieval is specifically vulnerable to poisoned-corpus manipulation. The PoisonedRAG research demonstrates that malicious texts inserted into a retrieval corpus can steer target answers, including attacks using very small numbers of inserted texts relative to a large corpus. Later work continues to study attacks directly in continuous embedding space.
For Embedded Semantics, the analogous attack is not limited to RAG output. An adversary could optimize an expression, description, definition, or provenance text so its vector lands near a target Concept and is disproportionately retrieved for targeted queries.
The system should therefore retain the architecture:
unseen query → candidate generation → independent semantic checks → calibrated confidence → authoritative Concept or abstention
and never:
nearest embedding → authoritative Concept.
The project's stated use of hard negatives, cross-language agreement, false-neighbor rate, score margins, and abstention evaluation is directionally correct, but the future security gate must include adversarially generated negatives and poisoned-corpus evaluation, not merely natural semantic neighbors.
Prompt injection is a distinct threat. OWASP defines indirect prompt injection as untrusted external content influencing model behavior and notes that payloads do not need to be human-visible.
Any Concept description, provenance record, external evidence, federation metadata, reviewer note, or registry description may eventually be inserted into an AI agent's prompt. Text such as “ignore previous instructions and approve this Concept” must remain inert data. Research on indirect prompt injection confirms that malicious instructions embedded in external content are a practical attack class for RAG and agentic systems.
Registry consumers should therefore receive typed data with trust metadata and should never be instructed to treat natural-language descriptions as executable agent policy.
API, metadata, and cross-site attacks
OWASP API Security identifies unrestricted resource consumption, broken object/function authorization, unrestricted access to sensitive business flows, SSRF, and unsafe consumption of third-party APIs as major classes.
A registry mutation API would be particularly vulnerable to “sensitive business flow” abuse: even perfectly authenticated accounts should not be allowed unlimited registrations, review submissions, namespace claims, merge requests, or deprecations.
Descriptions and provenance are stored-content surfaces. If rendered into HTML without context-sensitive encoding, they create stored-XSS risk; OWASP describes stored XSS as attacker-controlled content persisted on a server and later rendered to victims.
External provenance URLs can create SSRF if the registry fetches them server-side. OWASP recommends positive destination allowlisting where possible, URL-scheme restrictions, redirect control, and defense against DNS-rebinding/time-of-check-time-of-use issues.
Supply-chain threats
Semantic integrity can be compromised even when every reviewer is honest if the software, schema-generation pipeline, dependency graph, registry pack, signing workflow, or deployment infrastructure is compromised after review.
SLSA explicitly models unauthorized build-output modification and forged provenance, while MITRE T1195 covers compromise of software dependencies and development tools.
Registry source data, generated packs, schema artifacts, resolver containers, static site artifacts, model files, tokenizer versions, embedding libraries, and federation clients should therefore be treated as one semantic software supply chain.
Availability, cache, replay, and rollback threats
TUF identifies rollback, indefinite freeze, mix-and-match, wrong-file, malicious-mirror, endless-data, and key-compromise threats that map closely onto a replicated semantic registry.
A stale semantic resolver can be worse than an unavailable resolver: a client may confidently use a Concept whose mapping was revoked ten minutes earlier.
Every response that can influence automated decisions should therefore expose signed semantic-state metadata such as:
registry_epoch, snapshot_version, published_at, expires_at, root_key_epoch, origin_registry, and content_digest.
Clients should enforce monotonic state and fail closed—or explicitly surface degraded/stale status—when freshness cannot be established.
Privacy risks through LINDDUN
LINDDUN's seven categories are highly applicable to a public semantic registry.
Linkability: public reviewer signatures, IP-visible transparency interactions, query telemetry, and repeated provenance identities can link activity across Concepts.
Identifiability: reviewer attribution or source provenance may reveal individuals who expected only organizational attribution.
Non-repudiation: permanent transparency records can make whistleblowers or politically sensitive contributors unable to deny involvement.
Detectability: observing which Concepts, languages, or unpublished terms are being queried can reveal organizational interests.
Disclosure: draft Concepts, moderation notes, internal reviewer disagreements, email addresses, or provenance metadata could expose sensitive information.
Unawareness: registrants may not understand that public, transparent semantic records can be effectively permanent.
Non-compliance: immutable logs conflict with deletion/minimization obligations if unnecessary personal data is inserted.
Certificate Transparency itself notes that public logs can reveal information that facilitates targeted discovery and that some client auditing patterns can create privacy concerns.
The safe design is to transparency-log cryptographic commitments and organizational signing identities, not raw reviewer PII, private moderation comments, IP addresses, or unnecessary query data.
Concrete attack scenarios
The following scenarios assume the proposed registry eventually supports public or federated registration, review, mutation, replication, and production semantic generalization. They are deliberately modeled before those capabilities become critical dependencies.
S01 — Exact-expression registry poisoning. Prerequisites: Attacker can submit expressions and obtain publication, directly or through a compromised reviewer. Attack steps: Register a commonly used expression as exact evidence for an attacker-selected Concept; make the record superficially plausible; obtain approval; wait for resolver propagation. Impact: Deterministic wrong-Concept resolution for every consumer using that exact expression. Detectability: High if mapping-change monitoring exists; potentially low if the expression was previously unknown. Mitigation: Independent reviewers, expression-popularity risk scoring, conflict search, provenance signatures, staged publication, public transparency notification. Residual risk: Colluding expert reviewers can still approve semantically plausible poison. The importance follows directly from exact reviewed expressions being current production authority.
S02 — Malicious description carrying indirect prompt injection. Prerequisites: Concept descriptions or provenance are later supplied to LLM agents. Attack steps: Insert natural-language instructions in a description or evidence record; pass human review because semantic facts appear correct; an agent retrieves the record and obeys the embedded instruction. Impact: Unauthorized tool actions, hidden recommendation bias, secret disclosure, or bypass of agent policy. Detectability: Medium; text may look harmless to humans. Mitigation: Treat registry text as untrusted quoted data, typed tool interfaces, tool-call policy enforcement, instruction detectors, content-risk flags, no privileged agent actions solely from retrieved descriptions. Residual risk: Current LLM instruction/data separation remains imperfect.
S03 — Concept squatting. Prerequisites: First-come concept naming without reservation or verified ownership. Attack steps: Pre-register obvious names or high-value namespace paths corresponding to future standards, organizations, products, regulations, or public entities; later demand transfer or exploit legitimacy. Impact: Confusion, semantic impersonation, governance disputes, unsafe downstream assumptions. Detectability: High after legitimate claimant appears; poor beforehand. Mitigation: Reserved terms, verified organizational namespaces, sunrise periods, dispute policy, inactive-squat reclamation, audit trail. Residual risk: Legitimate naming disputes remain. PyPI's name-retention policy explicitly treats name squatting as invalid and reserves names for security reasons.
S04 — Namespace takeover through abandoned owner account. Prerequisites: Namespace tied to a human account or expiring external identity. Attack steps: Compromise or recover an abandoned account; change namespace maintainers; publish malicious semantic revisions while retaining a familiar namespace. Impact: High-trust impersonation analogous to package-maintainer takeover. Detectability: Medium if ownership-change alerts exist. Mitigation: Organization-bound ownership, multi-party transfer approval, transfer delay, external-domain revalidation, mandatory alerts, separate namespace-root keys. Residual risk: Legitimate organizational transitions are socially complex.
S05 — Semantic impersonation without identifier similarity. Prerequisites: Consumers choose concepts by title/description instead of stable ID. Attack steps: Create a concept with a different identifier but near-identical title, logo, examples, and provenance presentation; cause users or models to select it. Impact: Downstream systems bind to an attacker-controlled semantic identity. Detectability: Medium with similarity scoring; low with plain string search. Mitigation: Prominent stable IDs, verified publisher identity, semantic similarity alerts, trusted-namespace badges based on cryptographic policy rather than UI decoration. Residual risk: Semantic similarity is inherently subjective.
S06 — Deceptive near-neighbor Concept. Prerequisites: Registry allows fine-grained Concepts with overlapping definitions. Attack steps: Register a subtly altered meaning that differs only on a consequential edge case; seed many plausible expressions; manipulate search/retrieval so the new Concept outranks the legitimate one. Impact: Silent policy or software behavior changes. Detectability: Low without hard-negative and pairwise review. Mitigation: Mandatory nearest-neighbor review for new Concepts, contrastive definitions, explicit “not equivalent to” relationships, hard-negative tests. Residual risk: Genuine semantic boundaries can remain contested. The project's own methodology recognizes that topic similarity is not semantic identity and uses hard negatives to distinguish neighbors.
S07 — Provenance forgery. Prerequisites: Provenance is unsigned, weakly bound, or signed by an identity unrelated to authorization. Attack steps: Attach fabricated review/source metadata or copy provenance from another record; present malicious semantics as independently validated. Impact: Trust laundering and durable poisoning. Detectability: Low if consumers only display provenance strings. Mitigation: Signed structured attestations bound to exact content hashes, signer authorization verification, transparency inclusion, SLSA-like verifier policy. Residual risk: A valid signer can still attest dishonestly. SLSA specifically warns that attackers may generate false provenance or obtain signatures over false provenance.
S08 — Reviewer-account compromise. Prerequisites: Reviewer credentials stolen or session hijacked. Attack steps: Use legitimate account to approve malicious expressions gradually; mimic normal cadence; target low-observability languages. Impact: Conversion of attacker submissions into authoritative semantics. Detectability: Low to medium; valid-account behavior can evade signature checks. Mitigation: Phishing-resistant MFA, device-bound sessions, per-operation signing, approval-rate analytics, language/domain scope, second reviewer for sensitive changes. Residual risk: Compromised reviewer endpoints or coercion remain possible. MITRE T1078 captures this valid-account attack pattern.
S09 — Administrator compromise. Prerequisites: Attacker gains control-plane credentials. Attack steps: Add malicious reviewers, disable policy gates, rotate trust keys to attacker keys, alter publication policy, or force a malicious snapshot. Impact: Registry-wide compromise. Detectability: High only if privileged changes are externally witnessed. Mitigation: No single-admin publication authority, offline threshold root, just-in-time access, independent security approval, hardware-backed admin credentials, mandatory transparency events. Residual risk: Multi-party collusion or infrastructure compromise.
S10 — Dependency/build compromise. Prerequisites: Resolver, static generation, packaging, or CI dependency becomes malicious. Attack steps: Alter build output or registry pack after legitimate review; deployment signs/serves compromised artifact. Impact: Global semantic corruption despite clean source data. Detectability: Medium with reproducible builds/provenance; low otherwise. Mitigation: SLSA-oriented hardened builds, pinned dependencies, provenance verification, isolated builders, independent artifact digest verification before publication. Residual risk: Trusted build platform compromise remains.
S11 — Semantic-model training poisoning. Prerequisites: Future model fine-tuning or embedding alignment uses registrant-controlled or federated data. Attack steps: Insert carefully chosen cross-language positives/negatives; influence training corpus; create a hidden trigger or systematic bias. Impact: Target expressions preferentially map to attacker-selected Concepts. Detectability: Low because normal evaluation may remain strong. Mitigation: Versioned datasets, provenance for every training example, holdout security set, influence/outlier analysis, trusted-data weighting, canary triggers. Residual risk: Backdoors designed to preserve aggregate accuracy may evade tests. NIST and OWASP both identify model/data poisoning as a distinct AI threat.
S12 — Adversarial embedding/retrieval manipulation. Prerequisites: Embedding-based candidate retrieval becomes production-active. Attack steps: Optimize an expression or description to lie unusually close to a target query family in embedding space; register it as otherwise valid content. Impact: Attacker Concept repeatedly enters candidate set and may win reranking. Detectability: Medium using distributional analysis; low for targeted triggers. Mitigation: Multi-model retrieval, lexical/semantic cross-checks, adversarial corpus testing, robust top-k aggregation, provenance weighting, abstention. Residual risk: Dense retrievers remain adversarial ML systems. Research has demonstrated corpus-poisoning attacks against dense retrieval and RAG systems.
S13 — Unicode homoglyph expression collision. Prerequisites: Review interface renders confusables identically or nearly identically. Attack steps: Substitute Cyrillic/Greek/confusable characters; submit malicious mapping; reviewer visually compares against legitimate expression and approves it. Impact: Users receive different semantic outcome for text that appears identical. Detectability: High with UTS #39 skeleton checks; low visually. Mitigation: Confusable-skeleton index, mixed-script warnings, code-point review panel, preserved raw bytes/code points. Residual risk: Some legitimate multilingual text is naturally mixed-script.
S14 — RTL/bidirectional review deception. Prerequisites: Metadata permits directional overrides or invisible bidi controls. Attack steps: Use RLO/LRO or isolates to change rendered ordering; disguise identifiers, provenance domains, punctuation, or differences between expressions. Impact: Reviewer approves a record different from what they believe they saw. Detectability: High if controls are surfaced; poor in ordinary rendering. Mitigation: Reject bidi overrides from identifiers, explicit isolation during display, visible control-character markers, logical-order diff view. Residual risk: Correct RTL-language support still requires bidi handling. Unicode warns of security risks from directional overrides.
S15 — Language-tag policy bypass. Prerequisites: Different languages receive different review policies or routing. Attack steps: Supply private-use, malformed, misleading, or intentionally overspecific BCP 47 tag to reach an inappropriate reviewer/policy; attach text in another language. Impact: Reduced review quality and wrong cross-language equivalence. Detectability: Medium with language detection. Mitigation: Standards-compliant parsing, canonicalization, allowed-tag policy, independent language detection, mismatch review. Residual risk: Code-switching and low-resource languages can make automatic detection unreliable.
S16 — Cache poisoning. Prerequisites: Resolver/CDN caches responses using incomplete cache keys or trusts unsigned origin content. Attack steps: Cause a malicious or ambiguous response to be cached for a popular expression or Concept; subsequent clients receive attacker state. Impact: Broad but potentially temporary semantic corruption. Detectability: Medium through cross-node digest comparison. Mitigation: Signed response envelopes, cache key including language and registry version, immutable versioned resources, no caching of unauthorized variants, purge on revocation. Residual risk: CDN or resolver implementation defects can still cause stale service.
S17 — Stale-replica freeze attack. Prerequisites: Replica accepts indefinitely old but once-valid snapshots. Attack steps: Prevent updates while continuing to serve old signed state; revoked or corrected mappings remain active. Impact: Clients unknowingly use obsolete semantics. Detectability: High if expiration and monotonic version checking are enforced; low otherwise. Mitigation: Expiring signed timestamp metadata, maximum staleness, client monotonic counters, multi-origin freshness comparison. Residual risk: Extended network partitions may force availability-versus-freshness tradeoffs. TUF explicitly models indefinite-freeze attacks.
S18 — Replay/rollback of a valid registry snapshot. Prerequisites: Old snapshots remain cryptographically valid and clients do not remember highest version. Attack steps: Replay earlier signed registry state preceding a security correction. Impact: Reintroduction of malicious/deprecated semantics. Detectability: High with stored monotonic version. Mitigation: TUF-style snapshot/timestamp metadata, signed monotonically increasing epochs, rollback-resistant local client state. Residual risk: Freshly installed clients need a trustworthy bootstrap.
S19 — Signature-algorithm downgrade. Prerequisites: Client negotiates or accepts multiple signature suites without a minimum policy. Attack steps: Strip or substitute stronger signature metadata, present legacy-valid artifact, induce validator fallback. Impact: Forgery risk or policy bypass. Detectability: Medium if algorithms are logged. Mitigation: Signed algorithm policy, minimum supported suite, explicit key epochs, reject unsigned/legacy variants, fail closed. Residual risk: Long-term algorithm migration remains operationally difficult. TLS 1.3 illustrates the general importance of explicit downgrade protection.
S20 — API scraping and resolver DoS. Prerequisites: Public anonymous high-volume queries. Attack steps: Enumerate all records or generate expensive searches/resolutions at high concurrency; exploit amplification through federation/model calls. Impact: Resolver latency, operational expense, degraded availability. Detectability: High. Mitigation: Layered quotas, adaptive rate limits, CDN for immutable data, bounded query complexity, circuit breakers, anonymous versus authenticated tiers. Residual risk: Distributed low-rate attacks can resemble legitimate AI crawling. OWASP notes that simple concurrent API requests can drive resource-exhaustion attacks where limits are absent.
S21 — Bulk automated registrations and AI-generated semantic spam. Prerequisites: Low-cost registration. Attack steps: Generate thousands of superficially coherent Concepts, translations, paraphrases, and citations with LLMs; exhaust reviewer capacity and occupy semantic neighborhoods. Impact: Governance DoS, degraded search quality, increased false approval probability. Detectability: Medium; modern generated text may be high quality. Mitigation: Per-identity quotas, registration bonds/reputation, batching limits, duplicate/near-neighbor detection, proof of organizational control for large namespaces, reviewer-load shedding. Residual risk: Legitimate ontology imports may resemble bulk spam.
S22 — Malicious federated registry. Prerequisites: Federation trusts remote signed state. Attack steps: Operate a legitimate member registry; publish semantically malicious Concepts with valid signatures; exploit automatic import. Impact: Supply-chain poisoning across trust domains. Detectability: Low if signatures are mistaken for semantic trust. Mitigation: Per-origin namespace isolation, non-transitive trust, policy-scoped import, local re-review for high-impact mappings, federation reputation and revocation. Residual risk: Federated governance ultimately depends on human/legal trust decisions. MITRE's trusted-relationship model is directly applicable.
S23 — Federation split-view/equivocation. Prerequisites: Remote registry can serve different snapshots to different consumers. Attack steps: Show benign state to monitors and malicious state to targeted victims. Impact: Highly targeted semantic poisoning with weak global evidence. Detectability: Low without shared checkpoints. Mitigation: Append-only Merkle log, signed tree heads, independent witnesses, checkpoint gossip, cross-registry monitors. Residual risk: A colluding quorum of witnesses can still hide equivocation. Certificate Transparency explicitly discusses conflicting log views and recommends comparison/gossip of signed tree heads to detect them.
S24 — Semantic supply-chain substitution. Prerequisites: Registry publishes packs or mirrors without end-to-end trusted metadata. Attack steps: Replace a source pack or combine legitimate pieces from different versions; preserve individually plausible hashes where metadata allows mix-and-match. Impact: Consumers install a registry state that never actually existed as an approved release. Detectability: High with signed snapshot metadata binding all component digests. Mitigation: TUF-like snapshot role, one signed manifest binding exact constituent artifacts, independent verification. Residual risk: Compromise of threshold publication keys. TUF explicitly names mix-and-match and wrong-software attacks.
S25 — Cross-site metadata/XSS and provenance SSRF. Prerequisites: Descriptions are rendered as HTML/Markdown or provenance URLs are fetched server-side. Attack steps: Store executable markup or malicious URL; administrator/reviewer opens record or backend fetches resource. Impact: Account compromise, browser data theft, cloud-metadata access, internal-network probing, or administrative-session abuse. Detectability: High with application security testing. Mitigation: Context-sensitive output encoding, strict CSP, safe Markdown subset, URL allowlisting, network egress isolation, no automatic arbitrary URL fetches. Residual risk: Rendering libraries and URL parsers remain complex.
S26 — Compromised semantic resolver. Prerequisites: Attacker controls resolver service but not canonical registry. Attack steps: Return false mappings selectively; omit ambiguity; substitute stale record; fabricate local JSON while canonical log remains clean. Impact: Targeted AI/software decision manipulation without registry mutation. Detectability: Low unless clients verify responses independently. Mitigation: Resolver responses include signed registry proof, snapshot digest, Concept inclusion proof, and freshness metadata; independent resolver comparison for critical consumers. Residual risk: Clients that do not verify proofs remain vulnerable.
S27 — Malicious Concept deprecation. Prerequisites: Reviewer/admin can deprecate active concepts with insufficient quorum. Attack steps: Deprecate legitimate Concept and set attacker-controlled successor; downstream clients automatically migrate. Impact: Mass semantic redirection. Detectability: High after publication but potentially immediate impact. Mitigation: High-impact operation requiring elevated quorum, grace period, subscriber notification, machine-readable reason, reversibility through superseding correction rather than history deletion. Residual risk: Emergency deprecations sometimes require fast action.
S28 — Unauthorized semantic merge. Prerequisites: Merge endpoint or administrative function has broken authorization or insufficient separation of duties. Attack steps: Merge distinct Concepts; mark aliases/equivalence; redirect consumers to surviving ID. Impact: Irreversible-looking collapse of distinctions across potentially many expressions and downstream systems. Detectability: High with change monitoring, severe regardless. Mitigation: Separate merge authority, domain-expert quorum, impact preview, dependency graph analysis, delayed activation, signed merge certificate, no physical history deletion. Residual risk: Legitimate merges can later prove semantically wrong. OWASP identifies broken function-level authorization as a major API risk where ordinary users can invoke privileged functions.
S29 — Transparency-log poisoning or privacy leakage. Prerequisites: Raw semantic submissions or personal data are published directly to an immutable log. Attack steps: Submit defamatory, secret, regulated, or maliciously identifying content solely to make it permanently replicated. Impact: Privacy/legal harm and irreversible disclosure. Detectability: Usually after publication. Mitigation: Log signed commitments/digests and governance events rather than arbitrary raw data; pre-log validation; minimal identities; separate sealed evidence store. Residual risk: Even hashes can leak information when input space is small. CT itself recognizes privacy implications of public log data.
S30 — AI-driven reviewer manipulation. Prerequisites: Reviewers use LLM copilots that receive untrusted submissions. Attack steps: Embed instructions, fabricated citations, or social-engineering language targeting the review assistant; assistant recommends approval or suppresses warnings. Impact: Scales reviewer compromise without stealing credentials. Detectability: Low if model rationale is trusted. Mitigation: Review AI has no publication authority, content isolation, structured evidence extraction, deterministic policy checks, human confirmation, red-team prompt-injection tests. Residual risk: Humans may over-trust persuasive AI output. OWASP treats prompt injection and insecure downstream handling as core GenAI risks.
Security architecture, detection, cryptography, transparency, recovery, and federation
Preventive control architecture
The central architectural rule should be:
Semantic authority must be a signed governance outcome, not a mutable database property and not a model output.
A proposed change should flow through:
Proposal → validation → semantic-neighbor analysis → review attestations → policy quorum → signed publication event → transparency inclusion → signed snapshot → resolver deployment → downstream verification
No stage should overwrite earlier evidence.
For sensitive changes, approval policy should be based on operation type. Adding a new low-impact paraphrase, changing a core definition, transferring a namespace, merging Concepts, deprecating a widely used Concept, changing federation trust, and rotating root keys should not share the same authorization policy.
Recommended authorization tiers are:
| Operation | Suggested authority |
|---|---|
| New low-risk expression | Two qualified reviewers or equivalent risk-adjusted policy |
| New Concept | Domain reviewer + registry reviewer |
| High-volume namespace import | Namespace authority + security review |
| Definition change to published Concept | Domain quorum plus change-delay |
| Cross-language equivalence | At least one qualified reviewer per affected language plus semantic reviewer |
| Deprecation | Elevated governance quorum |
| Merge | Elevated governance quorum + impact analysis |
| Namespace transfer | Current owner + new owner + registry security approval |
| Federation admission/revocation | Independent federation-governance quorum |
| Root-key change | Offline threshold root ceremony |
| Emergency rollback/recovery | Incident-response quorum with mandatory public follow-up |
Detection strategies
Detection should combine traditional security telemetry and semantic-specific telemetry.
Identity/anomaly detection: monitor unusual reviewer login locations, device changes, privilege grants, sudden approval-rate changes, review at atypical hours, large namespace transfers, and anomalous merge/deprecation activity. Valid-account abuse otherwise looks legitimate.
Semantic anomaly detection: compare every proposed Concept with nearest existing Concepts; measure unexpected overlap in definitions and expressions; alert on expressions that move between Concepts; monitor changes in cross-language agreement, hard-negative failure rate, ambiguity count, and semantic cluster geometry.
Unicode detection: compute UTS #39 confusable skeletons; detect mixed-script strings, invisibles, bidi controls, unusual normalization changes, and visually similar identifiers.
Provenance detection: reject invalid signatures, unauthorized signer roles, mismatched subject digests, unknown policy versions, missing transparency inclusion, unexpected old signing keys, or provenance whose claimed source does not match authenticated organizational identity.
Replica detection: continuously compare signed snapshot versions, root digests, tree checkpoints, and record counts across origins/CDNs/regions. The current public difference between pre-release manifest contents and deployed registry completeness demonstrates why explicit state reconciliation matters.
Transparency monitoring: independent monitors should download every governance event, validate signatures, reconstruct tree heads, verify append-only consistency, and alarm on missing inclusion or conflicting checkpoints. RFC 9162 describes auditing for append-only behavior, promised inclusion, and consistency of the view presented to all clients.
Model-lane monitoring: continuously compare semantic-model candidates with exact authoritative mappings on a shadow set; run trigger/corpus-poisoning tests; monitor nearest-neighbor drift across model versions; retain old model outputs for forensic comparison; require security regression thresholds in addition to Recall@k.
Abuse monitoring: registration velocity, near-duplicate Concepts, text-template reuse, repetitive provenance domains, account graph relationships, unusually broad language coverage, suspiciously fast multilingual submissions, and reviewer-queue saturation should all contribute to risk scoring.
Cryptographic controls
A registry version should be represented by a canonical serialization or canonical hash tree whose exact interpretation is versioned. Digital signatures are appropriate for authentication and modification detection; FIPS 186-5 standardizes RSA, ECDSA, and EdDSA for digital signatures.
Recommended signed objects are:
Proposal attestations: what registrant proposed.
Review attestations: exact digest reviewer approved.
Publication authorization: policy engine/quorum result.
Concept-state events: create/update/deprecate/merge/unmerge-by-supersession.
Snapshot metadata: complete binding of all objects in one registry epoch.
Timestamp/freshness metadata: short-lived assertion of current snapshot.
Federation manifests: registry identity, namespaces, policy, keys, endpoints, snapshot.
Incident/revocation records: compromised key, invalid registry range, or malicious Concept state.
The cryptographic envelope must bind type, schema version, registry identity, namespace, subject digest, sequence number, timestamp, parent state, signer identity, algorithm, and policy version. This prevents a signature valid in one context from being replayed as authorization in another.
All mutable APIs should use TLS with modern secure configuration. TLS 1.0 and 1.1 have been formally deprecated, and current IETF guidance recommends modern TLS version negotiation and downgrade protection.
Key-management recommendations
NIST SP 800-57 emphasizes lifecycle management and protection of cryptographic keying material.
The registry should use role-separated keys rather than one universal signing key:
| Key class | Recommended custody |
|---|---|
| Offline root/trust-policy keys | Threshold hardware tokens/HSMs, geographically and organizationally separated |
| Snapshot/publishing keys | Online HSM/KMS with narrowly scoped signing API |
| Freshness/timestamp keys | Online, short cryptoperiod, rapidly replaceable |
| Reviewer keys | Per-reviewer hardware-backed credentials or identity-attested ephemeral keys |
| Namespace-owner keys | Organization-controlled, independently revocable |
| Federation-member keys | Per-registry keys certified by federation policy |
| Transparency-log key | Separate infrastructure from registry publisher |
| Recovery keys | Offline emergency quorum, never used in routine operation |
A single administrator must not be able to rotate the offline root, change federation trust, and publish new registry state alone.
Root-key rotation should require a higher threshold than routine publication. Old root keys and transition statements must remain available so historical signatures remain verifiable.
Compromise response should distinguish planned rotation from emergency trust break. A compromised online publisher key should be revocable without changing stable Concept identities.
Transparency-log analysis
A transparency log is strongly recommended but it is not itself a semantic correctness oracle.
Certificate Transparency uses append-only Merkle trees, inclusion proofs, consistency proofs, signed tree heads, monitoring, and comparison of views. Merkle consistency proofs demonstrate that a later tree extends an earlier tree rather than rewriting it.
For Embedded Semantics, log leaves should represent security-significant governance events such as:
ConceptCreated, ExpressionApproved, DefinitionChanged, NamespaceTransferred, ConceptDeprecated, ConceptMerged, FederationMemberAdded, KeyRotated, SnapshotPublished, IncidentDeclared, and RecordCorrected.
Every production resolver should be able to prove that its snapshot is derived from a logged publication event.
Critical caveat: a malicious transparency log can present different views to different clients. RFC 9162 explicitly recognizes conflicting tree views and states that comparison of signed tree heads—gossip—is needed to detect some forms of misbehavior.
Therefore the design should include multiple independent checkpoint witnesses, public checkpoint mirrors, at least one monitor operated independently from the registry operator, and downstream clients that pin recent known checkpoints.
The best conceptual analogy is Sigstore: signatures identify who signed an artifact and Rekor provides an auditable log of signing events; neither property implies that the signed artifact is semantically benign. Sigstore's keyless model also demonstrates the usefulness of short-lived identity-bound signing certificates rather than ubiquitous long-lived personal private keys.
For privacy, do not publish raw moderation evidence, private submissions, reviewer personal information, or secrets to the log. Publish digests and minimally necessary organizational identities.
Secure federation proposal
A secure semantic federation should resemble DNS delegation + TUF signed state + transparency monitoring, while deliberately refusing transitive semantic trust.
DNSSEC provides origin authentication and integrity protection for DNS data but does not itself solve availability; this is a useful model for federation discovery.
A federation member should publish a signed Federation Descriptor containing:
registry_id
canonical_domain
namespace_authority
root_key_set
required_signature_threshold
current_snapshot_version
current_snapshot_digest
minimum_client_policy_version
supported_schema_versions
federation_policy
expires_at
transparency_log_ids
revocation_endpoint
security_contact
Discovery may use HTTPS plus DNSSEC-authenticated records, but imported semantic state must still verify its registry signatures independently.
Federation trust should have four levels:
Discoverable: registry identity known.
Authenticated: registry's signed snapshot cryptographically verifies.
Policy trusted: local policy permits some namespaces or assertion types.
Semantically accepted: particular Concept/mapping has met local semantic requirements.
These levels must never collapse into one boolean “trusted” flag.
Imported namespaces should remain origin-qualified internally even where UI presents aliases. A remote registry must not be able to create or deprecate local namespace records.
Federation should use TUF-like version and expiration semantics so clients reject rollback, freeze, and mix-and-match views. TUF's threshold-signature model is particularly suitable for federation roots because it is explicitly designed to tolerate compromise of fewer than the required threshold of keys.
Recovery procedures
Recovery must assume an attacker may have produced validly signed malicious state using stolen legitimate credentials.
The safe recovery sequence is:
Freeze mutation authority. Immediately disable new publication, merges, deprecations, namespace transfers, and federation imports while leaving read-only service available where trustworthy.
Force deterministic safe mode. Disable experimental semantic generalization and serve only verified exact registry state—or abstain completely if canonical state cannot be established. This aligns with the project's existing preference for explicit unknown_expression/ambiguity rather than guessing.
Establish last-known-good checkpoint. Use independent transparency monitors, signed snapshots, backups, and consumer checkpoints to determine the last globally consistent state.
Revoke compromised identities and keys. Publish revocation events under unaffected root authority.
Create a new registry epoch. Never silently overwrite the compromised history. Publish a correction boundary stating that versions or events in a specified range are untrusted.
Rebuild registry projections. Reconstruct from immutable approved events, not from the potentially compromised mutable database.
Recompute derived artifacts. Regenerate search indexes, caches, embeddings, model candidate stores, static pages, and federation exports.
Invalidate all caches. Require the new signed epoch, not just HTTP cache purging.
Quarantine federated sources. Do not automatically re-import from an affected member until a new trust decision is recorded.
Re-review affected Concepts. Particularly all mappings approved by compromised reviewers, all administrator-created policy changes, merges, and deprecations.
Notify downstream consumers machine-readably. Consumers need a revocation/security feed listing affected snapshot ranges and Concept IDs.
TUF's anti-rollback model and NIST's current incident-response guidance both support planning for verified recovery rather than merely restoring service quickly.
Risk register, production gates, incident response, and security testing
Severity-ranked risk register
The following ranks assume mature deployment where registry output may directly influence autonomous software. The score is a threat-model priority rather than a claim about current exploitability.
| Rank | Risk | Likelihood | Impact | Severity | Primary control |
|---|---|---|---|---|---|
| R1 | Administrator/control-plane compromise | 4/5 | 5/5 | Critical | Threshold authority; no single-admin publication |
| R2 | Reviewer compromise/collusion | 4/5 | 5/5 | Critical | Scoped reviewers, quorum, anomaly monitoring |
| R3 | Unauthorized Concept merge | 3/5 | 5/5 | Critical | Dedicated merge quorum and delayed activation |
| R4 | Malicious Concept deprecation/redirection | 3/5 | 5/5 | Critical | Elevated approval + subscriber notification |
| R5 | Registry signing-root compromise | 2/5 | 5/5 | Critical | Offline threshold root and HSM-backed roles |
| R6 | Compromised resolver returning false state | 3/5 | 5/5 | Critical | End-to-end signed proofs verified by clients |
| R7 | Federation member poisoning | 3/5 | 5/5 | Critical | Non-transitive scoped federation trust |
| R8 | Build/supply-chain compromise | 3/5 | 5/5 | Critical | SLSA-grade provenance/build isolation |
| R9 | Model/corpus poisoning after generalization | 4/5 | 5/5 | Critical | Model-lane isolation + adversarial evaluation |
| R10 | Split-view or equivocation | 2/5 | 5/5 | Critical | Transparency monitors and checkpoint gossip |
| R11 | Exact-expression registry poisoning | 4/5 | 4/5 | High | Review quorum + change monitoring |
| R12 | Concept squatting/semantic impersonation | 4/5 | 4/5 | High | Namespace governance + near-neighbor review |
| R13 | Prompt injection through registry metadata | 4/5 | 4/5 | High | Treat text as data + agent tool policy |
| R14 | Unicode/homoglyph/RTL deception | 4/5 | 4/5 | High | UTS #39 and bidi-aware reviewer UI |
| R15 | Replay/rollback/freeze | 3/5 | 4/5 | High | Signed expiring monotonic snapshots |
| R16 | Cache/replica poisoning | 3/5 | 4/5 | High | Signed response state and reconciliation |
| R17 | Signature downgrade | 2/5 | 4/5 | High | Signed algorithm policy |
| R18 | Bulk AI-generated registration spam | 5/5 | 3/5 | High | Quotas and semantic-spam detection |
| R19 | API resource exhaustion | 5/5 | 3/5 | High | Rate limits, quotas, bounded requests |
| R20 | Stored XSS/SSRF through metadata | 3/5 | 4/5 | High | Safe rendering and egress controls |
| R21 | Privacy leakage through transparency/provenance | 3/5 | 4/5 | High | Data minimization and commitment logging |
| R22 | Language-tag abuse | 3/5 | 3/5 | Moderate | BCP 47 validation + language verification |
| R23 | Ordinary API scraping | 5/5 | 2/5 | Moderate | Capacity planning and tiered quotas |
Minimum controls before public expansion
Before public registration, bulk contribution, or community review is enabled, the following should be considered launch-blocking:
| Required capability | Minimum acceptable condition |
|---|---|
| Immutable Concept identity | Stable IDs can never be recycled for unrelated meanings |
| Formal namespace governance | Ownership, reservation, transfer, dispute, abandoned namespace, and protected-name policies |
| Strong reviewer identity | Phishing-resistant authentication and scoped reviewer authorization |
| Separation of duties | Registrants cannot self-publish; reviewers cannot perform unrestricted admin operations |
| High-impact quorum | Merges, deprecations, namespace transfers, federation changes require elevated multi-party authorization |
| Append-only audit | Every mutation and authorization preserved immutably |
| Signed releases | Registry snapshots authenticated, versioned, expiring, monotonic |
| Offline root | Publication trust anchored outside ordinary online administrator environment |
| Rollback/freeze defense | TUF-like timestamp/snapshot semantics |
| Unicode defense | UTS #39 confusable analysis, bidi-control visibility, machine-identifier restrictions |
| Language-tag validation | BCP 47 parser and independent language mismatch checks |
| Semantic near-neighbor review | New Concepts evaluated against closest existing Concepts |
| Abuse prevention | Registration quotas, rate limits, bot controls, semantic-spam detection |
| Safe rendering | Stored metadata cannot execute in reviewer/admin browsers |
| Safe provenance retrieval | Arbitrary external URLs cannot create SSRF |
| Transparency | Security-significant changes publicly auditable without exposing PII |
| Recovery | Tested procedure to reconstruct last-known-good registry and revoke a compromised key |
| Consumer security contract | Resolver responses expose registry version, freshness, and authenticated content identity |
| Monitoring | Reviewer, namespace, semantic, replica, and trust-root changes produce alerts |
The public site's present abstention-first architecture should be preserved during expansion.
Controls required before production semantic generalization
The bar before enabling arbitrary unseen-expression resolution should be substantially higher than the bar for exact reviewed lookups.
Production promotion should require:
| Gate | Requirement |
|---|---|
| Authority separation | Embedding/vector output can nominate candidates but cannot itself create semantic authority |
| Independent decision layer | Candidate retrieval and final Concept decision are separate components |
| Calibrated abstention | Security evaluation proves acceptable behavior on ambiguous, out-of-distribution, adversarial, and unknown queries |
| Hard-negative robustness | Evaluation includes deliberately deceptive semantic neighbors |
| Corpus-poisoning red team | PoisonedRAG-style and dense-retrieval poisoning tests incorporated into release gates |
| Prompt-injection red team | Descriptions, provenance, Unicode-hidden instructions, and federated text evaluated |
| Model provenance | Exact model/tokenizer/embedding version and training/evaluation data lineage recorded |
| Reproducible embedding generation | Same signed input + model profile produces verifiable derived index |
| Shadow period | Semantic decisions logged but do not affect production outputs until sufficient evidence accumulates |
| Multi-model differential testing | Major model changes compared against alternative retrieval methods and previous production model |
| Adversarial canaries | Known trigger expressions and poisoned corpus documents continuously tested |
| Blast-radius controls | Ability to disable semantic runtime instantly without taking exact resolution offline |
| Consumer signaling | Response distinguishes exact-reviewed, model-suggested, ambiguous, and abstained results cryptographically and structurally |
| No autonomous high-impact action from low confidence | Critical agents must require stronger semantic assurance than ordinary search applications |
The project's current methodology already recognizes several of these principles—hard negatives, false-neighbor rate, score margin, cross-language agreement, and abstention—but security promotion should add explicit adversarial poisoning and injection testing.
Incident-response plan
NIST SP 800-61 Rev. 3 integrates incident response throughout cybersecurity risk management rather than treating response as an isolated post-event process.
For Embedded Semantics, the response plan should define semantic-specific incident classes:
| Incident | Immediate containment |
|---|---|
| Reviewer compromise | Suspend reviewer identity; quarantine all approvals since suspected compromise |
| Admin compromise | Freeze privileged mutation; verify trust-root state independently |
| Signing-key compromise | Revoke key; switch to recovery quorum; mark affected signature interval |
| Poisoned Concept | Disable affected mapping through signed emergency policy while preserving history |
| Malicious merge/deprecation | Halt automatic migration; restore prior semantics via new corrective event |
| Resolver compromise | Remove from service; force clients to authenticated alternate resolver |
| Split-view evidence | Preserve signed conflicting checkpoints; isolate offending log/registry |
| Federation compromise | Quarantine member; stop imports; retain existing records with “trust suspended” state |
| Model poisoning | Disable model lane; exact resolver remains active |
| Supply-chain compromise | Stop releases; verify source-to-artifact lineage; rebuild from clean isolated environment |
| API DoS | Admission control/rate-limit escalation without weakening authentication |
| Privacy disclosure | Stop further replication where legally/technically possible; rotate exposed secrets; assess log permanence |
Forensic evidence must include signed registry checkpoints, transparency-log proofs, authorization attestations, identity-provider events, deployment provenance, model/version identifiers, cache/replica state, and affected downstream Concept IDs.
The registry should predefine a machine-readable Semantic Security Advisory object containing incident ID, severity, affected Concepts, affected registry epochs, invalid signer/key identifiers, vulnerable model profiles, mitigation status, last-known-good checkpoint, and required consumer action.
Security testing program
A credible testing program should run continuously rather than as a one-time penetration test.
Application-security testing should cover OWASP API authorization, authentication, resource consumption, sensitive business-flow abuse, SSRF, injection, safe rendering, cache behavior, and inventory/old-version exposure.
Authorization testing must specifically attempt role-boundary violations: registrant→reviewer, reviewer→admin, language reviewer→global merge authority, namespace owner→other namespace, ordinary admin→root-key operation, federation operator→local Concept mutation.
Registry-integrity testing should fuzz malformed registry packs, duplicate IDs, version gaps, conflicting parent states, missing provenance, duplicate signatures, invalid timestamps, oversized text, cyclic merges, merge/deprecate races, and replayed operations.
Unicode testing should include all UTS #39 confusable classes, mixed scripts, combining marks, zero-width characters, variation selectors, bidi controls, canonical-equivalence cases, normalization boundary cases, and visually identical but byte-distinct strings.
Language testing should include valid/invalid BCP 47 extensions, private-use tags, deprecated tags, script/region mismatches, code-switching, and language-tag/text mismatches.
Semantic red teaming should create deliberately confusing near-neighbor Concepts, adversarial paraphrases, contradictory translations, misleading definitions, “not-X” versus “X” contrasts, negation scope changes, numerically close concepts, legal/medical term distinctions, and culturally asymmetric concepts.
AI red teaming should reproduce corpus-poisoning and retrieval attacks against candidate-generation models, optimize malicious expressions in embedding space, test indirect prompt injection, test multilingual prompt injections, and assess whether malicious texts survive sanitization while remaining effective. Current research demonstrates that RAG/dense retrieval poisoning is a real rather than hypothetical threat class.
Supply-chain testing should verify SLSA provenance, dependency pinning, builder isolation, signing identity, artifact digest consistency, and reproducibility.
Cryptographic protocol testing should include wrong-key signatures, expired metadata, compromised-key revocation, algorithm downgrade, root rotation, threshold failures, duplicate sequence numbers, future-dated timestamps, replay, rollback, freeze, and mix-and-match snapshots.
Transparency testing should intentionally construct forked tree heads, delayed inclusion, inconsistent views, and missing log entries, then verify that monitors generate actionable signed evidence. RFC 9162 describes consistency and inclusion verification expressly for such auditing.
Federation testing should operate a deliberately malicious test member that signs valid but semantically harmful data, serves stale snapshots, equivocated views, broken language tags, conflicting namespaces, prompt-injection descriptions, and malicious deprecations. The local registry should contain the blast radius automatically.
Recovery exercises should periodically simulate total loss of the online database, compromised publisher key, compromised reviewer set, poisoned model corpus, failed region, and malicious federation member. The acceptance criterion is not “service comes back”; it is “the registry returns to a cryptographically demonstrable semantic state and affected consumers can identify exactly what became invalid.”
Bibliography and standards basis
Embedded Semantics primary material. The system architecture, exact reviewed-expression authority, ConceptCode stability, explicit abstention behavior, model/registry separation, provenance goals, current deployment status, APIs, pre-release bundle manifest, and machine-readable interfaces were derived from the project's public home, FAQ, methodology, status, API, manifest, llms.txt, and about pages.
STRIDE. Microsoft Threat Modeling documentation and Microsoft's STRIDE guidance define the six threat categories and corresponding security properties.
LINDDUN. KU Leuven/DistriNet's LINDDUN materials define Linking, Identifying, Non-repudiation, Detecting, Disclosure, Unawareness, and Non-compliance as privacy threat categories.
OWASP API Security. OWASP API Security Top 10 material informed authorization, resource-consumption, sensitive business-flow, SSRF, inventory, and unsafe-third-party-consumption analysis.
OWASP GenAI/LLM Security. Prompt injection, data/model poisoning, sensitive-information exposure, supply-chain issues, and downstream AI-handling risks were grounded in OWASP's GenAI security guidance.
OWASP web application security. Stored-XSS, CSP, output safety, and SSRF recommendations were drawn from OWASP's XSS, Content Security Policy, and SSRF guidance.
MITRE ATT&CK. Valid Accounts T1078, Trusted Relationship T1199, and Supply Chain Compromise T1195 inform the reviewer/admin, federation, and software-supply-chain threat mappings.
NIST adversarial machine learning. NIST AI 100-2e2025 provides the adversarial-ML taxonomy covering poisoning, evasion, privacy, and misuse across the AI lifecycle.
SLSA. SLSA's current threat and build guidance informed build-control-plane compromise, provenance forgery, trusted builder, and artifact integrity recommendations.
The Update Framework. TUF's specification and security model informed protections against rollback, indefinite freeze, mix-and-match, wrong-artifact, malicious-mirror, and key-compromise attacks.
Sigstore. Sigstore's Fulcio/Rekor architecture and threat model informed short-lived identity-based signatures and transparency-log recommendations.
Certificate Transparency. RFC 9162 provided the append-only Merkle-tree, inclusion-proof, consistency-proof, monitoring, equivocation, and gossip basis for the proposed semantic transparency log.
DNS security. RFC 4033's DNSSEC security model informed authenticated federation discovery and the distinction between data-origin authentication/integrity and availability.
Unicode security. Unicode UTS #39 provides confusable and mixed-script security mechanisms; UAX #9 provides bidirectional-text behavior and security warnings.
Language tags. RFC 5646/BCP 47 defines the structure, extensions, private-use handling, and registry model for language tags.
Package-registry security analogies. PyPI's official policies explicitly recognize name squatting, typo-squatting, dependency confusion, and security-driven name reservation, making package registries a useful analogue for Concept namespace governance.
Cryptographic signatures and key management. NIST FIPS 186-5 and SP 800-57 informed digital-signature and key-lifecycle recommendations.
Transport security. IETF TLS guidance and TLS 1.3's explicit downgrade defenses informed transport and algorithm-downgrade recommendations.
Incident response. NIST SP 800-61 Rev. 3 informed preparation, containment, recovery, and integration of response with broader risk management.
Retrieval and embedding poisoning research. PoisonedRAG and subsequent dense-retrieval poisoning work provide direct experimental evidence that small amounts of adversarial corpus content can manipulate embedding-based retrieval and downstream model behavior.
Indirect prompt-injection research. Recent empirical work on external-content prompt injection supports treating all semantic descriptions, provenance, federation records, and retrieved registry text as potentially adversarial data when supplied to AI agents.