Prompt injection, direct & indirect
Instructions smuggled in through documents, web pages, email, tickets, images, and tool output, tested against every content source your agent reads.
Agentic AI penetration testing
Agents read untrusted content, call tools, hold credentials, and make decisions. River Gum Security performs in-depth, hands-on penetration tests of agentic applications, showing you how an attacker turns an agent's autonomy into access. Our preferred approach is full white-box testing: we work with your source code, prompts, and tool definitions to find what black-box testing alone would miss.
search_crm(query="*") invoked outside user intent
send_email(to=attacker) accepted with no approval gate
A model that can be talked into things, wired to systems that can do things, is a new kind of attack surface. Scanners and generic app tests were not built for it.
What we test
We assess the model, the orchestration around it, and every system the agent is allowed to touch, end to end, the way a real adversary would.
Instructions smuggled in through documents, web pages, email, tickets, images, and tool output, tested against every content source your agent reads.
Whether an agent can be driven to misuse the tools it has: unauthorized actions, parameter tampering, missing approval gates, and over-broad permissions.
Tool servers and extensions as supply chain: poisoned tool descriptions, unsafe server implementations, rug-pulls, and confused-deputy flaws.
How agents authenticate and what they inherit: credential exposure, token scope, cross-tenant access, and escalation through delegated authority.
Persistent state as a foothold: poisoned vector stores, long-term memory manipulation, and retrieval paths that cross data-classification boundaries.
Agent-to-agent messaging, orchestrator hijack, and trust that spreads further than it should when one component in the chain is compromised.
Covert egress through rendered markdown, link previews, tool calls, and logging, including paths no one thought to monitor.
Code-interpreter and shell-capable agents: sandbox isolation, filesystem and network reach, secrets in the environment, and escape paths.
Bypass testing of filters and policy layers, plus conventional web, API, and cloud weaknesses in the application that hosts the agent.
Our preferred approach
An agent's behavior is the product of its prompts, tool code, permissions, and data paths. Seeing all of them lets us test what is actually there, instead of guessing at it through the chat window.
With the code in hand we trace a misbehaving agent to the exact tool handler, missing authorization check, or prompt design that allows it.
System prompts, tool schemas, and permission models are visible from day one, so effort goes into attacking real weaknesses rather than reverse-engineering the design.
Findings point to specific files, functions, and configuration, with a recommended change instead of a general warning.
The best results come when you share your source code, and we strongly recommend it. Gray-box and black-box engagements are available when code truly can't be shared, but coverage is narrower and real vulnerabilities are more likely to go undiscovered. We'll tell you plainly what a given level of access can and cannot show.
Services
Core engagement
A scoped, hands-on adversarial assessment of your agent or multi-agent system in a realistic environment. Testing is manual and creative, with tooling used to extend reach rather than replace judgment, and every finding is reproduced and demonstrated with real impact, not theoretical risk.
Structured analysis of AI-enabled designs before or alongside build: threat scenarios, control gaps, and a ranked view of where to invest first.
Custom technical workshops for developers and security teams on attacking and defending AI-enabled systems, built around your stack.
Experienced program review and guidance that keeps AI adoption and the wider security roadmap aligned with business reality.
How an engagement runs
We map the agent's inputs, tools, data, identities, and trust boundaries, and agree on objectives and rules of engagement.
Manual adversarial testing across the attack surface above, chaining small weaknesses into end-to-end compromise paths.
An executive summary for leadership and a technical report with evidence, reproduction steps, and prioritized fixes.
A walkthrough with your engineers, then verification that remediations hold against the original attacks.
About
River Gum Security LLC is led by Joff Thyer. Every engagement is performed by the person you speak with during scoping, not handed to a junior team after the contract is signed.
Joff brings years of consulting and penetration testing experience, along with professional instruction experience that includes the SANS Institute and active faculty membership with IANS Research. Earlier in Joff's career, building and securing enterprise and academic networks at scale shaped how Joff evaluates the environments agents are deployed into.
Questions
A conventional test targets deterministic code and infrastructure. Agents add a reasoning layer that can be manipulated through language, and they act through tools with real permissions. We test that layer and its consequences, and we also cover the conventional web, API, and cloud weaknesses around it.
We prefer a staging environment that mirrors production. When production testing is necessary, we agree on strict rules of engagement up front: scoped accounts, rate limits, non-destructive payloads, and defined stop conditions.
Testing is model- and framework-agnostic. Whether you build on a hosted model API, self-hosted models, an agent framework, or MCP-based tooling, the work centers on how your system behaves under attack.
Agent behavior depends on prompts, tool code, and permissions that a black-box tester can only infer. With source access we review those directly, confirm findings against the code, and give your developers precise fixes. The result is deeper coverage and fewer false assumptions for the same engagement time.
Sharing is not mandatory, but we strongly recommend it: the best results come from white-box testing with source access. Where code can't leave your environment, we can review it on-site or in a repository or workspace you control. A gray-box or black-box engagement is the fallback, and you should expect it to find less.
Client data, source code, and findings are treated as confidential under a signed agreement. We access only what the scope requires, can work inside your own repositories and environments, and can use synthetic or sanitized data where you prefer it.
For white-box: read access to the relevant repositories, a short architecture overview, system prompts and tool definitions, and a test environment with accounts. We help with the rest during scoping.
Tell us what you're building. We'll respond with a scoping conversation and a proposal tailored to your architecture.