The knowledge we're protecting is the same knowledge we're feeding in

Giri Ram

If you’ve read the rest of this series, you’ve read me make a case for something specific: that Guardrails - the context we build into AI tools - should be drawn from our richest, most complete product knowledge. Research, design rationale, usage patterns, support signals, the things we actually know that generic AI doesn’t.
Which raises a question I’ve deliberately left until now, because it deserves its own post rather than a caveat at the bottom of the others: that richest knowledge is also our most sensitive. It’s our institutional IP, our understanding of our users, and in some cases, information about our customers. The moment we talk about feeding it to AI tools, we have to talk about what happens to it once it leaves our hands.
This isn’t a post about specific tools, vendors, or controls - that’s the wrong altitude for a public post, and it’s not mine to disclose even if it weren’t. It’s a post about how I think Guardians should reason about this, as a standing discipline, regardless of which tools sit underneath.
The uncomfortable overlap
Here’s the tension at the centre of this whole series: the same qualities that make something a good Guardrail are the qualities that make it worth protecting.
Specific. Detailed. Reflective of real users, real decisions, real patterns nobody outside the company would know. That’s exactly what I described in Post 2 as the mark of a well-built Guardrail and it’s also, by definition, the profile of information you don’t want leaving the building carelessly.
There’s no version of this where we get to have deeply useful AI context and zero exposure. The job isn’t to eliminate that tension. It’s to manage it deliberately, the same way we already manage it for every other sensitive system we touch.
What a Guardian has to ask before anything goes in
Before context goes into a Guardrail, I want us asking the same handful of questions every time not as a formality, but as a genuine gate:
Whose information is this, actually? Research about our own product decisions is different from research that contains identifiable customer data. Usage patterns aggregated across thousands of users are different from a support ticket that quotes one specific customer’s exact words. The first category is usually safe to work with thoughtfully. The second needs a much higher bar, and sometimes it needs to be excluded or abstracted before it goes anywhere near an AI tool.
Does this need to be specific, or does it need to be true? A lot of what makes a Guardrail useful is the pattern, not the instance. “Users in this segment consistently struggle with X” carries the insight. The verbatim transcript that produced that insight often doesn’t need to travel with it. Abstracting a pattern from its source is frequently possible without losing what makes it useful and it’s worth defaulting to that abstraction rather than reaching for the raw material out of convenience.
What’s the blast radius if this ends up somewhere I didn’t intend? This is the same question I described in the pattern-level piece on designing for configurable systems - making consequences visible before they’re committed. It applies to Guardian work just as much as it applies to the products we design. Before committing something to a Guardrail, it’s worth a genuine pause on what happens if that context surfaces somewhere unexpected.
Would I be comfortable if this came up in a conversation with the customer it’s about? Not a legal test but a gut-check. If the honest answer is no, that’s the signal to abstract, anonymise, or leave it out, regardless of whether a policy technically permits it.
Guardrails need their own Guardrails
There’s a slightly recursive idea worth naming directly: the knowledge we’re using to make AI safer for the team also needs its own layer of protection.
In practice, that means the review step I described in Post 2 - the Guardian checking accuracy, scope, novelty, and routing - has a security dimension sitting alongside those four checks, not separate from them. Before something gets curated into the shared source of truth in a form other people’s AI tools will draw from, “is this the right information, positioned correctly” and “is this safe to have circulating this widely” are the same conversation, not two different ones.
This is also where the trust argument from Post 2 sharpens further. I wrote there that a weak Guardrail can travel for months before anyone traces a problem back to it. The security version of that is worse: a piece of sensitive information embedded carelessly into a widely-used Guardrail doesn’t just produce a bad AI output somewhere downstream - it’s exposure that compounds every time that Guardrail gets used, by every function drawing from it.
What this changes about how we write things down
If Post 2 raised the bar for how well we document things, this raises a second, different bar: write it so it’s useful, and write it so it’s safe by construction.
A few habits worth building into how we work, not just what we produce:
Default to the pattern, not the source material. When a synthesis will do the job, use the synthesis. Keep the raw material where it already lives, accessible to the people who need it, rather than duplicating it into every Guardrail that references it.
Treat anonymisation as a design skill, not a redaction exercise. Stripping a name isn’t the same as making something safe - context can still be identifying even without a name attached. Getting genuinely comfortable with this is its own competency worth developing.
Assume anything committed to a shared Guardrail will be read by tools and people you didn’t have in mind when you wrote it. That’s not paranoia. Given how many functions are now drawing from the same source of truth, it’s just an accurate description of how the system actually works.
When in doubt, ask, rather than including it and hoping it’s fine. The habit of checking - with whoever owns data governance in your organisation, whatever that function is called - needs to be as normal as the habit of writing the documentation in the first place.
Why this belongs to Guardians, not just to policy
It would be easy to treat this entire post as somebody else’s job - a security team’s job, a legal job, a policy that exists so the rest of us don’t have to think about it. I don’t think that holds up.
Policy can set the boundary. It can’t make the judgment call, in the moment, about whether this specific piece of research is safe to abstract into a Guardrail, or whether that specific support pattern needs one more layer of anonymisation before it’s useful without being exposing. That judgment happens at the point of curation - which is to say, it happens with the Guardian, every time, not with a policy document sitting somewhere unread.
That’s the same argument I made about the review step in Post 2, just extended one layer further. Being trusted with judgment other people can’t easily audit in the moment was already the weight of the role. This is simply the part of that weight that touches security and IP specifically, rather than accuracy and quality.
The through-line
Every post in this series has been about becoming more deliberate with AI rather than more reflexive with it. This one is no different and it’s just pointed at protection instead of usefulness.
The knowledge that makes our Guardrails genuinely good is the same knowledge that deserves genuine care. Holding both of those at once, consistently, on every piece of context that gets curated - that’s not a separate responsibility bolted onto the Guardian role. It’s the same responsibility, seen from the angle we hadn’t looked at yet.
This is the fourth post in the UX Guardians series. Start with Post 1 → · Read Post 2 → · Read Post 3 →
