Incomplete I/O - Blog

AI Deepfakes

2026-10-07T00:00:00+00:00

Impersonation has been a problem since the dawn of time. We have taken great strides in reducing the risk of one computer impersonating another computer when interacting with a third computer. We can also be pretty confident that the user of a computer is who they say they are and not an imposter. Much of this is done with cryptography</em> -- the same stuff that makes it safe for you to shop and bank online.</p>

However, we don't have a good way to prevent impersonation of humans over things like voice or video calls. The news is littered with cases of employees unintentionally leaking data to a nefarious actor just because they sounded convincing.</p>

With the advent of very advanced speech and video synthesis</em>, it has become much easier for the bad guys to have an AI agent call you and pretend to be your grandkid or your boss and convince you to do things you wouldn't otherwise. If one of your kids studying abroad calls and needs some cash for an emergency, we'd likely all make that happen. But how do you know it's one of your kids?</p>

We need an authentication</em> system that enables you to Confirm</em> that the person on the phone is who you think it is. That's precisely the case that the Confirm</em> app (and other tools) were designed to solve. Download the app, create trusts with the app and the people you, well, trust. From that point on, you can both Confirm that you're not being impersonated -- even over a phone or video call.</p>

Find out more, and download the (free and open) app here...</p>

Securing Against The Robots

2026-10-05T00:00:00+00:00

Whether you buy into the hype that AI has come alive and is out to get us, or not, the fact remains that using LLMs to discover and automate large scale attacks against our online services is a very real risk.</p>
This brief article lists five principles that can be applied to better secure your applications and services from bad actors.</p>
Limit Attack Surface</h2>
Defense In Depth</h2>
Defense In Depth</p>

Note</p>
Stuff in a callout box. </div> </div>
Least Privilege</h2>
Principle of least privilege</p>
Logging and Auditing</h2>
Log stuff.</p>
Remember the Humans</h2>
Social Engineering.</p>

AI Foot-Guns

2026-05-03T00:00:00+00:00

</p>
With the sporadic, yet increasing sound of Artificial Intelligence Agent Foot-Guns^{1</a></sup> going off in the distance, I'm left wondering whether we've forgotten the lessons of the past. Or perhaps in the rush to use Large Language Models (LLMs) for everything we're forgetting to put up the same guard rails we did to protect ourselves from Organic Intelligence</em> "hallucinations". What am I misssing?</p>}
It seems like every other day, we're reading about someone's experience with LLM-driven automation, such as Agentic AI, ending in tears and with fewer toes. Entire datasets and backups gone. Whole software repositories left a smoking crater.</p>
This isn't an anti-AI post by any stretch. I'm not an AI naysayer, preaching about the impending AI-pocalypse. But I'm also not a member of the AI cult, drinking the Kool-Aid without checking the ingredients. Like any tool we've developed in the industry ever, once you see past the hype, there's value to be had, but also caution to be exercised.</p>
I started my first software development job in 2000. I already had some years of running production systems in previous roles at that point, all using the only thing we had back then -- Organic Intelligence</em>. But my employer at this software development company didn't, on my first day, hand me the keys to their customers' production databases to drop it as I see fit. So why are folks out there granting</em> these agents the ability to wipe out a whole dataset?</p>
A few years further into my career, I was running some security and other courses for telecommunications companies, utility companies and government. One of the key security concepts we used to drive home was to grant the least privilege necessary for a given user. So why are folks out there granting agents permission to wipe out entire software repos. In most organisations I've worked for, we generally all have to create a pull request and have it reviewed before it's merged.</p>
My (admittedly relatively new) experience with self-hosting LLMs and agents suggests that there are numerous ways to separate different concerns for different agent functions. It's also definitely possible to have LLMs write test cases that would also act as an extra set of checks and balances.</p>
A previous employer and mentor of mine once described there being a difference between a software engineer or software developer, and someone who can write code. In some ways, the code written is less important than some of the other things that the job entails.</p>
LLMs can write code, but there's a lot they're missing that an engineer brings. The same likely applies for other automated tasks.</p>
So whilst we're offloading the writing of code (arguably the most fun part) to AI, perhaps we need to remember to take care of the rest of the job that AI can't, and to supervise it with the same sorts of guardrails we would any human with Organic Intelligence.</p>
^{1</sup>
The term foot-gun</em> is common slang for tools or functionalities within a technology that grant the user all the power they need to shoot themselves in the foot.</p>
</div>}

Incomplete I/O - Blog

AI Deepfakes

Securing Against The Robots

Limit Attack Surface</h2>

Defense In Depth</h2> Defense In Depth</p> Note</p> Stuff in a callout box. </div> </div>Least Privilege</h2> Principle of least privilege</p> Logging and Auditing</h2> Log stuff.</p> Remember the Humans</h2> Social Engineering.</p>

Least Privilege</h2> Principle of least privilege</p>

Logging and Auditing</h2> Log stuff.</p>

Remember the Humans</h2> Social Engineering.</p>

AI Foot-Guns

Defense In Depth</h2>
Defense In Depth</p>

Note</p>
Stuff in a callout box. </div> </div>
Least Privilege</h2>
Principle of least privilege</p>
Logging and Auditing</h2>
Log stuff.</p>
Remember the Humans</h2>
Social Engineering.</p>

Least Privilege</h2>
Principle of least privilege</p>

Logging and Auditing</h2>
Log stuff.</p>

Remember the Humans</h2>
Social Engineering.</p>