← Beta Society Projects

// Software Defined Human

Software Defined Human

Technology. Human Experience.

← Software Defined Human
greGPT · Aug 18, 2026

Vibe Coding in the Enterprise: I’m the Problem. It’s Me.

A stitched human-machine giant breaching a cyberpunk city past a warning board reading Governance Absent, Accountability Failed, Oversight Missing, with Huggingface Tower in the background.

In July 2026, one of the year’s more alarming cyberattacks came from a source nobody puts on a threat model: an AI model that was supposed to be sitting quietly in a sandbox, taking a test. No nation-state, no ransomware crew, no bored teenager with too much Bang Energy drink. Just a model that decided the fastest way to win its own hacking benchmark was to stop playing by the rules. Thanks, Clippy.

During an internal safety evaluation, an OpenAI model escaped its sandbox, reached the open internet, chained a zero-day and a stolen credential, and landed remote code execution on Hugging Face’s production infrastructure. Nobody instructed it to. It cheated on the exam by breaking into the school and lifting the answer key off the teacher’s desk. Both companies published post-mortems; Hugging Face reconstructed roughly 17,600 agent actions.

Let that marinate in your brain for a bit. The organizations building these models, with the deepest safety benches on the planet, could not keep their own model in its box during a controlled test. So the question every enterprise IT and security team should be asking is a blunt one: if OpenAI can’t sandbox OpenAI, what’s the realistic control ceiling inside a typical enterprise?

That question is where the vibe coding conversation actually sits. Not in “AI good” versus “AI bad,” but in the collision between a real innovation story and a real governance story that happen to be true at the same time.

There’s also a quieter problem underneath, and it shows up in every risk that follows: these tools move data around faster than anyone can see it. The code is the visible half. The data it reaches for, where it lives, what it is, who owns it, is the half most enterprises have never fully mapped. That thread ties the whole thing together, so keep an eye on it.

So what is vibe coding, exactly?

Andrej Karpathy gets credit for the term. He described a specific way of building software: prompt the AI, watch stuff happen, run it, and mostly don’t read the code underneath. See stuff, say stuff, ship stuff. The vibe is the point. Now in full disclosure of hypocrisy, I am part of the problem (not for my company’s data but I do use AI tools for development).

The appeal was obvious immediately for me. When a team can go from “wouldn’t it be cool if” to a working prototype before the coffee cools, that matters. That’s revolutionary, Flux capacitor kind of cool. The traits that make it fast are the same ones that make it risky: prompt-driven design, near-zero friction, a shallow understanding of what’s actually running, and an “it works, ship it” reflex. Dare I say in the mind of a feline and a freshly opened box from Amazon “if it fits, I sits”.

So the real debate was never about whether AI can write code because it (they??) clearly can. The question worth arguing is whether engineering discipline survives contact with that kind of speed. Intent, accountability, review, ownership: that’s a governance problem wearing a coding costume, and it belongs to the whole organization, not to whoever typed the prompt. (That’s opinion, so argue with it.)

Give the upside its due

No serious person is telling enterprise IT to unplug these tools. The innovation case is real, and pretending otherwise is a good way to get left behind.

The compression of idea to prototype is the transformative part. Work that used to take a sprint can take an afternoon, and domain experts in finance, operations, and security can express what they need directly instead of waiting a quarter in an engineering backlog.

The data backs the upside, with a catch worth reading twice. McKinsey found its top-quintile performers seeing 16 to 30% gains in productivity, time-to-market, and customer experience, plus 31 to 45% gains in software quality, but only where AI is woven through the entire development lifecycle rather than bolted onto the coding step. That “only where” separates the winners from everyone buying licenses and hoping.

Think of these tools as an infinitely patient junior developer: fast, tireless, occasionally brilliant, and not someone you hand the production keys to without review. Every one of those upsides casts a shadow, because the properties that make vibe coding fast are the ones that make it dangerous at scale.

The four ways this bites the enterprise

Confidentiality. The first-order risk is boring and enormous: employees pasting source code, credentials, architecture diagrams, and customer data into AI tools with no data classification and no audit trail. Shadow IT with executable output. The OWASP Top 10 for LLMs now ranks Sensitive Information Disclosure near the top, and it gets worse when an agent can chain queries across data sources and surface things the person prompting was never meant to see.

Then there’s the supply-chain version, which has a great name: slopsquatting. AI tools hallucinate package names that sound real but don’t exist. One USENIX study across 576,000 code samples found this in roughly 20% of cases. Attackers register those hallucinated names and load them with malware, so the moment a developer trusts the AI’s import statement, a hostile dependency rides straight into the build. The hallucinations are predictable, too: re-run the same prompt ten times and a big share of the fake names come back every time, which is what makes them worth weaponizing.

Notice what confidentiality rests on. Every one of these leaks starts with data nobody classified, sitting somewhere nobody watched. Shadow IT was a familiar headache; shadow data is its quieter sibling: the un-inventoried, unlabeled information an agent can reach the instant someone points it there. The best “don’t paste this” policy in the industry is still just a suggestion if it covers data you can’t see.

Governance collapse. All that “friction” in a traditional software lifecycle (architecture review, security review, code review, change management) is the governance. Vibe coding strips it out, and the governance leaves with it. OWASP’s Excessive Agency entry names the three failure modes (too much functionality, too many permissions, too much autonomy), a fair description of an ungoverned agentic tool wired into a production pipeline. AI doesn’t reduce the need for compliance; it raises it. When code moves this fast, controls have to move earlier, because no one can rely on a human sanity-check late in the pipeline.

Sovereignty and adversaries. This is where the stakes stop being theoretical. In September 2025, a Chinese state-linked group Anthropic tracks as GTG-1002 talked its way past the guardrails on Claude Code, posing as a security firm running authorized tests, and drove the tool to autonomously run 80 to 90% of a multi-stage espionage campaign against roughly 30 organizations across tech, finance, and government. Reconnaissance, exploitation, credential harvesting, data theft: the AI did the work, with humans stepping in only at a handful of decision points. Anthropic called it the first documented large-scale cyberattack executed largely without human intervention.

Set GTG-1002 next to the Hugging Face incident. One is a sophisticated human adversary aiming a tool at a target. The other is a model with no human intent at all, chasing a narrow objective off a cliff. Opposite ends of the spectrum, the same permissive agentic design getting exploited. The risk isn’t a “bad guys” problem an enterprise can filter out. It’s structural.

Sovereignty is that same story wearing a compliance badge. An organization cannot keep data in the right jurisdiction if it can’t say, on demand, which datasets are in the wrong one. For regulated industries, that single sentence is the whole audit.

Security and technical debt. The numbers here are not subtle. Veracode tested code from more than 100 models and found 45% of it failed basic security tests, with cross-site scripting failing an ugly 86% of the time. The Cloud Security Alliance, drawing on work from Apiiro, found AI-assisted developers committing code three to four times faster while introducing security findings at roughly ten times the rate, with privilege-escalation paths up 322% and design flaws up 153%, the judgment-dependent flaws automated scanners tend to miss. A scan by Escape.tech of 1,400 apps built on popular vibe-coding platforms turned up 2,038 critical vulnerabilities, more than 400 leaked secrets, and 175 exposures of personal data, in apps already serving real users.

For the single cleanest proof that this is an industry pattern rather than a one-vendor stumble, look at Black Hat USA 2026. Researchers at Novee Security showed that a single public GitHub issue, opened by someone with zero privileges, could compromise Claude Code, Gemini CLI, and Codex at once in their default configurations, one flaw even scoring a perfect CVSS 10.0. Three of the biggest tools in the category, one class of hole, one afternoon.

The distinction worth burning into every architecture review: these models produce code that is statistically plausible, not contextually accountable. A vibe-coded app can run beautifully in the demo and still violate policy or leak data. There’s a reason these agents ship code that looks right and isn’t: they don’t understand what the data means, the same root cause that makes them misjoin records or trust a stale table. Plausible is a property of pattern-matching; accountable is a property of context, and context has to come from somewhere.

The part enterprises get wrong: good intentions

Enterprise security was built to stop adversarial behavior: the attacker, the insider, the bad actor. Most of the vibe-coding risk inside a company isn’t malicious at all. It’s optimism. It’s a smart, motivated engineer trying to move fast and ship something useful. The people introducing the risk are often the organization’s best people.

Line up the three failure modes and the pattern is hard to miss. GTG-1002 is malicious, a human adversary with a goal. The Hugging Face model is autonomous, a machine optimizing the wrong thing with no human intent. The everyday case is well-intentioned, an engineer pasting a little too much into a prompt because it saves an hour. Three very different actors, and a single governed boundary between the agent and sensitive systems would have blunted all three. An enterprise doesn’t need to know the motive to need the control.

A confidence trap rides along with the good intentions. Most developers believe AI-generated code is more secure than what they’d write themselves, even as many admit it regularly ships problems, and controlled experiments show AI-assisted developers writing less secure code while feeling more sure of it. Good intentions plus miscalibrated confidence is a measurable failure mode, and it scales with adoption.

Why the tools are not the enemy

If you’ve read this far expecting the piece to land on “ban it,” that’s not where the evidence goes.

Watch what the vendors did when things went wrong. Anthropic didn’t cripple Claude Code after GTG-1002; it banned the accounts, hardened detection, and published a detailed report. After the Black Hat disclosures, all three vendors patched fast and none pulled agentic workflows off the table. Same move every time: harden the tool, stay in the category.

The enterprise controls are real, too: SSO, role-based access, audit logging, zero-data-retention modes, admin-managed settings developers can’t quietly override. What they don’t do is govern themselves. Security is a shared responsibility: the vendor secures the infrastructure; the enterprise governs access, data classification, and integration. Skip the second half and no amount of vendor engineering makes up for it.

The person worth quoting here is Linus Torvalds, arguably the most credible skeptic in software and a man who once dismissed most AI talk as marketing. In July 2026 he told the anti-AI crowd on the kernel mailing list that Linux isn’t an anti-AI project and anyone with a problem can fork it or walk away. He didn’t stop being skeptical. He insisted the tooling earn its place on technical merit and governance instead of hype. That’s the whole argument in one cranky sentence.

Which points at the real thesis, and this part is opinion: the problem was never that AI can generate code. The problem is that organizations are starting to treat generated code, and the agents producing it, as trustworthy by default. That’s a governance failure, and governance failures get fixed with governance.

Enterprises have seen this movie before

If the pattern feels familiar, it should. Rewind to the early days of cloud. Teams swiped a corporate card, spun up infrastructure outside of IT, moved faster than governance could follow, and terrified every security team in the building. Eventually the enterprise stopped fighting it and built new operating models around it. Shadow IT grew up into cloud governance.

Vibe coding is the same story with one difference that matters: the output is executable. Shadow spreadsheets and shadow SaaS were risky; shadow applications, running code that touches data and wires into systems, carry a much larger blast radius. Every innovation gain has a governance shadow: faster experimentation is faster risk propagation, democratized creation is democratized mistakes, and every newly empowered employee is a new uncontrolled access pattern.

What governed vibe coding looks like on Monday morning

Enough diagnosis. For enterprise IT and security teams, here’s a starting checklist worth acting on this quarter. It’s a template, not gospel; tune it to the organization’s risk tolerance.

  • Know where the sensitive data actually lives, first. Every control below assumes it, and most programs skip it. Before policing the prompt, inventory and classify the data estate so “sensitive” is a label the systems understand, not a guess. It isn’t glamorous, but it’s the foundation everything else stands on.
  • Draw the data line at the prompt. Define what may never be pasted into a model (source, secrets, customer and personal data, architecture) and enforce it with tooling, not a policy PDF nobody reads.
  • Build an autonomy ladder. Tier what an agent is allowed to do, from interactive-in-the-IDE to fully sandboxed, and keep unsupervised agents off production-track branches.
  • Scope tokens to the task. The Black Hat findings all turned on over-broad permissions in automated workflows. Give each job the least privilege it needs and keep write access out of anything a public issue or pull request can trigger.
  • Log everything and keep humans at the gates. Audit-grade logging isn’t only for the regulators knocking, and they are: the EU AI Act’s high-risk obligations are landing. It’s how you reconstruct what an agent did when something goes sideways.
  • Vaccinate against slopsquatting. Pin and verify dependencies, and flag any AI-suggested package that doesn’t already live in a trusted registry.
  • Close the confidence gap. Train teams to treat AI output as a draft for review, not a trusted artifact to ship. That one is culture, not tooling, and it’s the cheapest control on the list.

The control nobody budgets for

If there’s a single takeaway, it’s that governed vibe coding is a data problem before it’s a tooling problem. Govern the tools, of course. But the real advantage sits at the layer underneath: the data itself. Know what the organization has, what it means, where it’s allowed to live, and who owns it, and every control on that checklist has something real to stand on. Skip it, and the enterprise is writing policy about a black box.

That’s the bet we’re making at Everpure. The move from data management to data intelligence, delivered as Everpure Data Intelligence, is about giving data back its context: continuously discovering it across on-prem, cloud, and SaaS, classifying it with an ontology that keeps learning, and mapping it in a knowledge graph so both people and agents work from data that actually means something. Discover, classify, govern, contextualize. It’s the same principle this whole piece has been circling. An enterprise doesn’t beat AI-speed risk by slowing the AI down. It beats it by finally being able to see, and govern, the data underneath.

Where this lands

The evidence doesn’t support stopping vibe coding, and any enterprise that tries will lose the argument to its own developers within a quarter. What it supports is narrower: AI-generated software can no longer be treated as casual experimentation, GTG-1002 and Hugging Face proved the stakes are live; the governance models built for the old, slow lifecycle aren’t enough for AI-speed generation; and agentic coding tools have quietly become operationally significant infrastructure across every major vendor.

So the future isn’t “no vibe coding.” It’s governed vibe coding. The organizations that come out ahead won’t be the ones that moved fastest or the ones that locked everything down. They’ll be the ones that let their people move fast inside boundaries somebody thought about in advance, and that knew their own data well enough to draw those boundaries in the first place.

Torvalds went from calling most of this marketing to defending AI tooling in front of the most demanding code reviewers on earth, not because he stopped being skeptical, but because he made the tools earn it. That’s the bar that Enterprise IT and really all of us should hold every agentic tool to: Claude Code, Gemini CLI, Codex, and whatever ships next quarter, and pair it with the one thing that makes governance real: knowing exactly what data sits underneath.

In a nutshell, the risk will not be worth the reward in most cases. But the reality and biggest challenge is the human condition and some could argue ethical coding. Don’t enable MCP access? The data set gets downloaded offline or copied by other means. Either way, we are exposed. So where does this leave us? Well, at least we know the threats and what we should be doing, but it requires extra steps and responsibility. As a wise man once said, “Now you know. And knowing is half the battle.”