Security Gaps Persist As AI Adoption Accelerates Rapidly
As debate continues over the pace of Artificial intelligence development, security experts and healthcare regulators are grappling with a common concern: infrastructure and oversight have not kept up with rapid AI adoption, leaving both cyber networks and patients potentially exposed.
Now, a former Forrester analyst and Department of Defense advisor, Heath Mullins, who serves as Chief Evangelist at cybersecurity firm ExtraHop, believes mainstream commentary is finally catching up with warnings security experts have voiced for years.
"AI leaders calling for a slowdown is confirming what the security industry has already been living through firsthand," Mullins said. "This isn't a hypothetical risk, it's the threat landscape we're defending against right now. While it is concerning to see the pace of innovation behind these AI models, the real challenge is that organizations haven't had the runway to build the infrastructure to defend against machine-speed threats."
Mullins argues that calls for caution around AI development offer the security industry valuable time to gain proper visibility into AI activity within organisations.
He pointed to instances where models have broken out of sandboxes despite governance frameworks built into them. "Every organization will be relying on AI agents for machine-speed defense, and they need their own governance over how these models and agents operate inside their environment, starting with independent evidence of what they actually do, what they access, where they move data, what systems they talk to, and what actions they take," he explained.
"You can't govern AI based on what a model is designed or permitted to do. Instead, you need real-time evidence of what models and agents are actually doing, because the gap between exponentially more capable AI and defenders' ability to see it is exactly where the next incident happens." Mullins concludes.
New Rules Proposed for AI in Healthcare
Meanwhile, in the United Kingdom, the National Commission into the Regulation of AI in Healthcare published recommendations on 10 September 2026 calling for strengthened oversight of AI products used within the National Health Service and wider healthcare settings.
AI is already used within the NHS to detect serious conditions early, including strokes and skin cancers, and to support clinicians through voice-enabled technologies. The Commission, which drew on input from more than 12,000 people including patients and clinicians, wants to help more patients benefit safely while maintaining public trust.
Key recommendations include continuous monitoring of AI products, with removal from regulatory approval if performance declines; giving patients the right to know when AI is involved in their care; powers to penalise developers whose products fail to meet standards; and an AI "L plate" system allowing new models to be trialled under close clinical supervision.
Separately, the Medicines and Healthcare Products Regulatory Agency has issued 44 recommendations to update its own policies as AI use within the sector grows.
Concerns Over AI Scribes & Patient Trust
AI-powered note-taking tools, known as ambient scribes, are reportedly used by 40% of GPs across the UK to record consultations and generate reports. However, research from the University of Edinburgh, published in BMJ Digital Health and AI, found that patients may be less willing to disclose sensitive information, such as substance misuse history, if they know conversations are processed by AI.
The Edinburgh researchers also warned that reliance on such tools could contribute to deskilling among clinicians, reducing opportunities to develop clinical reasoning abilities.
They concluded that system design must preserve the patient's voice rather than overwrite it, and called for further research into medium- and long-term risks, particularly where tools are deployed across differing healthcare systems.
Gov.UK | Gov.UK | BBC News | Healthwatch | Financial Times | University of Edinburgh
Image: Point Normal
You Might Also Read:
Controversial AI Powerhouse Palantir Sparks Global Concern [extract}:
If you like this website and use the comprehensive 8,000-plus service supplier Directory, you can get unrestricted access, including the exclusive in-depth Directors Report series, by signing up for a Premium Subscription.
- Individual £5 per month or £50 per year. Sign Up
- Multi-User, Corporate & Library Accounts Available on Request
- Inquiries: Contact Cyber Security Intelligence
Cyber Security Intelligence: Captured Organised & Accessible






