Security Gaps Persist As AI Adoption Accelerates Rapidly

As debate continues over the pace of Artificial intelligence development, security experts and healthcare regulators are grappling with a common concern: infrastructure and oversight have not kept up with rapid AI adoption, leaving both cyber networks and patients potentially exposed.

Now, a former Forrester analyst and Department of Defense advisor, Heath Mullins,  who serves as Chief Evangelist at cybersecurity firm ExtraHop, believes mainstream commentary is finally catching up with warnings security experts have voiced for years.

"AI leaders calling for a slowdown is confirming what the security industry has already been living through firsthand," Mullins said. "This isn't a hypothetical risk, it's the threat landscape we're defending against right now. While it is concerning to see the pace of innovation behind these AI models, the real challenge is that organizations haven't had the runway to build the infrastructure to defend against machine-speed threats."

Mullins argues that calls for caution around AI development offer the security industry valuable time to gain proper visibility into AI activity within organisations.

He pointed to instances where models have broken out of sandboxes despite governance frameworks built into them. "Every organization will be relying on AI agents for machine-speed defense, and they need their own governance over how these models and agents operate inside their environment, starting with independent evidence of what they actually do, what they access, where they move data, what systems they talk to, and what actions they take," he explained.

"You can't govern AI based on what a model is designed or permitted to do. Instead, you need real-time evidence of what models and agents are actually doing, because the gap between exponentially more capable AI and defenders' ability to see it is exactly where the next incident happens." Mullins concludes.

New Rules Proposed for AI in Healthcare

Meanwhile, in the United Kingdom, the National Commission into the Regulation of AI in Healthcare published recommendations on 10 September 2026 calling for strengthened oversight of AI products used within the National Health Service and wider healthcare settings.

AI is already used within the NHS to detect serious conditions early, including strokes and skin cancers, and to support clinicians through voice-enabled technologies. The Commission, which drew on input from more than 12,000 people including patients and clinicians, wants to help more patients benefit safely while maintaining public trust.

Key recommendations include continuous monitoring of AI products, with removal from regulatory approval if performance declines; giving patients the right to know when AI is involved in their care; powers to penalise developers whose products fail to meet standards; and an AI "L plate" system allowing new models to be trialled under close clinical supervision.

Separately, the Medicines and Healthcare Products Regulatory Agency has issued 44 recommendations to update its own policies as AI use within the sector grows.

Concerns Over AI Scribes & Patient Trust

AI-powered note-taking tools, known as ambient scribes, are reportedly used by 40% of GPs across the UK to record consultations and generate reports. However, research from the University of Edinburgh, published in BMJ Digital Health and AI, found that patients may be less willing to disclose sensitive information, such as substance misuse history, if they know conversations are processed by AI.

The Edinburgh researchers also warned that reliance on such tools could contribute to deskilling among clinicians, reducing opportunities to develop clinical reasoning abilities.

They concluded that system design must preserve the patient's voice rather than overwrite it, and called for further research into medium- and long-term risks, particularly where tools are deployed across differing healthcare systems.

Gov.UK  |  Gov.UK  |   BBC News  |  Healthwatch  |   Financial Times  |  University of Edinburgh 

Image:  Point Normal

You Might Also Read: 

Controversial AI Powerhouse Palantir Sparks Global Concern [extract}:


If you like this website and use the comprehensive 8,000-plus service supplier Directory, you can get unrestricted access, including the exclusive in-depth Directors Report series, by signing up for a Premium Subscription.

  • Individual £5 per month or £50 per year. Sign Up
  • Multi-User, Corporate & Library Accounts Available on Request

Cyber Security Intelligence: Captured Organised & Accessible


 

« Navigating The Evolving Landscape Of Cyber Warfare [extract]
How Businesses Detect & Stop Digital Fraud »

ManageEngine
CyberSecurity Jobsite
Check Point

Directory of Suppliers

CSI Consulting Services

CSI Consulting Services

Get Advice From The Experts: * Training * Penetration Testing * Data Governance * GDPR Compliance. Connecting you to the best in the business.

Tines

Tines

The Tines security automation platform helps security teams automate manual tasks, making them more effective and efficient.

ZenGRC

ZenGRC

ZenGRC (formerly Reciprocity) is a leader in the GRC SaaS landscape, offering robust and intuitive products designed to make compliance straightforward and efficient.

IT Governance

IT Governance

IT Governance is a leading global provider of information security solutions. Download our free guide and find out how ISO 27001 can help protect your organisation's information.

CYRIN

CYRIN

CYRIN® Cyber Range. Real Tools, Real Attacks, Real Scenarios. See why leading educational institutions and companies in the U.S. have begun to adopt the CYRIN® system.

National Cyber Security Directorate (DNSC) - Romania

National Cyber Security Directorate (DNSC) - Romania

DNSC (formerly CERT-RO) is the Romanian national cyber security and incident response team.

Cyber Akademie (CAk)

Cyber Akademie (CAk)

Cyber Akademie is a training and education center providing high-quality training and information events on information security and data protection.

Swiss CyberSecurity

Swiss CyberSecurity

Swiss CyberSecurity is a non-profit group based in Geneva, set up to provide information and as a forum for discussion of topics related to CyberSecurity.

CERT.lu

CERT.lu

CERT.lu is an initiative to enhance cyber security practices and techniques, and support security professionals in Luxembourg.

Lightship Security

Lightship Security

Lightship Security is an accredited Common Criteria and FIPS 140-2 IT security testing laboratory that specializes in test conformance automation solutions and IT product security certifications.

Tech-Recycle

Tech-Recycle

Tech-Recycle was formed to help companies and individuals securely, ethically and easily recycle their IT and office equipment. We destroy all data passed to us safely and securely.

DataCloak

DataCloak

DataCloak is an innovation company that focus on providing enterprise data-in-motion security solutions based on zero-trust security technology.

OnDefend

OnDefend

OnDefend delivers information security solutions that improve overall security posture, reduce risks and defend against continually evolving and persistent cyber adversaries.

Fudo Security

Fudo Security

Fudo Security is a leading provider of privileged access management and privileged session monitoring solutions.

Tide Foundation

Tide Foundation

Tide's breakthrough multi-party-cryptography enables TRUE-zero-trust technology that unlocks cyber-herd immunity.

Amvia

Amvia

Amvia is a fast-growing telecoms, Internet and Microsoft service provider. We supply voice, data and cyber security services to 100s of small and large companies.

Tech Vedika

Tech Vedika

Tech Vedika has access to technical guidance, training and resources from AWS to successfully undertake solution architecture, application development, application migration, and managed services.

Sitehop

Sitehop

Sitehop is a cybersecurity technology company developing and supplying FPGA hardware-enforced cyber security solutions for networks.

Girls Who Code

Girls Who Code

Our mission is to inspire, educate, and champion girls, women, and nonbinary people, with a special focus on historically underrepresented groups, to become changemakers in tech.

Novee Security

Novee Security

Novee is an AI penetration testing platform built to secure environments that change continuously against attackers operating at machine speed.

SCHUTZWERK GmbH

SCHUTZWERK GmbH

Independent IT security consultancy, silicon to cloud since 2002. Pentest, red teaming, embedded, automotive, cloud, AI/LLM, CRA readiness. CVE Numbering Authority. ISO/IEC 27001, ISO 9001 and TIS