Is Artificial Intelligence Becoming Too Smart for Regulators?

Artificial Intelligence Regulation. AI poses ethical, legal, and socio-economic dilemmas such as data sensitivity, privacy, and cyber security.

AI is Everywhere and it isn’t that New!

The term ‘artificial intelligence’ (AI) was first coined in the 1950s. Since then, this disruptive idea has come a long way from concept to reality.

From enhancing photos for your social media page to detecting diseases from medical images, AI is omnipresent in our day-to-day life. In business sectors, AI-driven analytics are used to detect fraud and predict stock movements. AI in digital media improves click through rates and helps businesses gain market insights. AI-powered chatbots are replacing physical staff, assisting customers with the information they need.

All of this is possible thanks to major advancements in computing power and ‘machine learning’ (ML) capabilities, the backbone of AI.

AI in Healthcare

In healthcare, AI is opening doors that were limited with conventional technology.

  • An Australian startup is building the world’s largest metagenomics database. They’re using an AI/ML powered cloud platform to a gain deeper understanding of microbiomes. This may help to predict different disease states including IBDs and cancer with a high degree of accuracy.
  • In radiology, radiomics (a technique for extracting large data from radiographic medical images using algorithms) is surpassing the naked eye in detecting disease states.
  • It is also forecast that AI-based technology can reduce the burden on physicians, medical information and transcription by 17-20%.

Challenges for Health Authorities

With such fast-emerging technologies on the way, AI is causing some headaches for health authorities globally.

At a fundamental level, AI poses ethical, legal, and socio-economic dilemmas such as data sensitivity, privacy, and cyber security, to name a few.

For the medical technology sector, AI introduces complexity that traditional medical device regulation was not designed for. An example is the adaptiveness of an AI software algorithm (i.e. a different output to the output at the time of approval). Such unpredictability is making it difficult for regulators to evaluate the ‘basis’ behind AI’s decision making (prognosis, treatment recommendation etc.).

Artificial Intelligence Regulation is, without a doubt, complex and unchartered territory, and opinions are divided.

However, regulators and lawmakers agree on one thing:

The benefits of AI are vital to medical technology and we need a new framework fast!

Regulating Artificial Intelligence. Experts agree, the benefits of AI are vital to medical technology and we need a new framework fast!

Artificial Intelligence Regulation

Right now, China is leading the world by laying down a national plan for AI. In 2019, the NMPA released a “Technical Guideline on AI-Aided Software”, and approvals are being granted through an ‘innovative’ pathway for AI-based diagnostic software in radiology.

The US FDA followed suit with action plans mapping out a regulatory framework for AI/ML based Software as a Medical Device (SaMD). Guidelines on Good Machine Learning Practice (GMLP) are also in development.

The first cardiac ultrasound software that uses AI was given US marketing authorisation in 2020 (via De Novo pathway).

Other developed countries are trailing behind, with the EU first tackling the ethical and legal issues, and Australia’s TGA planning to issue a separate guideline to the existing SaMD document.

In principle, countries with mature regulatory frameworks are largely aligned in adopting a total product lifecycle approach for AI by proposing that manufacturers:

  • Establish assurance of organisational culture of quality and excellence (i.e. GMLP)
  • Plan for algorithm changes (i.e. premarket assurance plan)
  • Take a planned approach for modifications after initial product review
  • Be transparent and monitor products’ real-world performance

Effective regulatory frameworks will support introduction of this powerful technology, for the benefit of patients globally.

Contact us for Regulatory and Quality assistance with your new generation medical devices.

More recent articles

  • Australia and the ACCESS Consortium: Navigating Regulatory Collaboration

    Australia and the ACCESS Consortium: Navigating Regulatory Collaboration

    The Access Consortium is a coalition of like-minded regulatory authorities working together to promote greater regulatory collaboration and alignment of regulatory requirements. Learn how the ACCESS Consortium can streamline medicine approvals in Australia and partner countries, accelerating access to new therapies. Australia as an Early Entry Market for Medicines Australia is an increasingly attractive early…

  • Life Sciences Expansion Strategies Greater Bay Area – China

    Life Sciences Expansion Strategies Greater Bay Area – China

    China’s Greater Bay Area (GBA) initiative aims to create a single, integrated economic zone, fostering innovation, connectivity, and environmental sustainability. We explore how the Greater Bay Area (GBA) is transforming life sciences and medical device access in China, with regulatory benefits and streamlined market entry opportunities. What is the Greater Bay Area (GBA)? The Greater…

  • Australia’s TGA Priority Review Pathway

    Australia’s TGA Priority Review Pathway

    How Australia’s TGA Priority Review Pathway Helps Speed Up Access to New Medicines. The ultimate goal of every regulatory submission is patient access. Whether seeking approval for a new prescription medicine or an additional indication for an existing drug, the objective remains the same — providing patients with the best possible treatment options as quickly…