IBM's Watson and the Challenges of AI in Healthcare
The Case
IBM’s Watson for Oncology, a machine-learning system designed to recommend cancer treatments, came under scrutiny after it was found to suggest unsafe and incorrect treatments for patients. This software uses artificial intelligence algorithms to recommend cancer treatments tailored to individual patients. It claims to base its recommendations on data from real patients and is used by over 200 hospitals globally. However in 2017, it was revealed that the system often recommended treatments that were not suitable for patients and inconsistent with national treatment guidelines in the US.
Key Issues
It’s clear that AI has the potential to transform healthcare for the better, but cases like this highlight the caution that must be applied in implementing these resources. For 2022/23, the NHS litigation expenditure surpassed £2.6 billion. Relying on AI and implementing incorrect treatment could lead to an increase in claims against healthcare providers, undermining the cost and time benefits that AI is intended to create. It is clear that any implementation of AI systems and healthcare will need stringent testing and regulation to ensure the risks of AI do not outweigh the benefits.