Health care sector leaders are urging Congress to pass regulations governing the use of artificial intelligence (AI) in the industry, as they navigate the challenges posed by issues such as implicit bias and patient privacy. The concerns were voiced during a recent hearing that delved into the impact of AI on health care, following the significant influence of tools like ChatGPT in the industry.
One key issue raised was the potential for implicit bias in AI programming, which could result in discrimination against patients based on demographics. Benjamin Nguyen, senior product manager at healthcare company Transcarent, highlighted the reliance of generative large language models on vast amounts of written language, inheriting the biases present in the data used for training. House Energy and Commerce Chair Rep. Cathy McMorris Rodgers echoed these concerns, emphasising the need to address the possibility of human biases becoming ingrained in AI technologies.
Witnesses at the hearing stressed the importance of Congress considering the training procedures of AI systems to prevent biases, advocating for the use of “gold-standard data sets” in training to ensure equitable AI use in medicine. Dr. David Newman-Toker from Johns Hopkins University School of Medicine emphasised the need to avoid converting human biases into rigid AI-determined rules.
Another significant aspect discussed was the potential compromise of transparency and patient privacy resulting from the integration of AI in medicine. Rep. Frank Pallone Jr. highlighted the critical necessity for safeguards to protect the privacy and security of patient data. Peter Shen, head of digital health in North America for Siemens Healthineers, emphasised the collaborative effort required to build ethical, transparent, and accessible AI in healthcare.
Witnesses and members of the subcommittee on health expressed concerns about the need to inform patients about the use of AI and the importance of transparency. Benjamin Nguyen emphasised the paramount importance of patients understanding the role of AI in their treatment.
In considering legislation, lawmakers are challenged with finding a balance between fostering innovation and implementing necessary regulations in the realm of AI in health care. Dr. Newman-Toker stressed the importance of carefully crafted regulations, innovative payment incentives, and research resources to overcome barriers and ensure the successful deployment of high-quality AI systems.
Must Read:What is Biden’s executive order to oversee AI and its investment? 20 Facts you must know
