Skip to main content

Dr. AI, Where Did You Get Your Degree?

  • Conference paper
  • First Online:
Artificial Intelligence in Health (AIH 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11326))

Included in the following conference series:

  • 1046 Accesses

Abstract

Federal health agencies are currently developing regulatory strategies for Artificial Intelligence based medical products. Regulatory regimes need to account for the new risks and benefits that come with modern AI, including safety concerns and unique opportunities, like the potential for autonomous learning, that makes AI dramatically different from traditional static medical products. The current default regulatory regime is to treat AI like a medical device (i.e., as opposed to like a drug or a biologic product). As agencies like the U.S. Food and Drug Administration (FDA) develop new regulation to cover the uniqueness of AI, we suggest they consider adopting aspects of regulation traditionally used in the practice of medicine (i.e., doctors). In fact, FDA is currently undergoing a pilot that moves in that direction. We propose that AI regulation in the medical domain can analogously adopt aspects of the models used to regulate medical providers. We provide this view point to encourage discussion of how medical AI might be regulated. In doing so, we will also review several issues our framework does not resolve.

The views expressed in this paper come solely from the authors, and do not represent an official or endorsed position by Booz Allen Hamilton.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://www.fda.gov/medicaldevices/digitalhealth/digitalhealthprecertprogram/default.htm.

  2. 2.

    https://www.fda.gov/downloads/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/UCM524904.pdf.

  3. 3.

    https://www.forbes.com/sites/bernardmarr/2017/01/20/first-fda-approval-for-clinical-cloud-based-deep-learning-in-healthcare.

  4. 4.

    https://www.fda.gov/MedicalDevices/DigitalHealth/DigitalHealthPreCertProgram/default.htm#getinvolved.

  5. 5.

    https://phys.org/news/2016-05-humans-automated-advisor-bad-advice.html#jCp.

References

  1. Digital health innovation action plan introduction. Technical report, Food & Drug Administration (2017). https://www.fda.gov/downloads/MedicalDevices/DigitalHealth/UCM568735.pdf

  2. Data Science Bowl (2018). https://datasciencebowl.com/

  3. Anderson, J.G.: Social, ethical and legal barriers to e-health. Int. J. Med. Inform. 76(5), 480–483 (2007). https://doi.org/10.1016/j.ijmedinf.2006.09.016. http://www.sciencedirect.com/science/article/pii/S1386505606002218. ISSN 1386-5056

    Article  Google Scholar 

  4. Biggio, B., Fumera, G., Roli, F.: Security evaluation of pattern classifiers under attack. IEEE Trans. Knowl. Data Eng. 26(4), 984–996 (2014). https://doi.org/10.1109/TKDE.2013.57. ISSN 10414347

    Article  Google Scholar 

  5. Biggio, B., Roli, F.: Wild Patterns: Ten Years After the Rise of Adversarial Machine Learning, pp. 32–37 (2017). http://arxiv.org/abs/1712.03141

  6. Finlayson, S.G., Kohane, I.S., Beam, A.L.: Adversarial Attacks Against Medical Deep Learning Systems (2018). https://arxiv.org/abs/1804.05296

  7. Goodman, B., Flaxman, S.: European union regulations on algorithmic decision-making and a “right to explanation”. AI Mag. 38(3), 50 (2017). https://doi.org/10.1609/aimag.v38i3.2741. http://www.aaai.org/ojs/index.php/aimagazine/article/view/2741. ISSN 0738-4602

    Article  Google Scholar 

  8. Gottlieb, S.: FDA’s comprehensive effort to advance new innovations: initiatives to modernize for innovation. Technical report, Food and Drug Administration (2018). https://blogs.fda.gov/fdavoice/index.php/2018/08/fdas-comprehensive-effort-to-advance-new-innovations-initiatives-to-modernize-for-innovation/

  9. Leveson, N., Turner, C.: An investigation of the Therac-25 accidents. Computer 26(7), 18–41 (1993). https://doi.org/10.1109/MC.1993.274940. http://ieeexplore.ieee.org/document/274940/. ISSN 0018-9162

    Article  Google Scholar 

  10. Lipton, Z.C.: The doctor just won’t accept that! In: Interpretable ML Symposium at NIPS (2017). http://arxiv.org/abs/1711.08037

  11. Morrison, J., Wickersham, P.: Physicians disciplined by a state medical board. JAMA 279(23), 1889 (1998). https://doi.org/10.1001/jama.279.23.1889. http://jama.jamanetwork.com/article.aspx?doi=10.1001/jama.279.23.1889. ISSN 0098-7484

    Article  Google Scholar 

  12. Popejoy, A.B., Fullerton, S.M.: Genomics is failing on diversity. Nature 538(7624), 161–164 (2016). https://doi.org/10.1038/538161a. http://www.nature.com/doifinder/10.1038/538161a. ISSN 0028-0836

    Article  Google Scholar 

Download references

Acknowledgments

We thank anonymous reviewers as well as participants in AIH 2018 workshop at FAIM for their generous feedback and discussions, which have improved this paper.

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Edward Raff , Shannon Lantzy or Ezekiel J. Maier .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Raff, E., Lantzy, S., Maier, E.J. (2019). Dr. AI, Where Did You Get Your Degree?. In: Koch, F., et al. Artificial Intelligence in Health. AIH 2018. Lecture Notes in Computer Science(), vol 11326. Springer, Cham. https://doi.org/10.1007/978-3-030-12738-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-12738-1_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-12737-4

  • Online ISBN: 978-3-030-12738-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics