Transformers in Healthcare: A Survey
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks and has subsequently been adapted in many fields, including healthcare. In this survey paper, we provide an overview of how this architecture has been adopted to analyze various forms of data, including medical imaging, structured and unstructured Electronic Health Records (EHR), social media, physiological signals, and biomolecular sequences. Those models could help in clinical diagnosis, report generation, data reconstruction, and drug/protein synthesis. We identified relevant studies using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. We also discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.
Code (0)
등록된 구현이 없습니다.
Tasks
FairnessSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Recent Survey of Vision Transformers for Medical Image Segmentation
Medical image segmentation plays a crucial role in various healthcare applications, enabling accurate diagnosis, treatment planning, and disease monitoring. Traditionally, convolutional neural networks (CNNs) dominated t…
Image SegmentationInductive BiasMedical Image SegmentationSegmentation+2A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks
Transformer is a deep neural network that employs a self-attention mechanism to comprehend the contextual relationships within sequential data. Unlike conventional neural networks or updated versions of Recurrent Neural …
SurveyFoundation Model for Advancing Healthcare: Challenges, Opportunities, and Future Directions
Foundation model, which is pre-trained on broad data and is able to adapt to a wide range of tasks, is advancing healthcare. It promotes the development of healthcare artificial intelligence (AI) models, breaking the con…
SurveyFederated Learning for Smart Healthcare: A Survey
Recent advances in communication technologies and Internet-of-Medical-Things have transformed smart healthcare enabled by artificial intelligence (AI). Traditionally, AI techniques require centralized data collection and…
Federated LearningManagementSurveyHow COVID-19 influences healthcare workers' happiness: Panel data analysis in Japan
Healthcare workers are more likely to be infected with the 2019 novel coronavirus (COVID-19) because of unavoidable contact with infected people. Although they are equipped to reduce the likelihood of infection, their di…