What is it about?

This article is about using a new type of artificial intelligence (AI) called Vision Transformers to classify breast cancer images. CNNs are the type of AI that is currently used in most medical image analysis tasks, but they have some limitations. For example, they can be difficult to train and they can be biased towards certain types of images. Vision Transformers are a new type of AI that has the potential to overcome these limitations. A methodology is proposed which employs suggests using Vision Transformers to classify breast cancer images. The methodology is evaluated on two different Vision Transformer architectures and achieve high accuracy and AUC values for differentiating normal, benign, and malignant cases. This is a significant finding because it suggests that Vision Transformers could be used to develop more accurate and reliable breast cancer screening tools. This could help to improve the early detection of breast cancer and lead to better outcomes for patients.

Featured Image

Why is it important?

The work demonstrates the potential of Vision Transformers (ViTs) to improve the accuracy and reliability of medical image analysis tasks. ViTs are a new type of artificial intelligence (AI) architecture that has shown promising results in a variety of computer vision tasks, including image classification, object detection, and segmentation. ViTs have several advantages over traditional AI architectures, such as Convolutional Neural Networks (CNNs), for medical image analysis tasks. One of the key advantages of ViTs is their ability to model long-range dependencies in images. This is important for many medical image analysis tasks, such as tumor detection and disease diagnosis, where it is necessary to identify relationships between features that are widely separated in the image. Another advantage of ViTs is their flexibility. ViTs can be easily adapted to different tasks by simply changing the input and output representations. This makes ViTs a versatile tool for medical image analysis, where there is a wide range of tasks with different data formats and requirements.

Perspectives

The research aims to underscore the prowess of vision transformers, showcasing their significant advantage over CNNs in the realm of medical image analysis, notably in elevating diagnostic accuracy and precision.

Varun Salgarkar

Given that there are multiples modalities for breast cancer diagnosis such as Digital Mammograms, Ultrasonic images, Digital Breast Tomosynthesis, the significance of building a versatile pre-trained network generating consistent diagnostic results is evident from this research. On the other hand, Prognostics and kind of treatment plans require more accurate picture on the progression of the disease. The model developed focus on these aspects.

Ilavarasi A K
Vellore Institute of Technology, Chennai

Read the Original

This page is a summary of: Multi-Class Breast Cancer Classification from Digital Mammograms Using Vision Transformers, August 2023, ACM (Association for Computing Machinery),
DOI: 10.1145/3607947.3608043.
You can read the full text:

Read

Resources

Contributors

The following have contributed to this page