S276 - Vispi: Automatic Visual Perception and Interpretation of Chest X-rays

Xin Li, Rui Cao, Dongxiao Zhu

Show abstract - Show schedule - PDF - Reviews - Teaser

Computer-aided medical image visual perception and interpretation with deep learning remain a challenging task, due to the lack of high-quality annotated image-report pairs and tailor-made generative models for sufficient extraction and exploitation of localized semantic features associated with abnormalities. To tackle these challenges, we present Vispi, an automatic medical image interpretation system, which first annotates an image via classifying and localizing common thoracic diseases with visual support and then followed by report generation from an attentive LSTM model. Analyzing an open IU X-ray dataset, we demonstrate a superior performance of Vispi in disease classification, localization and report generation using automatic performance evaluation metrics ROUGE and CIDEr.
Hide abstract

Poster Session #6 - 13:30 - 15:00 UTC-4 (Wednesday)
Hide schedule

Access paper channel


Short paper


Can't display slides, your browser doesn't support embedding PDFs.

Download slides