about
CT-ScanGaze: A Dataset and Baselines for 3D Volumetric Scanpath Modeling (arxiv.org)
4 points by PaulHoule on Jul 23, 2025 | hide | past | pdf | discuss on HN

In plain words: The first public dataset of eye-tracking data from radiologists reading CT scans, plus a predictor that works on full 3D volumes instead of flat 2D images to predict where they look next. It produced eye-fixation sequences closer to real radiologists' than predictors built for flat 2D images.

Abstract

Understanding radiologists' eye movement during Computed Tomography (CT) reading is crucial for developing effective interpretable computer-aided diagnosis systems. However, CT research in this area has been limited by the lack of publicly available eye-tracking datasets and the three-dimensional complexity of CT volumes. To address these challenges, we present the first publicly available eye gaze dataset on CT, called CT-ScanGaze. Then, we introduce CT-Searcher, a novel 3D scanpath predictor designed specifically to process CT volumes and generate radiologist-like 3D fixation sequences, overcoming the limitations of current scanpath predictors that only handle 2D inputs. Since deep learning models benefit from a pretraining step, we develop a pipeline that converts existing 2D gaze datasets into 3D gaze data to pretrain CT-Searcher. Through both qualitative and quantitative evaluations on CT-ScanGaze, we demonstrate the effectiveness of our approach and provide a comprehensive assessment framework for 3D scanpath prediction in medical imaging.

Trong-Thang Pham, Akash Awasthi, Saba Khan, Esteban Duran Marti, Tien-Phat Nguyen, Khoa Vo, Minh Tran, Ngoc Son Nguyen, Cuong Tran Van, Yuki Ikebe, Anh Totti Nguyen, Anh Nguyen, et al.
arXiv:2507.12591 · cs.CV · submitted Jul 16, 2025
abstract · pdf · html · ICCV 2025

add comment on HN