Breaking boundaries in radiology: redefining AI diagnostics via raw data ahead of reconstruction

Objective. In the realm of utilizing artificial intelligence (AI) for medical image analysis, the paradigm of ‘signal-image-knowledge’ has remained unchanged. However, the process of ‘signal to image’ inevitably introduces information distortion, ultimately leading to irrecoverable biases in the ‘image to knowledge’ process. Our goal is to skip reconstruction and build a diagnostic model directly from the raw data (signal). Approach. This study focuses on computed tomography (CT) and its raw data (sinogram) as the research subjects. We simulate the real-world process of ‘human-signal-image’ using the workflow ‘CT-simulated data- reconstructed CT,’ and we develop a novel AI predictive model directly targeting raw data (RCTM). This model comprises orientation, spatial, and global analysis modules, embodying the fusion of local to global information extraction from raw data. We selected 1994 patients with retrospective cases of solid lung nodules and modeled different types of data. Main results. We employed predefined radiomic features to assess the diagnostic feature differences caused by reconstruction. The results indicated that approximately 14% of the features had Spearman correlation coefficients below 0.8. These findings suggest that despite the increasing maturity of CT reconstruction algorithms, they still introduce perturbations to diagnostic features. Moreover, our proposed RCTM achieved an area under the curve (AUC) of 0.863 in the diagnosis task, showcasing a comprehensive superiority over models constructed from secondary reconstructed CTs (0.840, 0.822, and 0.825). Additionally, the performance of RCTM closely resembled that of models constructed from original CT scans (0.868, 0.878, and 0.866). Significance. The diagnostic and therapeutic approach directly based on CT raw data can enhance the precision of AI models and the concept of ‘signal-to-image’ can be extended to other types of imaging. AI diagnostic models tailored to raw data offer the potential to disrupt the traditional paradigm of ‘signal-image-knowledge’, opening up new avenues for more accurate medical diagnostics.