Background and purpose Subjective memory impairment (SMI) and amnestic mild cognitive impairment (aMCI) are thought to represent the pre-dementia stages of Alzheimer's disease (AD). SMI is considered a more advanced pre-clinical status prior to aMCI. Understanding the neuromechanism of SMI will have great benefits for monitoring the disease progression of AD. The study aims to explore whether SMI shows alterations of white matter (WM) integrity similar to the patterns of aMCI. Methods The atlas-based analyses were performed to investigate the diffusion changes in the major WM tracts amongst 22 individuals with normal cognition (NC), 22 SMI patients and 25 aMCI patients. The correlations between the altered diffusion metrics and cognitive performance in the SMI and aMCI groups were assessed. Results The diffusion tensor metrics of SMI were intermediate between the NC and aMCI groups. The aMCI group presented disrupted integrity in multiple WM tracts, including the left anterior thalamic radiation, right corticospinal tract and left cingulum of the hippocampus (CgH), compared to the NC group. The left CgH showed diffusion alterations in the SMI group. In the aMCI group, the mean diffusivity of the left CgH was negatively correlated with episodic memory, whilst the radial diffusivity of the right corticospinal tract was negatively correlated with executive function. No significant relationship was found in the SMI group. Conclusion The study suggested that SMI patients might present detectable WM integrity changes in the left CgH before exhibiting objective cognitive dysfunction, which may provide novel insights into the pathological mechanisms of AD.