Type 1 and type 2 diabetes mellitus have an impact on the microstructural environment and cognitive functions of the brain due to its microvascular/macrovascular complications. Conventional Magnetic Resonance Imaging (MRI) techniques can allow detection of brain volume reduction in people with diabetes. However, conventional MRI is insufficiently sensitive to quantify microstructural changes. Diffusion Tensor Imaging (DTI) has been used as a sensitive MRI-based technique for quantifying and assessing brain microstructural abnormalities in patients with diabetes. This systematic review aims to summarise the original research literature using DTI to quantify microstructural alterations in diabetes and the relation of such changes to cognitive status and metabolic profile. A total of thirty-eight published studies that demonstrate the impact of diabetes mellitus on brain microstructure using DTI are included, and these demonstrate that both type 1 diabetes mellitus and type 2 diabetes mellitus may affect cognitive abilities due to the alterations in brain microstructures.