When the core is configured to use GMII or RGMII interface on UltraScale or UltraScale+ devices,you need to set the REFCLK_FREQUENCY attribute of all the IDELAY and ODELAY primitives used by the core to the frequency of the clock driving the ref_clk port. This can be done through XDC constraints. For more information, refer to the example design in Vivado.