Weak links between fast mobility and local structure in molecular and atomic liquids