One Lie Group to Define Them All