Symmetry enhanced non-reciprocal polarization rotation in a terahertz metal-graphene metasurface