Collisional evolution of asteroids constrained by their present rotational properties