On colored Turaev-Viro invariants for links in arbitrary 3-manifolds