Cosmology and astrophysics of minimal dark matter