We can't possibly see light from a millisecond after the Big Bang because the universe was opaque for the first few hundred thousand years. We do see the glow of the "cosmic microwave background" from light that existed at the time the universe became transparent.