The main issue is if you freeze your yeast solid. Ice crystals form in the cells and cause them to burst, thus killing the yeast. The initial freeze is not always a death sentence, however multiple freeze and thaw cycles is extremely deadly. If there was still some liquid in the vial, brew on.