It is safe.

From Kelly Mom and Hale (who is THE GUY on medical information and breastfeeding) : Teeth whiteners are carbamide peroxide, which is just a stabilized formulation of hydrogen...