@augustine18 Unless your pediatrician told you to use special water, you should be fine with whatever you guys are drinking.
Also common misunderstanding, usually you're not heating water to make the water safe, but heating formula to kill bacteria in the formula. This is especially important...