Something that might help is leaving a sticky note on your desk. A number in the top corner so he knows which break it is and a "back at __:__" so he knows where you are and when you'll be back. It should answer his complaints. ;)
If he makes another comment, go to your boss and tell him that his comments are inappropriate. He has NO RIGHT whatsoever to comment on how you feed your child or how you exercise your rights.