My LO is four months old now and doing the very same thing. Pulling off and talking, smiling or looking around. ANY distraction at all and she's wanting to investigate. I'm trying to nurse her in a quiet place (works some of the time) and basically just offering to feed her as much as possible right now . . . sometimes she'll stay latched and fall asleep which is working out better because at least she's nursing while she's resting and I know she's getting milk then.