Okay I've definitely been in this boat too - no one has blamed it on the breastfeeding yet, but I'm sure that's coming. DD is 7 mos. old and I've started to hear things like "oh, you'll get tired of bf soon," or, "I just picked up this bottle for her because you won't be bf forever." I'm not sure it's mean spirited, but just my mom and mil didn't make it past 4-6 mos. with each child so they just think it's natural to stop right about now.
I am young (okay, not super young), so I don't have many friends my age with kids, but one of my good friends has been a nanny for many years. She keeps telling me that kids who are AP'd are a pain in the behind to watch and are spoiled. I just smile and ignore it - she just may change her mind when the kids are her own.