I bought a chest carrier, and for the first couple months before he got so huge, I would just wear a low cut shirt, or one with a stretchy neckline. That way when he was hungry I could just drape a scarf or light blanket over the both of us, pull out my breast and keep on doing whatever it was I was doing. Now I have to lower his carrier too much for it to be comfortable for me to nurse him like that but it was wonderful while it lasted. I actually managed to nurse him several times in close quarters with friends who had no idea I was doing it. Although he did tend to dribble on my shirt but lesser of two evils for sure.
I think so long as your breast is covered as well as you can manage it is not anyone else's business. It's one of those things you have to be firm in and proud of, otherwise they will ruin this special time for you.