Does your LO vomit after you eat dairy? That happened to my friend whose baby had a dairy sensitivity ... at the time she told me that babies who have this sensitivity can grow out of it around ~6 mo, but I don't have personal experience with it so I don't know this for sure (although this did in fact happen with her LO). According to The Womanly Art of Breastfeeding, babies can grow out of food sensitivities and some allergies by ~1 year old. Dairy can also be a major culprit among food sensitivities.
It does seem interesting that dairy is seeming to affect YOU now and that the almond milk didn't do the same ... I wonder if all the hormone shifts can affect these things. When I was in my third trimester I couldn't have tomato-based sauce because it irritated my stomach; after I had the LO it went away.

Sorry not to be able to help more. I hope others can add to the discussion!