I worry about it too. My DH is soooo into peanut butter and says he doesn't know how he'd cope if our baby was allergic. His cousin ate peanut butter on her toast every morning for breakfast when pg and her daughter is highly allergic, but her father has an intolerance too.
Short answer is, I don't know. I have eaten it during this pg, but I try not to have it too often. I'm comfortable with having it once every couple of weeks. But that's just me.