If you're worried about toxins, memory foam is the most toxic mattress you can get. I would never cosleep on one.

We have a latex mattress and it's heaven. It's a big piece of natural latex wrapped in a wool layer for fire retardant (check to find out if they use a chemical fire retardant). So comfy! It doesn't heat up or have dips or anything unsafe. It's a very smooth sleep surface.