It depends if your soreness feels like post-exercise stiffness or injury. If it is post-soreness then definitely keep moving. I would start to get back into it. Doing a smaller form of exercise the day after a big one seems to really help me. For example the day after a big soccer game, if I feel sore I will go for a jog and I seem to pull up a lot better than if I don't. If you are actually injured though go for an alternative that gives that area a break (e.g. cycling or swimming).