It can depend on what kind of paint has been used, but I've always found cream Ajax cleanser to work a treat

Crayons, pencils, 'the outline of wear my dogs lean' , scuff marks from shoes and just plain old grubby marks.