Yip I do it all the time. Sometimes because it is just too hot to be standing at the line and sometimes because I forget I had a load in the machine.
I have never lost anything off the line yet (touch wood) so I will carry on while it works for me.
Do whatever is going to make your life easier babe.