Jesus paid a high price to give us a garment of salvation and a robe of righteousness.  Keep them on!  These were meant to be always be worn.