How to get oily stains out of clothes that have been washed and dried several times. . . Palmolive Dish Soap. Put a fair amount on, rubbing it around to cover the oily stain well and let it soak for ONE HOUR. Then just throw it in the washer and run a cicle.