How To Cover an Outlet With Drywall. When you relocate an electrical outlet, you're usually left with an empty electrical box nailed to a wall stud. It isn't easy to remove the box without cutting a hole around it, but if all you want to do is cover it, removal shouldn't be necessary. As long as there are ...