Choose at least two colors for your home's exterior when the siding is brick or stone. Select three colors when the siding will also be painted as the main color. Pick a complementary color for the trim and an accent color for doors, shutters, and decorative trim. Need more help? Try hiring a professional colorist to design a color scheme unique to your home.