More to explore:
chalkboard labels - great party idea!
Chalkboard Labels for Wedding Drinks They make different shaped chalk board labels. You could add a lid and straw if you want.
DIY chalkboard labels for mason jars - just use chalkboard paint
chalkboard mason jar drinks (serve as take home favors too)