Zero (and various phrases: zero slope, zero vector, zero degree angle etc), z-intercept, zeta
Teachers are zealous. It begins with the letter z.
No word in the U.S. constitution begins with the letter z.
jazz, jeez
zlow
zipper, because you can use it for Christmas