Piggy banks are a staple item in all newborn nurseries. Give one of these banks for a baby shower with some change (or bills) and get them off to a good start.
Coink piggy bank available at Sparkability.
Tirelire soft rubber piggy bank available thru ModernTots.com.
Silver plated piggy bank by Elegant Baby for a more classic look.