Congrats, brah!
Having gone through this relatively recently, I can say that this is all very, VERY sound advice (Amy, where were you with that pyrex advice? Wish I'd known that before melting a couple bottles. *grins*)
Also: for newborn clothes, just get a handful of onesies and, depending on local climate, something to bundle in for going outside. They grow out of clothes so ridiculously fast, it's saddening and maddening at the same time. Down here there's a kind of thrift store that sells lightly-used baby clothes, toys and accoutrements at really cheap prices. Check around for stuff like that.
Something I wish we had in the area is family. Both of ours are out of state, so my wife's been trooping through it all by herself. If you get offers to sit for baby, hang on to them. Trust me; she's going to want a break later, no matter how good your child is or how devoted she is to it. It's not a reflection on her or the child, but too much of anything without a break wears on a person.
As has been said, get used to lack of sleep, but you might get lucky, too. Rhiannon is usually good about dropping off after a diaper change and a bottle, combined with some singing.
Also: Diaper genie = MAGIC.
