There have been a lot of good responses on here, so I guess I’ll just fill in a couple of things that I think might help more generally.
1) – I second the suggestion about Nikon and Canon, as they are probably your best bet, though I wouldn’t rule out Olympus completely, either. Unlike clothing, there are certain items where the branding really does just make big difference. :)
2) – For a starter camera, megapixels really don’t matter, once you’re past that threshold of around 6 or 7 MP. Much more important are things like light sensitivity, and image quality at various ISO settings (which as I’m sure you noticed, dpreview often demonstrates in pictures).
3) – While you may someday decide to upgrade to a better camera body, the lenses will always be good, hence the recommendations above about focusing on good lenses.
..3b) – As per what lenses to actually get, it depends a little bit on money. While standard lenses tend to have better focus, zoom lenses are a lot more versatile. I would recommend getting what is often called a “framing” lens as your first, which is a zoom lens that ranges from around 28 or 32mm to around 70 or 80mm. This will help a lot in terms of framing your shot, and focusing on the artistic element that XCNuse just mentioned. If you wanted to get a second lens, I would go for something like a 70 or 80mm up to somewhere around 300mm, just to give yourself some range, and after that maybe a fixed wide-angle, like a 15mm or 17mm, just cause those can be a lot of fun.
4) – batteries – the post above gives a decent, if technical, response about batteries.. but the one thing that I would add is that certain cameras have the option of adding a AA battery pack to the bottom of the camera to replace the Lithium Ion battery that might come standard with the camera. Whether or not you do this is kinda up to you, depending on what you like and what’s comfortable.. it’s nice to have the extra space to grip the camera body, and it can be convenient to be able to purchase simple AA batteries if you’re in a jam, since they’re by far the most common batteries that you’ll find anywhere.
—lastly, Amazon is fine, but there are plenty of other decent online retailers out there, most notably B&H Photography, which has (you may well know) been around a lot longer than Amazon. :)
Also don’t worry too much about all the technicalities, and from a former professional turned pleasure photographer, the two most important things to pay attention to, in my book, are good lighting and the rule of thirds. And to have fun doing it!