The memory cards are both proprietary and expensive, and you'll fill up one of the smaller 8 or 16 GB ones fast, so look for a good sale on the higher capacity models if you intend to have your Vita be primarily digital-based.
They released a newer model of the Vita that uses an LCD screen rather than OLED, but as far as I've heard it's fine. The older models come in Wi-Fi or 3G, but the 3G is only compatible with AT&T's data plans and not really worth any extra you might think to pay for it, but it doesn't affect the system in any significant way if you get one in a bundle or something.
I actually like the system quite a bit, their recent push for indie games as well as the fact that a lot of the more niche Japanese stuff ends up on Vita rather than PS3/4 makes me happy I own one.
Last week on XBLA: - Tour De France 2009: The Official Game (800 points) Gold Member Deal of the Week (Monday; 400 points) - Star Wars: The Force Unleashed: Jedi Temple Mission Pack Retail (Tuesday) - G-Force - Rock Band: