The memory cards are both proprietary and expensive, and you'll fill up one of the smaller 8 or 16 GB ones fast, so look for a good sale on the higher capacity models if you intend to have your Vita be primarily digital-based.
They released a newer model of the Vita that uses an LCD screen rather than OLED, but as far as I've heard it's fine. The older models come in Wi-Fi or 3G, but the 3G is only compatible with AT&T's data plans and not really worth any extra you might think to pay for it, but it doesn't affect the system in any significant way if you get one in a bundle or something.
I actually like the system quite a bit, their recent push for indie games as well as the fact that a lot of the more niche Japanese stuff ends up on Vita rather than PS3/4 makes me happy I own one.
USA Mana Khemia: Student Alliance Samurai Shodown Anthology EUROPE Monster Jam: Urban Assault JAPAN Ever17: The Out of Infinity Never7: The End of Infinity Resistance: Retribution Shinseiki Genso: SSII Unlimited Side (Idea Factory Collection)