CUDA Zone is a central location for all things CUDA, including documentation, code samples, libraries optimized in CUDA, et cetera. Go to:
And follow the link to "Developing with CUDA"
The "CUDA Programming Guide" is the right document to read for getting started with CUDA.