GPU: architecture and programming (NYU Course)

http://cs.nyu.edu/courses/spring12/CSCI-GA.3033-012/index.html

Contains some interesting links for GPU tools from webpage above
Multi2Sim Simulation Framework
http://www.multi2sim.org/

GPUocelot
http://code.google.com/p/gpuocelot/
Dynamic Compilation for PTX

Short CUDA tutorial of Colorado School of Mines
http://geco.mines.edu/tesla/cuda_tutorial_mio/index.html