Professional CUDA C Programming

The explosion of the parallel computing on heterogeneous machines has significant challenges: 1) how to best manage all available resources to ensure the most efficient use of the peak performance provided by hardware; and 2) how the enormous potential of these systems can be effectively utilized by a wide spectrum of professionals, scientists and engineers who are not necessarily parallel programming experts. CUDA is a parallel computing platform and programming model that is designed to ease the development of GPU programming with a minimum learning effort for programmers familiar with standard programming languages such as C.  Professional CUDA Programming in C is geared specifically towards this audience - it is an entry-level programming book for professionals from different industries, with minimum requirements of knowledge and experiences for computer sciences, parallel computing, and C programming. The book turns complex subjects into easy-to-comprehend concepts and easy-to-follows steps. It not only teaches readers the fundamentals of parallel programming with GPUs, but also helps readers think in parallel. The book covers major CUDA features with the main focus on GPU programming skills and best practices that delivers outstanding performance, such as: CUDA Programming model GPU Execution Model GPU Memory Architecture Stream, Event and Asynchronization Multiple GPU Programing Performance Tuning Each chapter is organized around one central topic with a concise explanation, followed by workable examples to demonstrate the development process beginning with parallel computational thinking and ending with effective parallel programs.  Each chapter contains two parts: the main section and exercise section. In the main section, readers can learn the basic feature of the topic; while in the exercise section, readers have a chance to probe the limitation of hard and soft aspects of each topic, so as to let readers gain much insight on that topic from many different and practical perspectives.