cuBLAS Library - NVIDIA Developer

← Back to document page

| March 2022cuBLAS LibraryUser GuidecuBLAS | 1Chapter cuBLAS Library is an implementation of BLAS (Basic Linear Algebra Subprograms) on topof the NVIDIA CUDA runtime. It allows the user to access the computational resources ofNVIDIA Graphics Processing Unit (GPU).The cuBLAS Library exposes three sets of API: The cuBLAS API, which is simply called cuBLAS API in this document (starting with ), The cuBLASXt API (starting with CUDA ), and The cuBLASLt API (starting with CUDA )To use the cuBLAS API, the application must allocate the required matrices and vectors in theGPU memory space, fill them with data, call the sequence of desired cuBLAS functions, andthen upload the results from the GPU memory space back to the host. The cuBLAS API alsoprovides helper functions for writing and retrieving data from the use the cuBLASXt API, the application may have the data on the Host or any of the devicesinvolved in the computation, and the Library will take care of dispatching the operation to, andtransferring the data to, one or multiple GPUs present in the system, depending on the cuBLASLt is a lightweight Library dedicated to GEneral Matrix-to-mat

should convert to using the new API if it requires sophisticated and optimal stream parallelism, or if it calls cuBLAS routines concurrently from multiple threads. For the rest of the document, the new cuBLAS Library API will simply be referred to as the cuBLAS Library API.

  Using, Library, Routines, Bucal, Cublas library