cuBLAS is Nvidia's standard go-to library for accelerating their GEMM code. In this repository I have included my attempts of writing kernels (without using TENSOR_WMMA) to try and meet the cuBLAS performance on my own gpu. The method I have followed is considering naive GEMM implementation as a baseline and then using NSight Compute to find the benchmark metrics.
GFLOPs = 2 * (Matrix-Size)^3 / (1e6 * time_ms)
(and the same for TFLOPs but using 1e9)


