Profiling Training Study
Profiling-driven training optimisation on CPU and a rented NVIDIA L4: one rung is +298% and the eight after it are noise, the GPU stays data-starved through every kernel tweak, and negative results stay in the table.
Description excerpted from the original listing, which is linked below.