Inference Governor QoS

Inference QoS for edge robotics. A freshness- and deadline-aware governor in front of NVIDIA Triton: drops superseded camera frames before they cost GPU time, protects time-critical perception from long background jobs, and picks the model variant that still fits. 22x fewer missed control cycles…

Description excerpted from the original listing, which is linked below.