Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA
NVIDIA Technical Blog1 min read
NVIDIA has introduced cuDLA, a Python API that enables direct inference execution on the Deep Learning Accelerator (DLA) hardware within the Jetson AGX Orin platform. This allows AI workloads to offload inference tasks from the GPU, improving power efficiency and enabling concurrent execution of multiple neural networks under tight resource constraints.
AI summary