Single Device
As can be seen from the diagram, all domains are deployed on the same device. This implies that all cognitive load is handled by the devices resources, GPU, VRAM, CPU etc.
In a single device deployment the throughput of the solution will be dictated entirely by the device resources.