blogHugging Face Blog·21 Oct 20264.3
Part 1 of a guide to system-level profiling of PyTorch inference on AWS Trainium.
paperIEEE Xplore·1 Nov 20264.0
DIAMM splits multimodal model inference across edge devices to cut latency.
newsInfoQ·26 Oct 20263.7
Google open-sourced ML Drift under Apache 2.0, a cross-platform GPU compute engine for on-device inference over OpenGL ES, OpenCL, Metal and WebGPU.
paperIEEE Xplore·1 Nov 20263.6
ESR-HGNN removes redundant semantic computation to speed up mini-batch heterogeneous GNN inference.