All news

1 articles

Min score

paperIEEE Xplore·1 Nov 20263.5
Breaking Memory Wall for Fast Edge LLM Inference Using Contextual Sparsity
Uses contextual sparsity to get around the memory bandwidth limit in edge LLM inference.
edge-computing llm-inference sparsity