All news

1 articles

Min score

paperIEEE Xplore·1 Nov 20263.1
DWI: Efficient On-Device LLM Decoding Through Dynamic Width Selection on Nested Models
DWI speeds up on-device LLM decoding by picking the width of a nested model per step.
llm-inference on-device-ai model-efficiency