All news

SARIA keeps agent KV caches across turns with coordinated DRAM and SSD reload to cut prefill latency.

EpiSEM-Bench tests whether tool-using agents notice missing safety evidence before acting.

AgentPhishing benchmarks LLM email agents under adaptive phishing.

Separates task decomposition from typed-state QA to explain gains in multi-agent LLM pipelines.

Tests which LLM inference optimizations designed for NVIDIA GPUs actually help on Apple Silicon.

Re-selects KV cache visual tokens during long multimodal generation based on drift, under a budget.

Characterizes how LLMs keep repeating instructions while ceasing to obey them in long dialogues.

Spherical lattice vector quantization-aware training for low-bit LLMs.

Conservative meta-agent search adapts agent architectures under non-stationary workloads.

Routes coding agent skills at runtime between macro and micro granularity with recovery.

SCOPE compiles natural-language policies into neurosymbolic predicate programs to enforce LLM agent rules.

Quantizes n-gram embedding tables in open LLMs to low bits.

BeNice shares KV cache across loop iterations in looped transformers to close the inference memory gap.

Compresses per-layer embeddings with cross-layer latent vector quantization.

Evidence position bias differs across attention and other sequence mixers in long-context QA.

Twin-world counterfactual credit assignment for agentic RL.

Recasts sequence compression as test-time regression for efficient models.

Fixes two numerical bugs in standard softmax and cross-entropy, including Softmax Collapse.

DoorDash uses a multi-agent LLM system to clean up stale feature flags at scale.

Shows routing to the most predictable model is suboptimal for LLM routing.

Shows offline tests cannot always verify agent updates stay safe after deployment.

RIFT compresses draft-model KV cache for speculative decoding with complementary training.

AfterDeleteBench shows deleted data persists in LLM agent memories and derived summaries.

Learns robot behavior priors from non-robot synthetic data.

Motion-guided VLM picks frames for efficient video anomaly detection instead of dense per-frame inference.

Optimizes pass@k directly to prune reasoning candidates while keeping diversity at test time.

ProductWebBench grades frontend coding agents on whether the existing site keeps working.

Rewording questions changes tool-augmented model rankings.

Automates model discovery and virtual crash tests to estimate microservice availability.

Benchmark for agents writing video-centered deep research reports.