All Stories

  1. CacheBlend: Fast Large Language Model Serving for RAG with Cached Knowledge Fusion

    Article • March 2025, ACM (Association for Computing Machinery)

    Hanchen Li

  2. Eloquent: A More Robust Transmission Scheme for LLM Token Streaming

    Article • August 2024, ACM (Association for Computing Machinery)

    Hanchen Li

  3. CacheGen: KV Cache Compression and Streaming for Fast Large Language Model Serving

    Article • August 2024, ACM (Association for Computing Machinery)

    Ganesh Ananthanarayanan, Hanchen Li

  4. Optimizing Real-Time Video Experience with Data Scalable Codec

    Article • September 2023, ACM (Association for Computing Machinery)

    Hanchen Li