Ray on Rudy Pei (裴彦儒) https://peabrane.github.io/tags/ray/ Recent content in Ray on Rudy Pei (裴彦儒) Rudy Pei (裴彦儒) https://peabrane.github.io/profile_pic.jpg https://peabrane.github.io/profile_pic.jpg Hugo -- 0.163.3 en Tue, 25 Aug 2026 00:00:00 +0000 KV- and Token-Aware Routing in Ray Serve LLM https://peabrane.github.io/post/anyscale-routing/ Tue, 25 Aug 2026 00:00:00 +0000 https://peabrane.github.io/post/anyscale-routing/ <p>I coauthored an <a href="https://www.anyscale.com/blog/llm-kv-token-aware-routing">Anyscale technical deep dive</a> on integrating NVIDIA Dynamo&rsquo;s KV-aware selection machinery into Ray Serve LLM. The collaboration is a useful example of a systems component becoming more valuable when it can be embedded outside the system where it started.</p>