Distributed AI Inference Best Practices & Gotchas

Originally posted on Medium. Authors: Fatih Nar, Yuchen Fama, Greg Pereira, Yuan Tang Reviewers: Taneem Ibrahim, Robert Shaw, Ron Haberman, Anish Asthana 1. Introduction In our Part-I article, ...

Posted by Yuan Tang on June 5, 2026

Production-Grade LLM Inference at Scale with KServe, llm-d, and vLLM

Authors: Yuan Tang: Project Lead, KServe; Senior Principal Software Engineer, Red Hat Scott Cabrinha: Staff Site Reliability Engineer, Tesla Robert Shaw: Director of Engineering, Red Hat S...

Posted by Yuan Tang on April 21, 2026

Best of Both Worlds: Cloud-Native AI Inference at Scale using KServe and llm-d

Authors: Yuan Tang: Project Lead, KServe; Senior Principal Software Engineer Ran Pollak: Manager, AI Catalyst at Red Hat Originally posted on KServe Blog. Also available on Red Hat Developer...

Posted by Yuan Tang on March 5, 2026

Kubernetes Serving Working Group Has Succeeded and Will Be Disbanded

Originally posted on Kubernetes dev mailing list and on CNCF Blog. We’d like to announce that Kubernetes WG Serving has succeeded and will be disbanded! Thank you everyone who have participated an...

Posted by Yuan Tang on February 13, 2026

Feeling Thankful Today and Reflecting on Two Incredible Years at Red Hat

Originally posted on my Substack. While my official two-year anniversary is just a few days away, Thanksgiving feels like the perfect time to express my gratitude for this journey. I still rememb...

Posted by Yuan Tang on November 28, 2025

KubeCon North America 2025: Red Hat AI Model Serving Highlights

Originally posted on InferenceOps Substack newsletter. Time: Nov 9th - 13th, 2025 Location: Atlanta, Georgia, USA Executive Summary Red Hat AI had a great presence at KubeCon. Highlights of ...

Posted by Yuan Tang on November 18, 2025

KServe Joins CNCF as an Incubating Project

Originally posted on Red Hat Blog. In addition, check out the complementary announcement blog from CNCF. We are excited to share that KServe, the leading standardized AI inference platform on Kube...

Posted by Yuan Tang on November 11, 2025

The Best Choice for AI Inference: vLLM

Originally posted on Medium and on Red Hat Blog. Authors: Fatih E. Nar, Greg Pereira, Yuan Tang, Robert Shaw, Anish Asthana As organizations move from Large language model (LLM) experimentation...

Posted by Yuan Tang on October 9, 2025

Eight Lessons on Open Source Leadership and Community

What contributing, mentoring, and stewarding have taught me about OSS

Originally posted on Substack. Over the past months, I’ve been sharing thoughts on open source, leadership, and community building on social media. This post provides a quick roundup of the themes...

Posted by Yuan Tang on September 20, 2025

PyTorch on Kubernetes: Kubeflow Trainer Joins PyTorch Ecosystem

Authors: Andrey Velichkevich, Apple; Yuki Iwai, CyberAgent, Inc.; Yuan Tang, Red Hat; Antonin Stefanutti, Red Hat; Johnu George, Nutanix Originally posted on PyTorch blog. We’re thrilled to ann...

Posted by Yuan Tang on July 28, 2025

Live deeply, live fully, and live with love.