FlashInfer-Bench: Building the Virtuous Cycle for AI-driven LLM Systems
A benchmark and infrastructure that opens the pathway for AI to accelerate real-world AI deployment.
Latest Posts
Sorting-Free GPU Kernels for LLM Sampling
Some cool LLM sampling algorithms and their implementations on GPUs.