LLM 推理算法工程师

工作内容：
    •   研发稳定高效的 LLM 推理系统，支持低延迟和高吞吐
    •   设计和优化分离式推理框架，实现低延迟、高吞吐
    •   开发和优化分布式 KV 缓存（KV Cache）框架
    •   进行 CUDA 内核优化，提高计算效率和 GPU 资源利用率

岗位要求：
    •   熟悉大语言模型（如 LLaMA、Qwen）推理流程
    •   了解主流模型推理加速技术（模型量化、算子融合、P/D 分离、Prefix Caching、Speculative Decoding、KV Cache 压缩与调度）
    •   掌握 vLLM、TensorRT-LLM 等主流推理加速框架，能分析并优化其加速技术
    •   熟悉 Hugging Face Transformers 及常见深度学习库
    •   具备 GPU 高性能计算优化能力，熟悉 CUDA 并行计算、访存优化、低比特计算
    •   深入理解计算机体系结构，具有基于 CUDA 的 GPU 性能优化经验
    •   熟悉深度学习算法、神经网络架构及算子计算

加分项：
    •   了解至少一种深度学习训练框架（如 PyTorch、TensorFlow）及其模型文件解析方式
    •   具备软硬件联合设计经验
    •   有 P/D 分离系统、分布式 KV Cache 系统优化经验
    •   熟悉底层性能优化（Cutlass、NCCL 等）

Ways of Working
Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.

Benefits
As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn for more information.

About Us
Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars.
We’re problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Here, you’ll work across teams to deliver impactful projects that are changing the way people communicate and enjoy opportunities to advance your career in a diverse, inclusive environment.

Our Commitment​
We believe that the unique contributions of all Zoomies is the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. Zoom is proud to be an equal opportunity workplace and is an affirmative action employer. All your information will be kept confidential according to EEO guidelines.

We welcome people of different backgrounds, experiences, abilities and perspectives including qualified applicants with arrest and conviction records and any qualified applicants requiring reasonable accommodations in accordance with the law.

If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.