Inference Jobs

Why this is a real AI job: The role is explicitly focused on the research and development of LLM inference systems and optimization, spanning the entire inference stack. The job description details numerous tasks directly related to AI/ML model performance, system design, and AI-driven…

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collabor…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on the research and development of LLM inference systems, optimization techniques, and AI-native engineering. The entire job description revolves around core AI/ML concepts and their practical application.

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collabor…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and optimizing infrastructure for large-scale LLM inference, a core AI task. The description heavily emphasizes AI/ML technologies and their application.

About Anyscale At Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of li…

Details Open source / apply

Why this is a real AI job: The role is entirely focused on the development and optimization of LLM inference frameworks, distributed systems, and related technologies. The responsibilities and requirements clearly indicate a core AI/ML engineering position.

About the Role At Together.ai, we are building state-of-the-art infrastructure to enable efficient and scalable inference for large language models (LLMs). Our mission is to optimize inference frameworks, algorithms, and infrastructure, pushing the boundaries of performance, scalability, and cost-e…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and scaling a machine learning platform, specifically for inference and LLM workloads. The responsibilities and requirements heavily emphasize ML systems, frameworks, and serving infrastructure. The company is active…

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collabor…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and optimizing AI/ML systems, specifically around inference and reinforcement learning for large language models. The responsibilities and requirements heavily emphasize core AI/ML skills and concepts.

About the Role The Turbo team sits at the intersection of efficient inference (algorithms, architectures, engines) and post‑training / RL systems. We build and operate the systems behind Together’s API, including high‑performance inference and RL/post‑training engines that can run at production sca…

Details Open source / apply

Why this is a real AI job: The role is fundamentally focused on building and improving a platform for serving AI models, optimizing costs, and integrating with various LLMs. The description explicitly mentions core AI concepts like model routing, inference APIs, fine-tuning workflows,…

ABOUT US: Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequo…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and maintaining the infrastructure for a generative AI platform, specifically LLMs. The responsibilities directly involve ML systems, model serving, and performance optimization of AI models.

About Us: Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequo…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on developing, fine-tuning, and operationalizing machine learning models, with a strong emphasis on generative AI and LLM inference. The responsibilities are heavily centered around AI/ML engineering tasks.

About Us: Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequo…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on developing and implementing machine learning models and algorithms for core Lyft products. Responsibilities heavily emphasize data science tasks like model building, experimentation, and analysis. The required qualifications als…

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Data Science is central to Lyft's products and decision-making. As a Data Scientist on the cross-functional team, you will work in…

Details Open source / apply