Inference Jobs

Why this is a real AI job: The role is explicitly focused on building and scaling a machine learning platform, specifically for inference and LLM workloads. The responsibilities and requirements heavily emphasize ML systems, frameworks, and serving infrastructure. The company is active…

At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don’t just use tools; you possess an innate curiosity, treating AI as a high-trust collabor…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and optimizing infrastructure for large-scale LLM inference, a core AI task. The description heavily emphasizes AI/ML technologies and their application.

About Anyscale At Anyscale https://www.anyscale.com/, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray https://docs.ray.io/en/latest/, a popular open-source project that's creating an ecosystem of li…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and maintaining the infrastructure for a generative AI platform, specifically LLMs. The responsibilities directly involve ML systems, model serving, and performance optimization of AI models.

About Us: Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequo…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on developing, fine-tuning, and operationalizing machine learning models, with a strong emphasis on generative AI and LLM inference. The responsibilities are heavily centered around AI/ML engineering tasks.

About Us: Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequo…

Details Open source / apply

Why this is a real AI job: The role is explicitly focused on building and optimizing AI/ML systems, specifically around inference and reinforcement learning for large language models. The responsibilities and requirements heavily emphasize core AI/ML skills and concepts.

About the Role The Turbo team sits at the intersection of efficient inference (algorithms, architectures, engines) and post‑training / RL systems. We build and operate the systems behind Together’s API, including high‑performance inference and RL/post‑training engines that can run at production sca…

Details Open source / apply

Why this is a real AI job: The role is entirely focused on the development and optimization of LLM inference frameworks, distributed systems, and related technologies. The responsibilities and requirements clearly indicate a core AI/ML engineering position.

About the Role At Together.ai, we are building state-of-the-art infrastructure to enable efficient and scalable inference for large language models (LLMs). Our mission is to optimize inference frameworks, algorithms, and infrastructure, pushing the boundaries of performance, scalability, and cost-e…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on developing and implementing machine learning models and algorithms for core Lyft products. Responsibilities heavily emphasize data science tasks like model building, experimentation, and analysis. The required qualifications als…

At Lyft, our purpose is to serve and connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Data Science is central to Lyft's products and decision-making. As a Data Scientist on the cross-functional team, you will work in…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on deploying and scaling AI products, working with customers on AI solutions, and contributing to open-source AI codebases. The job description heavily emphasizes AI/ML technologies and their application in production environments.

About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, produ…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on deploying and integrating Mistral AI's products (LLMs) with customers, involving end-to-end execution of AI solutions. The job description heavily emphasizes working directly with AI models, infrastructure for AI, and solving co…

About Mistral At Mistral AI, we believe in the power of AI to simplify tasks, save time, and enhance learning and creativity. Our technology is designed to integrate seamlessly into daily working life. We democratize AI through high-performance, optimized, open-source and cutting-edge models, produ…

Details Open source / apply

Why this is a real AI job: The role explicitly focuses on developing systems for LLM inference and fine-tuning, requiring deep expertise in ML and related technologies. The company is a research-driven AI company.

About the Role Together AI is looking for an ML Engineer who will develop systems and APIs that enable our customers to perform inference and fine tune LLMs. Relevant experience includes implementing runtime systems that perform inference at scale using AI/ML models from simple models up to the lar…

Details Open source / apply