LLM Infrastructure, AI Engineer,
Location: Hybird, san francisco bay area, CA

Job Description:

Unlock Deeper Understanding in Healthcare with Abridge

Abridge is a pioneering organization that empowers healthcare professionals to make informed decisions through AI-powered clinical documentation. As a Staff or Senior Full Stack Engineer, you'll join our mission-driven team to build innovative solutions for Large Model (LLM) orchestration and evaluation.

We're seeking an experienced engineer to design and develop highly scalable cloud-based services using TypeScript, Python, and React. You'll work closely with our Applied AI and product teams to create cutting-edge ML powered solutions that push the boundaries of Healthcare AI technology.

  • Main Responsibilities:
  • Design, build, and maintain high-performance infrastructure for LLM model orchestration using cloud services like AWS and GCP.
  • Collaborate with cross-functional teams to integrate ML models with internal UI products and ensure seamless user experiences.
  • Research and evaluate commercial and open-source tools to implement efficient and scalable solutions.
  • Advocate for best coding practices, mentor junior engineers, and drive technical excellence across the team.
  • Contribute to the development and expansion of our ML infrastructure, ensuring smooth interaction between the product and ML models.

About the Role

This position requires 5+ years of experience building and scaling distributed systems using modern technologies like TypeScript, Python, React, and Node.js. Hands-on experience integrating and working with Large Models (LLMs) and APIs, familiarity in fine-tuning and prompt engineering are also essential.

The ideal candidate will have proficiency in working with cloud services, infrastructure as code, and containerization. Proven experience leading engineering teams or owning major software components from development to production is highly desirable.

A passion for learning new technologies and sharing knowledge within your team is a must. We offer a competitive salary range of $185,000 - $265,000 per year, plus equity and benefits, including flexible PTO, medical insurance, and professional development opportunities.


Key Skills:

  • TypeScript, Python, React, and Node.js. Hands-on experience integrating and working with Large Models (LLMs) and APIs, familiarity in fine-tuning and prompt engineering are also essential.
    Python