Full Stack Engineer, LLM Apis
Location: Hybird, san francisco bay area, CA

Job Description:

Abridge was founded to power deeper understanding in healthcare through AI. Our purpose-built platform transforms patient-clinician conversations into structured clinical notes, improving clinical documentation efficiencies and enabling clinicians to focus on their patients.

Our enterprise-grade technology is powered by Linked Evidence and our auditable AI. We map AI-generated summaries to ground truth, helping providers quickly trust and verify the output. As pioneers in generative AI for healthcare, we set industry standards for responsible AI deployment.

We are a growing team of professionals working together to empower people and make care more understandable.

The Role

We seek Staff and Senior Full Stack Engineers to build internal UI products supporting LLM Model orchestration, evaluation, and dataset curation. You'll work closely with Applied AI and product teams to build innovative ML-powered solutions advancing Healthcare AI technology.

Key Responsibilities

  • Design, build, and maintain scalable cloud-based services using TypeScript, Python, and React.
  • Create tooling for the ML model lifecycle, including model evaluations, dataset curation, and training infrastructure.
  • Build scalable infrastructure for LLM model orchestration with an intuitive user experience.
  • Make architecture and technology decisions aligning with business needs, balancing innovation with security and reliability.
  • Enhance platform performance and scalability, focusing on seamless user experiences.
  • Work cross-functionally with product, machine learning, and design teams to ensure new feature success from conception to deployment.
  • Research and evaluate commercial and open-source tools to implement effective and scalable solutions.
  • Advocate best coding practices, mentor junior engineers, and promote technical excellence.
  • Build empathy for users, maintaining a user-centric mindset when implementing solutions.
  • Contribute to ML infrastructure development, ensuring smooth interaction between the product and ML models.

Requirements

  • 5+ years building and scaling distributed systems with modern technologies like TypeScript, Python, React, and Node.js.
  • Hands-on experience integrating and working with Large Models (LLMs) and APIs, with familiarity in fine-tuning and prompt engineering.
  • Proficiency in working with cloud services (AWS, GCP), infrastructure as code (Terraform), and containerization (Docker, Kubernetes).
  • Proven experience leading engineering teams or owning major software components from development to production.
  • A background in optimizing and scaling inference systems for LLMs or similar AI-based systems is highly desirable.
  • Experience working in regulated environments (HIPAA, SOC 2, or HITRUST) is a plus.
  • A passion for learning new technologies and sharing knowledge within your team.

Estimated Salary Range: $185,000 - $265,000 USD per year + Equity

This role may include participating in a company stock option plan as part of the total compensation package.

Must be willing to work from our SF office at least 3x per week (Relocation assistance available for candidates willing to move to San Francisco).

This position requires a commitment to a hybrid work model, with the expectation of coming into the office a minimum of 3 times per week.

Must be willing to travel up to 10%.

Abridge hosts regular team retreats featuring internal hackathons, collaborative project sessions, and social events that allow the team to connect in person.

About Abridge

  • Be part of a trailblazing, mission-driven organization powering deeper understanding in healthcare through AI.
  • Opportunity to work and grow with talented individuals and have ownership and impact at a high-growth startup.
  • Flexible/Unlimited PTO — Salaried team members can take off as much approved time off as they need, plus 13 paid holidays.
  • Equity — For all salaried team members.
  • Medical insurance — We pay 100% of the premium for you + 75% for dependents. 3 Aetna plans to choose from.
  • Dental & Vision insurance — We pay 100% of the premium for you + 75% for dependents. 2 Aetna plans to choose from.
  • Flexible Spending (FSA) & Health Savings (HSA) Accounts.
  • Learning and Development budget — $3,000 per year for coaching, courses, workshops, conferences, etc.
  • 401k Plan — Contribute pre-tax dollars toward retirement savings.
  • Paid Parental Leave — 16 weeks paid parental leave, for all full-time employees.
  • Flexible working hours — We care more about what you accomplish than what specific hours you're working.
  • Home Office Budget — We provide up to $1,600 in a one-time reimbursement to set up your home office.

Key Skills:

  • TypeScript, Python, and React. (LLMs) and APIs, with familiarity in fine-tuning and prompt engineering. Proficiency in working with cloud services (AWS, GCP), infrastructure as code (Terraform), and containerization (Docker, Kubernetes).
    .NET, Python