Manager, Prompt Engineering
Location: On-Site, San Francisco Bay Area, CA

Job Description:

Are you ready to push the boundaries of AI and innovation? At Scale AI, we're accelerating the development of Artificial Intelligence, working alongside some of the world’s leading companies like OpenAI, Lyft, Meta, and many others to advance LLM applications, improve datasets, and drive model reliability. As we continue to lead the AI revolution, we are looking for a Manager of Prompt Engineering to join our team and shape the future of AI applications.

Role Overview:As a Prompt Engineering Manager, you will lead a dynamic team of experimental engineers focused on leveraging AI in groundbreaking ways. From skunkworks projects to enhancing AI-driven operations, you’ll apply your creativity and mastery of cutting-edge models to solve complex challenges. This role offers the unique opportunity to collaborate with top talent, lead innovation, and drive experimentation that will shape the future of AI.

What You Will Do:

  • Lead and inspire a high-performing team of prompt engineers, fostering a culture of innovation and experimentation.
  • Develop state-of-the-art LLM applications that address real-world challenges and enhance data quality.
  • Proactively identify vulnerabilities in LLMs and improve their robustness and performance.
  • Document AI model behaviors, focusing on vulnerability and adversarial testing, to create more reliable models.
  • Collaborate cross-functionally with various teams to bring projects from concept to deployment.
  • Mentor and elevate the skills of team members in prompt engineering and LLM applications.
  • Analyze experimental results and effectively communicate findings to stakeholders across the organization.

What You’ll Bring:

  • 5+ years of engineering experience with hands-on expertise in AI models.
  • Proficiency in Python, TypeScript, or JavaScript.
  • Experience in building LLM-based applications or using LLMs creatively, including personal or hobby projects.
  • Strong leadership and mentoring skills with the ability to inspire and guide a team.
  • Excellent communication and collaboration abilities, ensuring seamless integration across teams.
  • A creative mindset with a passion for experimentation and pushing the envelope on AI development.

Nice to Haves:

  • Experience with AI/LLM development or red teaming.
  • Familiarity with LLM evaluation metrics and statistical analysis.
  • Academic background related to language models or adversarial robustness.
  • Willingness to collaborate in person with teams in San Francisco or NYC at least once a month.

Why Scale AI?At Scale, we are at the forefront of the AI revolution, transforming industries through cutting-edge models in generative AI, computer vision, and LLMs. We work with top-tier organizations like OpenAI, Meta, and Microsoft to push the boundaries of what’s possible in AI. We are a growing team with ambitious goals and are committed to building an inclusive and diverse workplace where everyone can thrive.

Perks and Benefits:

  • Competitive salary and benefits.
  • Be part of a fast-growing, innovative team.
  • Access to cutting-edge AI technology and projects.
  • Collaborative work environment with opportunities for growth.

Scale AI is an Equal Opportunity Employer committed to creating a diverse and inclusive workforce. We strongly encourage applications from all qualified individuals, regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, age, or veteran status.

To learn more and apply, visit: Scale AI Careers


Key Skills:

  • Manager, Prompt Engineering