Applied ML Engineer
Location: Remote Work

Job Description:

Remote | Anywhere in the U.S.

Your AI Journey Starts Here

At Broadcom, we’re revolutionizing cloud technology for businesses worldwide. Through the VMware Cloud Foundation (VCF), we deliver agility, security, and performance that power the largest enterprises, governments, and institutions globally.

Now, we're taking innovation to the next level by integrating Generative AI and LLM capabilities into our technology stack—and that’s where you come in. As an Applied ML Engineer, you’ll collaborate with a bold team of researchers, engineers, and technologists to build cutting-edge systems that simplify infrastructure deployment and redefine IT operations.


Why Join Us?

  • Impact: Work on transformative AI technologies that enable intelligent automation for global businesses.
  • Innovation: Design and optimize advanced LLM pipelines that reshape the IT landscape.
  • Growth: Thrive in a team that values expertise, creativity, and continuous learning.
  • Reward: Earn competitive pay, equity, and benefits while contributing to game-changing solutions.

Your Role: Build the Backbone of AI Innovation

In this role, you’ll engineer platforms and pipelines that bring LLM-powered solutions to life. From designing and fine-tuning AI models to optimizing real-time inference systems, your work will directly impact how businesses operate in the modern cloud era.

What You’ll Do:

  • Develop and Optimize LLM Pipelines:
    • Manage data ingestion, preparation, and prompt engineering to fine-tune models.
    • Streamline deployment and monitoring processes to ensure efficiency, scalability, and compliance.
  • Lead Model Maintenance:
    • Oversee performance monitoring, retraining, and governance processes to maintain quality and reliability.
    • Incorporate human-in-the-loop systems to refine LLM outputs.
  • Innovate with Agentic Systems:
    • Leverage tools like AutoGen and CrewAI to design autonomous AI applications that think and act intelligently.
  • Collaborate Across Teams:
    • Work with AI researchers, DevOps engineers, and IT professionals to deliver world-class solutions.
    • Communicate results and insights effectively to stakeholders at all levels.

What You Bring to the Table

Required Qualifications:

  • Bachelor’s in Computer Science, Data Science, or related field with 12+ years in full-stack software development (including 2+ years in GenAI/LLM applications), OR a Master’s with 10+ years of experience.
  • Proficiency in Python and frameworks like PyTorch or TensorFlow.
  • Experience with LLM post-training, including instruction tuning and preference alignment.
  • Hands-on expertise in MLOps platforms (e.g., MLflow, Weights & Biases).
  • Knowledge of vector databases and similarity search techniques.

Preferred Qualifications:

  • 3–5 years in machine learning operations, with a focus on LLMs.
  • Familiarity with tools like LangChain, LlamaIndex, or frameworks for LLM application development.
  • Experience with model serving systems (vLLM, Triton, llama.cpp) and real-time inference optimization.
  • Understanding of human-in-the-loop feedback for model evaluation.

Your Skills & Attributes:

  • Exceptional problem-solving abilities and analytical thinking.
  • Strong communication and collaboration skills to work effectively across teams.
  • Passion for staying at the forefront of AI advancements and industry trends.

Why You’ll Love Working Here

Compensation & Benefits:

  • Salary: $127,000–$225,000 annually, plus a discretionary annual bonus and equity.
  • Comprehensive Benefits: Medical, dental, vision, 401(k) with matching, ESPP, paid holidays, and generous leave policies (including Paid Family Leave).
  • Wellness & Work-Life Balance: Paid sick leave, flexible PTO, and robust employee wellness programs.

Culture of Innovation:

Join a team of technologists who thrive on creativity and problem-solving. At Broadcom, we embrace diversity, equity, and inclusion to build a culture where every perspective counts.


Ready to Build the Future?

Your next chapter begins here. If you’re ready to push the boundaries of AI, optimize LLM applications, and make a lasting impact, we’d love to hear from you.


Key Skills:

  • Applied ML Engineer