Job Description

Job Overview

We are seeking a highly skilled AI Engineer to join our team at Unreal Gigs. As a key member of our research and development team, you will be responsible for advancing deep learning research and developing general human-like machine intelligence.

About the Role

The successful candidate will work closely with our research team members to design, develop, and implement cutting-edge projects related to large language models (LLMs). This includes researching and implementing various research papers to improve architecture efficiency, training speed, loss metrics, and fine-tuning methods.

Key responsibilities include:

• Researching and implementing various research papers to improve architecture efficiency, training speed, loss metrics, and fine-tuning methods.
• Designing and conducting scientifically rigorous experiments to validate the effectiveness of proposed adjustments for solving Imbue's target problems using LLMs.
• Enhancing our knowledge of LLM fundamentals, focusing on areas such as chain-of-thought, reasoning, generalization, hallucination, and grokking.
• Utilizing our existing framework to perform hyperparameter sweeps, and contributing to the development of new features for the sweep code.
• Collaborating with infrastructure engineers to develop monitoring systems, informative logging, and maintenance guides for long-running experiments.
• Working with data and product engineers to identify and implement improvements in our training and evaluation datasets.
• Conducting scientific research and development to create LLM models that perform effectively in practical applications.

Requirements

To be successful in this role, you will need:

• Strong expertise in Python programming.
• Proficiency in PyTorch and training deep neural networks.
• Experience in open source code development.
• Able to conduct experiments and test research-based improvements.
• Understanding of LLM knowledge and inference.
• Working experience with infrastructure for monitoring and logging.

What We Offer

In return for your expertise, we offer a competitive salary range of $175,000 - $325,000 annually, comprehensive health insurance, retirement plans with company matching, paid time off, including vacation, sick leave, and holidays, professional development opportunities, flexible work arrangements, paid parental leave, wellness programs, employee assistance program, stock options, commuter benefits, technology stipend, and company events, including team-building activities, social events, and company retreats. We strive to foster an inclusive and diverse workplace culture.