About the Role
We are seeking an experienced Machine Learning Operations Engineer to join our team and help drive our Reinforcement Learning from Human Feedback (RLHF) efforts. The successful candidate will report directly to the Research Director and will be responsible for developing and iterating large-scale data collection proposals, coordinating with business development personnel, managing the implementation of RLHF projects, and documenting data quality standards.
Responsibilities:
Develop and iterate large-scale data collection proposals to support RLHF projects.
Coordinate with business development personnel to draft proposals for partnerships and collaborations.
Manage the implementation of RLHF projects, including data collection, model training, and evaluation.
Monitor and optimize the performance of RLHF models.
Collaborate with researchers, engineers, and other stakeholders to ensure project success.
Document all kinds of data received and data quality standards.
Stay current with developments in the field of machine learning operations and apply best practices to our RLHF efforts. Familiar with recent literature in RLHF and RLAIF.
Qualifications:
Bachelor's or Master's degree in Computer Science, Mathematics, Statistics, or a related field.
5+ years of experience in machine learning operations.
1+ year of experience in RLHF, or relevant experience.
Experience managing large-scale data collection efforts.
Excellent communication skills and ability to collaborate effectively with researchers, engineers, and other stakeholders.