SF · NYC
The Role
We are looking for a research engineer to advance how open-weight models learn to reason, use tools, and carry out complex work in healthcare. You would own research and engineering across post-training: identifying important research questions, developing methods, running experiments, and translating findings into agents that perform better in production.
You will have substantial autonomy to shape the research agenda and carry projects from an initial hypothesis through implementation, evaluation, and release. We expect you to engage deeply with emerging research, challenge existing approaches, and develop original contributions that can advance the field. The work combines scientific judgment with hands-on ownership of data, training, and evaluation.
Responsibilities
Define and drive research directions in post-training for long-horizon reasoning, tool use, memory, and recovery from failures.
Develop and evaluate training methods across supervised fine-tuning, preference optimization, and reinforcement learning. Investigate new approaches where existing methods fall short.
Own the post-training pipeline end to end: data selection and mixing, training stages, evaluation, and release.
Turn production trajectories and human feedback into training signal, including preferences, corrections, reward models, and verifiers that capture successful actions and outcomes.
Design rigorous experiments with strong baselines and clean ablations. Establish which methods, data mixtures, and base models deliver meaningful gains per unit of compute.
Stay at the forefront of relevant research. Reproduce promising results, examine their limitations, and extend them to the demands of agents operating in real environments.
Work with Evals and Environments, Data Foundry, and Infrastructure to establish reliable evaluations, improve training data, and keep runs reproducible and regressions traceable.
Produce original, publishable research and communicate findings through papers, technical reports, and open-source contributions where appropriate.
Minimum qualifications
Hands-on experience post-training open-weight models with SFT, preference optimization, or RL methods, with measurable improvements you personally drove.
Strong foundations in machine learning, optimization, and the design and evaluation of learning systems.
Strong Python and PyTorch skills, with the ability to implement research ideas, debug training behavior, and work effectively in a large training codebase.
Demonstrated ability to conduct research independently: identify a meaningful problem, formulate hypotheses, design experiments, and carry the work through to defensible conclusions.
Experimental discipline: appropriate baselines, clean ablations, reproducible results, and honest reporting of limitations and negative findings.
Ability to read research papers critically, reproduce their methods, and determine whether the findings hold in a new setting.
Willingness to own data as well as method, and to connect research results to the behavior of deployed systems.
Preferred qualifications
PhD in computer science, machine learning, artificial intelligence, or a closely related field.
Strong publication record at leading research venues such as NeurIPS, ICML, ICLR, ACL, or EMNLP, with substantial intellectual and experimental contributions.
Original research in reinforcement learning, post-training, reasoning, reward modeling, or learning for tool-using agents.
Experience with distributed training, large-scale experimentation, or improving training efficiency.
Experience training and evaluating agents on long-horizon tasks with sparse or delayed feedback.
Experience working with sensitive or regulated data.
Logistics
Location: San Francisco or New York, on-site.
Employment type: full-time.
Compensation: competitive salary and meaningful equity.
Visa sponsorship is available.
RoVR is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.
Apply for this Job