Careers

Help us build genuinely compassionate AI

Senior Research Scientist, Post-training and Safety

Full-time Remote · California overlap $200,000 to $300,000

Summary

CaML is hiring a Senior Research Scientist to run our training work: synthetic document mid-training, RL post-training on top of it, and the evals that tell us whether the values we put in are still there afterwards. We want someone who has run LLM training experiments before, follows alignment research closely, and will tell us when we’re wrong.

What CaML does

CaML is a small California-based AI safety nonprofit. We study how values get into models during training and whether they survive the training that comes after: how to instill a specific set of values through mid-training data and RL, how to measure whether it worked, and how to keep it from being trained back out.

So far we’ve built the TAC benchmark (NeurIPS 2026 AI4Good workshop), the Manager Coercion Bench, HarvestBench in UK AISI’s Inspect evals, and the leaderboard at compassionbench.com. Our current open question is whether values instilled in mid-training survive later RL, and when they don’t.

What you’ll do

  • RL post-training on open-weight models, mostly around the 12B scale. RLHF, RLAIF, DPO and its variants, GRPO, RLVR.
  • Mid-training and continued pretraining data: synthetic document generation at scale, matched control conditions, mixing ratios, and measuring what the data did to the model.
  • Evals that catch the difference between a model that says the right thing and a model whose reasoning holds up under adversarial prompting and distribution shift.
  • Studying how values degrade through training: reward hacking, sycophancy, specification gaming, and whether an instilled value generalises.
  • Writing up research for arXiv and LessWrong.

You’d own the training side of the research agenda in a small team with no management layers.

How we work

We want to be told when we’re wrong, by the people who work here. That includes being wrong about things the EA and alignment communities mostly agree on. A lot of that agreement rests on a few influential but untested posts, and we’d rather find out than assume.

In practice this means reporting the negative result, saying “I don’t know” when that’s the truth, flagging when one of our own evals is broken even if it hurts a paper we’ve already published, and disagreeing with well-known people on the merits.

Requirements

We check these against the application before reading anything else.

  • You’ve done your own research that involved training LLMs: RL or preference optimisation, fine-tuning, or mid-training on synthetic data, with results written up as a paper, a post or a program project like MATS or ASTRA.
  • You can read a recent post-training paper and say specifically what you think is wrong with it or what you’d try next.
  • You follow alignment research. You read LessWrong, and nothing in this ad needed explaining. Ideally you’ve posted there, or you argue about this work on Twitter and people in the field reply.
  • You can write clearly about technical work in English.

Things that help but aren’t required:

  • A LessWrong post, a paper, or a Twitter thread you’ve published that people in the field read and responded to.
  • Someone we know in alignment research who can vouch for you.
  • MATS with any mentor, ASTRA or FIG.

If this role doesn’t seem quite right, you can also apply to be an engineer!

Applying

The initial application form takes about 15 minutes. It asks three short questions, and we read the answers before the CV.

  1. Your training experience. LLM training you’ve done in your own research, including at MATS, ASTRA or a similar program, and what you found. Two or three sentences.
  2. A result you’d build on. A post-training or alignment result from the last twelve months that changed what you’d work on, and what you’d do next with it. Two or three sentences.
  3. Something you wrote. A link to a LessWrong post or a paper on alignment or training that you think represents some of your best work.

Then link your CV, and add your LessWrong username, Twitter handle and Google Scholar link if you have them. None of those is required on its own, but an application with none of them will struggle against the requirements above.

If you’re a good fit, we’ll aim to reach out within three weeks. The rest of the hiring process consists of:

  • An initial cultural interview and technical screening (~30 minutes)
  • Technical interview (~45 minutes)
  • Paid test task (~3 hours)
  • Offer

We aim to send offers in early December for a late December or January start.

Pay and terms

  • $200,000 to $300,000 depending on experience
  • Full-time
  • Fully remote (overlap with California working hours for calls), with travel to the San Francisco Bay Area if needed
  • Open to applicants in any country; no visa sponsorship needed

Apply now →

ML Research Engineer

Full-time Remote · California overlap $120,000 to $150,000

Summary

CaML is hiring a Research Engineer to run our training experiments: synthetic document midtraining, RL post-training on top of it, and the evals that measure the compassion personas we care about. Our research scientists decide what to test, and you make it run well, reproducibly and without needing many questions answered. We want someone who has finetuned open-weight LLMs, can implement and debug an RL pipeline, and will tell us when a run or an eval is broken.

What CaML does

CaML is a small California-based AI safety nonprofit. We study how values get into models during training and whether they survive the training that comes after: how to instill a specific set of values through mid-training data and RL, how to measure whether it worked, and how to keep it from being trained back out.

So far we’ve built the TAC benchmark (NeurIPS 2026 AI4Good workshop), the Manager Coercion Bench, HarvestBench in UK AISI’s Inspect evals, and the leaderboard at compassionbench.com. Our current open question is whether values instilled in mid-training survive later RL, and when they don’t.

What you’ll do

  • Run training experiments end to end as set by a research scientist. If they say “post-train this model on this data”, you’ll choose the hyperparameters, build or adapt the pipeline, and split the work into well-scoped tasks. Our researchers can describe a set of experiments and you run them well without needing to ask many questions.
  • Midtraining runs on synthetic document corpora, and RL post-training on top of them (for example RLVR with GRPO on verifiable tasks), on open-weight models mostly around the 12B scale.
  • Build synthetic corpus generation pipelines, including well-matched control conditions, at the scale and quality the experiments need.
  • Run evaluations, mostly on UK AISI’s Inspect, and interpretability methods under a researcher’s guidance.
  • Direct AI coding agents such as Claude Code and Codex for much of the implementation, and check their code quickly but carefully enough to catch bugs.
  • Keep configurations reproducible, checkpoint runs, log thoroughly and track experiments cleanly, so that every result can be traced and rerun.
  • Debug training instabilities and infrastructure failures.

You’d work day to day with our research scientists in a small team with no management layers.

How we work

We want to be told when we’re wrong, by the people who work here. That includes being wrong about things the EA and alignment communities mostly agree on. A lot of that agreement rests on a few influential but untested posts, and we’d rather find out than assume.

In practice this means reporting the negative result, saying “I don’t know” when that’s the truth, flagging when one of our own evals is broken even if it hurts a paper we’ve already published, and disagreeing with well-known people on the merits.

Requirements

We check these against the application before reading anything else.

  • You’ve trained or finetuned (7B+) LLMs as part of research: a paper or preprint, a research programme (MATS, ASTRA, SPAR or similar), an academic lab, or an industry ML team, where the results were evaluated and written up.
  • You’re comfortable with Unsloth, RunPod and the Hugging Face ecosystem.
  • You can implement, run and debug an RLVR or GRPO pipeline, and you understand the algorithms well enough to notice when a run is quietly broken.
  • You’re familiar with literature on RL post-training, synthetic document midtraining and self-fulfilling (mis)alignment.
  • Reproducibility, versioning and thorough logging are things you do by default, not on request.
  • You can work independently in a small remote team and write clearly about what you ran, what you found and what went wrong.

If your experience with LLM training is mainly tutorials or personal projects that weren’t evaluated, this role probably isn’t the right fit yet.

Things that help but aren’t required:

  • Ideas about values training and how midtraining data persists through later training.
  • Experience with Inspect, OLMo models, or open post-training frameworks such as TRL or verifiers.
  • Basic interpretability skills.
  • Public technical work: papers, preprints, open-source contributions or posts.
  • Familiarity with EA and discussions on LessWrong and the Alignment Forum.

This role suits someone who wants to take an experiment plan and execute it well. If you’d rather set the research direction yourself, see our Senior Research Scientist role.

Applying

The initial application form takes about 15 minutes. The bulk of it is three short questions, which we look at before your CV.

  1. Your training experience. The largest or most involved training run you’ve done yourself: model size, method (fine-tuning, RL, GRPO etc.), the tools you used, and how you evaluated whether it worked. Two or three sentences.
  2. A hard debugging problem. The hardest bug or technical problem you’ve solved in ML work, ideally from a different project than your answer above. What was going on, and how did you track it down? Two or three sentences.
  3. Something you built. A research output you contributed to (paper, preprint, write-up or research codebase), and which part was yours.

If you’re a good fit, we’ll aim to reach out within three weeks. The rest of the hiring process consists of:

  • An initial cultural interview and technical screening (~30 minutes)
  • Technical interview (~45 minutes)
  • Paid test task (~3 hours)
  • Offer

We aim to send offers in early December for a late December or January start.

Pay and terms

  • $120,000 to $150,000 depending on experience
  • Full-time
  • Fully remote (overlap with California working hours for calls), with travel to the San Francisco Bay Area if needed
  • Open to applicants in any country; no visa sponsorship needed

Apply now →