Lawyer

About This Role

This role will shape how AI systems learn to reason like attorneys by evaluating and refining large language models' ability to apply U.S. law with precision and nuance. You will work on ambitious projects to build high-quality evaluation and training datasets for frontier AI.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law
• Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities

Requirements

• Juris Doctor (J.D.) from an accredited U.S. law school
• Active or inactive Bar admission
• 3+ years of experience practicing law or teaching at a U.S.-based law school
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work
• Excellent written communication skills for delivering clear, high-quality feedback
• High ethical standards and the ability to handle sensitive legal information with confidentiality

Qualifications

• Juris Doctor (J.D.) from an accredited U.S. law school
• 3+ years of experience practicing law or teaching at a U.S.-based law school

Nice to Have

• Interest in AI and language models (LLMs)

Skills

* Required skills