Lawyer

About This Role

Advance the frontier of AI by training large language models to think like skilled legal professionals, focusing on building high-quality evaluation and training datasets. Evaluate how models handle complex hypothetical cases and refine their ability to apply U.S. law with precision and nuance.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law
• Identify gaps, edge cases, and reasoning blind spots, helping define new benchmarks for legal understanding in AI
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities

Requirements

• J.D. from an accredited U.S. law school, with active or inactive Bar admission
• 3+ years of experience practicing law or teaching at a U.S.-based law school
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work
• Excellent written communication skills for delivering clear, high-quality feedback
• High ethical standards and the ability to handle sensitive legal information with confidentiality

Qualifications

• Juris Doctor (J.D.) from an accredited U.S. law school
• 3+ years of experience practicing law or teaching at a U.S.-based law school

Nice to Have

• Interest in AI and language models (LLMs)

Skills

* Required skills