Lawyer

About This Role

This role involves training large language models (LLMs) to reason like legal professionals by building high-quality evaluation and training datasets, focusing on complex hypothetical cases and U.S. law. You will evaluate model outputs, apply legal rubrics, and provide feedback to improve AI systems' legal reasoning capabilities.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law
• Identify gaps, edge cases, and reasoning blind spots to help define new benchmarks for legal understanding in AI
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities

Requirements

• Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission
• 3+ years of experience practicing law or teaching at a U.S.-based law school
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work
• Excellent written communication skills for delivering clear, high-quality feedback
• High ethical standards and the ability to handle sensitive legal information with confidentiality

Qualifications

• Juris Doctor (J.D.) from an accredited U.S. law school
• 3+ years of experience practicing law or teaching at a U.S.-based law school

Nice to Have

• Interest in AI and language models (LLMs)

Skills

* Required skills