Lawyer

About This Role

This role involves training large language models to reason like legal professionals by evaluating model outputs on complex U.S. legal hypotheticals. The position offers an opportunity to define new benchmarks for legal understanding in AI and influence the future of AI in the legal industry.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law
• Identify gaps, edge cases, and reasoning blind spots to help define new benchmarks for legal understanding in AI
• Provide clear, consistent annotations and detailed feedback to improve model fine-tuning and legal reasoning capabilities

Requirements

• Juris Doctor (J.D.) from an accredited U.S. law school, with active or inactive Bar admission
• 3+ years of experience practicing law or teaching at a U.S.-based law school
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases (hypothetical or real-world)
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work
• Excellent written communication skills for delivering clear, high-quality feedback
• High ethical standards and the ability to handle sensitive legal information with confidentiality

Qualifications

• Juris Doctor (J.D.) from an accredited U.S. law school
• 3+ years of experience practicing law or teaching at a U.S.-based law school

Nice to Have

• Interest in AI and language models (LLMs)