Lawyer

About This Role

This role involves training large language models (LLMs) to think like skilled legal professionals. You will create high-quality evaluation and training datasets, applying U.S. law with precision and nuance to shape the future of AI in the legal industry.

Responsibilities

• Review and evaluate model outputs on complex U.S. legal hypotheticals across multiple domains of law
• Apply a structured legal rubric to assess accuracy, relevance, logical reasoning, and application of law
• Identify gaps, edge cases, and reasoning blind spots — helping define new benchmarks for legal understanding in AI
• Provide clear, consistent annotations and detailed feedback that directly improve model fine-tuning and legal reasoning capabilities

Requirements

• Juris Doctor (J.D.) from an accredited U.S. law school
• Active or inactive Bar admission
• 3+ years of experience practicing law or teaching at a U.S.-based law school
• Proven ability to apply U.S. legal reasoning to complex, nuanced cases
• Strong foundational knowledge across multiple areas of U.S. law, including contracts, torts, criminal law, constitutional law, corporate law, and civil procedure
• Exceptional attention to detail, precision, and consistency in evaluating and annotating legal work
• Excellent written communication skills for delivering clear, high-quality feedback
• High ethical standards and the ability to handle sensitive legal information with confidentiality

Qualifications

• Juris Doctor (J.D.) from an accredited U.S. law school
• 3+ years of experience practicing law or teaching at a U.S.-based law school

Nice to Have

• Interest in AI and language models (LLMs)

Skills

* Required skills