Remote Software Engineer

About This Role

This role involves acting as a Software Engineering evaluator, primarily focusing on creating and refining advanced datasets for training and benchmarking large language models. The individual will work with various programming languages to curate and correct code examples, ensuring efficiency, scalability, and reliability of AI-generated solutions.

Responsibilities

• Curate code examples, build solutions, and correct code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go for AI model training initiatives
• Evaluate and refine AI-generated code to ensure efficiency, scalability, and reliability
• Collaborate with cross-functional teams to enhance AI-driven coding solutions against industry performance benchmarks
• Build agents capable of verifying code quality and identifying error patterns
• Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities
• Design verification mechanisms to automatically confirm solutions to software engineering tasks

Requirements

• 5+ years of software engineering experience
• 2+ years of continuous full-time experience at a top-tier product company (e.g., Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, IBM Research)
• Strong expertise in building full-stack applications
• Expertise in deploying scalable, production-grade software using modern languages and tools
• Deep understanding of software architecture, design, development, debugging, and code quality/review assessment
• Excellent oral and written communication skills

Qualifications

• Several years of software engineering experience (+5 years), including 2+ years of continuous full-time experience at a top-tier product company

Skills

* Required skills