Tech Lead, Agentic AI Platform

ServiceNow Mountain View, CA
Full Time Mid Level 7+ years

Posted 3 weeks ago

Interested in this position?

Upload your resume and we'll match you with this and other relevant opportunities.

Upload Your Resume

About This Role

This role involves scaling and optimizing a cutting-edge Generative AI product, focusing on building an extensive product infrastructure, designing scalable API abstractions, and enhancing the conversation engine. The ideal candidate will apply abstraction, scalability, and optimization to a dynamic, probabilistic, and generative conversational system.

Responsibilities

  • Construct an extensive product infrastructure with user-friendly interfaces to customize and optimize generative AI models
  • Design scalable API abstractions for the conversation platform supporting various chat clients
  • Optimize the dialog engine to accommodate conversational features, leveraging private domain knowledge and enabling real-time multilingual translation
  • Champion best practices for coding patterns, API design, scalability, robustness, and optimization
  • Provide comprehensive insights into conversational AI product performance through robust logging, tracing, debugging tools, and automated metrics
  • Collaborate with ML engineers, application engineers, product teams, and customer support to drive new features and scalability initiatives

Requirements

  • Strong foundation in computer science and software engineering
  • Expertise in building scalable systems
  • Deep understanding of clean, modular, and scalable API design
  • Ability to champion best coding practices and influence engineers on code quality
  • Passion for optimizing systems and improving performance
  • Well-versed in tracing, logging, and metrics frameworks
  • Systematic approach to identify and resolve latency bottlenecks, race conditions, and throughput limitations
  • Ability to independently research new requirements and develop innovative solutions
  • Thrive in an environment of fast-paced coding and execution, embracing rapid iterations
  • Strong communication skills to articulate rationales and design approaches
  • Cross-functional awareness for seamless collaboration with various teams

Qualifications

  • A bachelor's degree or higher in computer science or a related field
  • 7+ years of professional development experience, specifically in building systems at scale

Skills

Generative AI * LLMs * Optimization * API design * Scaling * Tracing frameworks * Logging frameworks * Metrics frameworks *

* Required skills

About ServiceNow

Global market leader bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500, with an intelligent cloud-based platform connecting people, systems, and processes.

Technology
View all jobs at ServiceNow →