Website Testing & Optimization Analyst II

About This Role

This role contributes to the Website A/B Testing & Optimization Program by running tests, generating actionable insights, and continually improving flagship websites. The role focuses on enhancing customer website experiences through analytics, testing, and teamwork.

Responsibilities

• Support the complete process of split testing and optimization
• Work closely with the T&O Program Manager and various teams to identify testing priorities, establish KPIs, and implement tracking
• Extract and transform analytics data from online platforms, ensuring data accuracy, segmentation, and attribution
• Perform statistical analysis of experiments, calculating lift, confidence, segmentation, and interaction effects
• Develop actionable insights and recommendations from test outcomes in business-relevant terms
• Track post-test impact and embed lessons into future experiments and optimization roadmap
• Stay current on digital testing & optimization industry standards and propose improvements to elevate the organization's testing maturity

Requirements

• Bachelor's degree in Statistics, Mathematics, Economics, Business Analytics, Digital Marketing Analytics, or related field
• 2+ years of experience in a digital analytics or experimentation role
• Strength in quantitative analysis and understanding of statistical concepts (hypothesis testing, confidence intervals, sample size)
• Strong skills in Excel
• Experience with analytics tools / data visualization (e.g., Power BI) and data query (SQL) or willingness to learn
• Proficiency in using web analytics tools like Google Analytics/GA4, Adobe Analytics, and split testing platforms such as Optimizely, VWO, Google Optimize
• Ability to clearly communicate analytic results and recommendations to non-technical audiences and influence cross-functional partners
• Strong attention to detail, interpersonal skills, and ability to run multiple test streams and priorities

Qualifications

• Bachelor's degree in Statistics, Mathematics, Economics, Business Analytics, Digital Marketing Analytics or related field (or similar experience)
• 2+ years of experience in a digital analytics or experimentation role (or similar)

Nice to Have

• Familiarity with causal inference and incrementality testing beyond A/B (e.g. holdout)
• Familiarity with scripting (R, Python) or automated data pipelines
• Understanding of digital conversion optimization
• Experience in eCommerce or B2B website environments
• Knowledge of data privacy/consent frameworks (GDPR, CCPA) and implications on digital analytics

Skills

* Required skills