These job descriptions are examples. Looking for work?

Find JobsFind Jobs

Sr Optimization Program Analyst-- A/B testing expert

0 people like this description

The Sr. Optimization Analyst leads optimization projects for multiple work streams. This includes validating test hypotheses, defining test analysis of Key Performance Indicators (KPIs), and executing effective and actionable test analysis with statistics rigor and interpreting test findings. This role is an integral part of the Company’s Optimization team which manages and executes on all A/B Testing needs of the eCommerce Center of Excellence. These efforts are highly visible and engaged across various groups within the organization and shapes the methodologies and processes around testing and optimizing the site. Major responsibilities and duties: Partnering & Influencing (40%) • Act as an optimization lead for work streams including showing up as an expert in A/B testing and influencing decision making • Contribute to shaping optimization program best practices and driving continuous improvements to establish best in class program • Establish strong working partnerships with relevant areas of the business and global teams (Marketing, Merchandising, Product Management, Engineering, User Experience) • Collaborate with cross functional partners to develop clear and measurable business and testing objectives and define test KPIs (both financial and engagement metrics) • Act as a key liaison with stakeholders with respect to A/B test analysis framework Hypothesis assessment & Test results analysis (30%) • Hypothesis validations – Participate in hypothesis generation process and clearly validate opportunities/recommend actions that can have positive improvements in the firm’s site experience and financials; help stakeholder teams to think about site opportunities in a different way by asking questions; provide feedback to stakeholders to influence test ideas that will yield the most impactful customer experience improvements on the site. • Calculate traffic allocation – Understand traffic baselines for pages being tested, identify traffic required to achieve significance; effectively use page traffic for various concurrent tests • Define Test KPIs – Identify conversion and engagement KPIs needed for test analysis and understand test setup and data collection standards within test environment • Test analysis – Drive proper A/B or multi-variant testing analysis with statistical rigor and perform cohort studies to answer “why?” on test result drivers. Support more complex tests from an analytical and reporting perspective. • Leverage supporting tools –3rd party tools such as Adobe Analytics, Adobe Test & Target, Adobe Reportbuilder, Adobe Audience Manager, TeaLeaf; Microsoft Excel. Insights & Test results communication (30%) • Deliver insights – Objectively deliver testing insights and help create a culture of data-driven decision making. • Tell Story – At completion of Tests, build timely, compelling, fact-based test recaps that strongly communicate the business ‘story’ behind the data and lead Test outcomes. Be able to tie site KPIs and results to financial metrics. • Communicate results – Identify successes, failures, trends. Effectively present these findings to the organization in a succinct way. If test results are positive – analyze KPI improvements in pre/post A/B test roll-outs; if results are negative – perform driver analysis to recommend next steps which could include iteration of that test. • Summarize weekly test result findings and communicate actionable recommendations to stakeholders and executives. Requirements: • Bachelor’s degree in business administration, finance, mathematics, economics, or in a quantitative discipline required; Master’s degree preferred • Minimum 5 -8 years of A/B testing or site optimization, usability analysis, and/or web analytics experience supporting analysis or in a related data analytics field (financial analysis, digital analysis, statistical modeling) • Experience with web analytics, A/B testing or site optimization will be ideal • Solid understanding of online analytics metrics and related statistical concepts. Experience with web analytics tools (such as Adobe Analytics), A/B or Multi-variant testing tools (such as Adobe Target) • High-level proficiency Microsoft Excel is a must • Excellent analytical skills – ability to understand and interpret data within the context of the A/B testing – solve problems and distill data into actionable recommendations. • Excellent communication skills – this position requires confidence in directly working with stakeholder in the organization and will be tasked to communicate complex test results findings and recommendations persuasively, in a compelling and easy to understand manner • Demonstrated ability to work with cross-functional teams; independently and proactively • Intellectual and analytical curiosity – initiative to dig into the “why” of various results • Excellent project management skills including the ability to formulate and identify key performance indicators for tests and drive detailed test results. • Flexible and responsive, ability to prioritize multiple tasks, reprioritize as needed and work with a sense of urgency to meet deadlines in a fast-paced, dynamic work environment • Minimal travel required Impact on organization: Work relationships • Partners with suppliers, industry and professional SMEs, customers • Partners with all levels of Marketing, Medium and Large Customer, Digital, ES, Analytics, Finance, etc.

These job descriptions are examples. Looking for work?

Find JobsFind Jobs