Testing & Optimization Manager
RichRelevance - San Francisco, CA

This job posting is no longer available on RichRelevance. Find similar jobs:Testing Optimization Manager jobs - RichRelevance jobs

RichRelevance powers personalized shopping experiences for the world’s largest and most innovative retail brands, including Walmart, Sears, Target and others. Founded and led by the e-commerce expert who helped pioneer personalization at Amazon.com, RichRelevance helps retailers increase sales and customer engagement by recommending the most relevant products to consumers regardless of the channel they are shopping.RichRelevance has delivered more than $5.5 billion in attributable sales for its retail clients to date, and is accelerating these results with the introduction of a new form of digital advertising called Shopping Media which allows manufacturers to engage shoppers where it matters most -- in the digital aisles on the largest retail sites in world. RichRelevance is headquartered in San Francisco, with offices in New York, Seattle, Boston, and London, and has been twice recognized as one of the “Best Places to Work” in the Bay Area.

As a member of RichRelevance’s Customer Success group you will be part of a dedicated team focused on high profile & high impact A/B & multivariate (MVT) site testing & optimization. Our primary focus is to provide coherent decision support, project & ROI validation and valuable insight into what drives transactions and profit.

As the subject matter expert on testing & optimization, work directly with product/business owners and technical specialists throughout the organization to plan and execute A/B & MVT tests

Manage the intake process for test requests and ideas

Experiment design - Design insightful tests (test length, KPIs, control groups etc.) that adhere to testing best practice

Lead client discussions on test methods, set up, and interpretation of results.

Work with clients on a consultative basis

Prioritize tests and manage a testing calendar to make best use of available traffic and testing resources and avoid any conflicts between tests

Turn tests on and off and have ultimate responsibility for which tests are running on the site

Ensure product/business owners interpret test results correctly and make informed decisions

Form a close relationship with product/business owners across RichRelevance and be their first point of call for anything to do with testing

Develop RichRelevance’s testing processes and policies to further increase the quality and rigorousness of testing

Provide input and direction for the future development of RichRelevance testing technologies

Evangelize testing throughout the business to drive adoption of testing ever more widely


Strong analytical mindset and skills, including the ability to break down complex scenarios into constituent parameters

Understanding of fundamental concepts in probability and statistics, such as confidence intervals, hypothesis testing, etc. Although not an applied-math position, these concepts are highly relevant to test design and results interpretation

Excellent verbal and written communication skills

Strong organizational skills and attention for detail

Experience with a A/B/MVT platform

2+ years online experience with a focus on web analytics and/or optimization and direct involvement with AB/MVT testing

Bachelor’s degree or higher

RichRelevance is an Equal Opportunity Employer and does not discriminate against any applicant on the basis of race, color, religion, national origin, gender, marital status, age, disability, sexual orientation, military/veteran status, or any other status protected by Federal or State law or local ordinance.

About this company
2 reviews