Senior Experimentation Analyst Senior Experimentation Analyst

We are looking for a Senior Experimentation Analyst passionate about experimentation to join our team. You will help us drive the experimentation culture across all products at the BBC. You are confident with statistical analysis, already use data to identify problems most worth solving for product teams, are capable of designing, deploying and analysing product experiments.

You will join a diverse group of highly skilled data analysts, experimentation specialists and product teams that are passionate about driving innovation through scaling experimentation.

You will champion experimental design and methodologies to the rest of the BBC, advance the underlying theory and methods we use, work within the platform to create tools to speed up analysis, as well as find new ways of applying experimentation in a machine learning setting.

Above all, you will play a pivotal role in driving the experimentation culture throughout the company.

Responsibilities

Work closely with product and analytics teams to identify and solve problems through experimentation.

Build, validate and help prioritise the roadmap of tests with data & insights.

Apply experimental design principles to all briefs.

Calculate and communicate baseline conversion rates, sample sizes, MDE, confidence levels and statistical power to product teams

Monitor and validate data quality in running experiments.

Create and communicate experimental findings to product teams and to wider BBC teams

Work with the platforms team to improve the capability of the experimentation platform

Gather, cultivate and research experimentation best practices

Research new methods for experimentation

Create our internal experimentation teaching material

Help the BBC develop procedures for iterating fast while managing risks in a big data environment

An undergraduate or MSc degree in Statistics, Computer science or another quantitative field

You have significant practical expertise in experimentation design and analysis methodologies

Solid foundation in causal inference methodology and how to identify causal effects.

Proficient in advanced analytics: statistical hypothesis testing and statistical modelling

Comfortable working with large datasets and well versed in tools such as SQL, Python, R

You have experience with proactively building relationships across organizational boundaries and with multiple stakeholders

You are a strong communicator and can explain sophisticated topics in simple terms.

Salary £48,000 - £60,000

Our comprehensive benefits package includes:

• An employer pension contribution of up to 10%


• 26 days' annual leave (based on full time hours) + bank holidays and the option to buy/sell additional days


• Contributory lifestyle benefit options including discounts at hundreds of retailers, cycle to work scheme, discounted gym memberships and healthcare schemes


• Employee assistance and well-being programmes


• Learning and development tailored to your role - this could include industry recognised qualifications, coaching and mentoring


• An inclusive and diverse environment with opportunities to join staff networks including: Women's Network, National Disability Networks and many more.


Family friendly flexible working arrangements, such as hybrid working, job sharing, flexi-time and compressed hours can be requested.

We welcome candidates from all backgrounds and especially welcome individuals from underrepresented groups.