I was going through the different types of release strategy and was confused between the Canary and A/B strategy. Both of them seems to be similar. Everywhere I read on Canary is "Allows to test ...

I had made new menu for my app and I have made A/B testing to optimize my revenue. I have set ad_impression as a goal. I see in A/B testing console that new menu is worse for ad_impression:  I h...

I'm trying to get an A/B test with Remote Config up and running and I'm having some trouble with the iOS part. After setting the experiment up as described in the documentation it doesn't seem to w...

I am trying to create an experiment using Firebase remote config. The criteria is as follows: It should target only new users who have not used the app ( opening the app for the first time) Now o...

According to the docs you should be able to AB Test app icons now on iOS. However, I can't figure out how to do it. Here, it says you need to include an asset catalog that supports uploading altern...

Do you know formul for calculating ab testing sample size per variation base on: Baseline Conversion Rate Minimum Detectable Effect Statistical Significance Statistical Power It is a few onlin...

For example, in an AB test the A population could have 1000 data points, of which 100 are successes. While B could have 2000 data points and 220 successes. This gives A a success proportion of 0.1 ...

Lately, I have read a blog post titled Bandits Know the Best Product Price" (http://pkghosh.wordpress.com/2013/08/25/bandits-know-the-best-product-price/), which outlines how to use multi-armed ban...

We just now started doing the A/B testing for our Django based project. Can I get some information on best practices or useful insights about this A/B testing. Ideally each new testing page...

I wanted to perform two A/B tests on an app using Firebase A/B Testing with Remote Config. The problem is that the two tests audiences should be mutually exclusive. Forming part of both experiment...

I'm running an A/B test on a web page. Users aren't authenticated on the webpage, so there's no user ID to track them. On the webpage, there are links to Android/iOS app stores where users can down...

When creating Firebase AB experiment our custom events don't show up on the Activation event list nor on the Goal metric event list. Both of those events are properly showing on the Analytics Event...

I am using firebase to do some A/B testing on my app. Currently, I am trying to validate if the experiment is setup correctly. I am facing the following issues: I have 3 variants A,B and C. I can...

I am looking to split up my user base to 10 group and show 10 different UI and see how they feel about it. so each user group will have single type of UI always. i.e Let's say I have 10k users an...

I have a df containing two sets of values (value_1 and value_2) relative to two experiments. One experiment contains two groups (0 and 1), the other contains three groups (0,1,2). test group Val...

I have created and started an A/B Test on Firebase Remote Config 2 days ago on my iOS app with this code: [FIRApp configure]; [FIRRemoteConfig.remoteConfig fetchWithCompletionHandler:^(FIRRemoteCo...

I've provisioned the following AWS resources to host a static website (via Cloudformation): S3 bucket to store the website Cloudfront distribution for CDN (for reduced latency) Route 53 A record ...

Is it possible and allowed to have A/B-testing for in-app-purchase for iOS and Android? I heard it's not allowed for iOS but didn't find an official document. What about Android?

I need to add A/B testing functionality to a large application built with Angular 2 and bundled with Webpack. Tools like VWO are not flexible enough for us. Any online guides or tips? T...

What is the best and cleanest way to implement A-B testing in asp.net mvc? That is, when we make new changes to an asp.net mvc web site, we want to test the new html/css/js with a certain subset of...

I'm looking for an easy way to integrate split testing into my Rails 3 application. I've researched and found two alternatives that seem to be up to date for Rails 3... Vanity: http://vanity.labno...

I do A/B Testing on our site and I do most of my work is in a JS file that is loaded at the top of the page before anything else is rendered but after jQuery has loaded which comes in handy at time...

I've tried using Google Mobile Analytics for a phonegap application. I know that Google Analytics supports Context Experiments, but I couldn't find anything about Google Mobile Analytics doing the ...

There are two main schools of thought for doing A/B (Split) Testing: Javascript-based solutions such as Optimizely, Google Analytics Content Experiments. Server-side solutions such as Django-AB, ...

Leanplum, Apptimize and other A/B testing platforms for iOS have the ability to download assets (nib files ,images, etc...) from the web and replace them at runtime. The naive approach will be to ...