Hey everyone,
This is my first post in the Tubebuddy forum, be nice
I have a question about A/B split testing, as it seems to have a little bit of a flaw (maybe I'm wrong).
I have attached a few images showing some recent tests.
Tubebuddy states that for all of these tests the "Original will be better than the Variation".
Yes, based on CTR alone, that is true, but is this the only factor we should take into consideration?
If we look at the Impressions/Clicks column, we can see that for all of these tests, despite having a lower CTR, we actually have more impressions/clicks.
To me this would mean that the Variation is actually performing better.
Tubebuddy will automatically select the Original unless I override it.
Please let me know your opinions on this.
Thank you,
Michael
This is my first post in the Tubebuddy forum, be nice
I have a question about A/B split testing, as it seems to have a little bit of a flaw (maybe I'm wrong).
I have attached a few images showing some recent tests.
Tubebuddy states that for all of these tests the "Original will be better than the Variation".
Yes, based on CTR alone, that is true, but is this the only factor we should take into consideration?
If we look at the Impressions/Clicks column, we can see that for all of these tests, despite having a lower CTR, we actually have more impressions/clicks.
To me this would mean that the Variation is actually performing better.
Tubebuddy will automatically select the Original unless I override it.
Please let me know your opinions on this.
Thank you,
Michael