New A/B Testing Bug?

Discussion in 'Support' started by Tangerine Travels, Oct 10, 2018.

  1. Tangerine Travels

    Tangerine Travels Newbie Member

    Joined:
    Apr 20, 2018
    Messages:
    5
    Likes Received:
    3
    Hey Tubebuddy team!

    I'm loving that you implemented one of the A/B improvements that I suggested a couple of weeks ago (watch time per impression).

    I think there might be a bug in the calculation of this metric. In the attached screenshot you can see:
    1. The variation has a significantly higher click-through rate
    2. The variation has a slightly higher average watch time
    3. The variation has a slightly lower watch time per impression

    How could #3 be true if #1 and #2 are also true?
     


    Attached Files:

  2. Andrew

    Andrew Superman Administrator

    Joined:
    May 6, 2016
    Messages:
    3,295
    Likes Received:
    2,217
    Tagging @Phil
     


  3. Tangerine Travels

    Tangerine Travels Newbie Member

    Joined:
    Apr 20, 2018
    Messages:
    5
    Likes Received:
    3
    Also, I'm sure you guys are aware because you've been doing a lot of updates to it lately, but CTRs haven't been updating for the past couple of days.
     


Loading...
Similar Threads - Testing Bug
  1. jharleschen
    Replies:
    0
    Views:
    8
  2. IMI
    Replies:
    1
    Views:
    97
  3. Tangerine Travels
    Replies:
    3
    Views:
    132