Search results

  1. E

    What alpha spending formula to use for chi square test of independence ?

    That is exactly what I need, and I found some alpha spending functions that work for T-tests (i.e. the type-I error stays 5% if you repeatedly check the result) but it seems for chi-square test of independence it does not hold ( I made some simulations and I get around 10% error with the...
  2. E

    What alpha spending formula to use for chi square test of independence ?

    Thanks for the comment! Do you mean the boundary at which the test statistic is significant? I would be happy to use that as well. I was reading on this a bit (here for instance https://blog.optimizely.com/2015/01/20/statistics-for-the-internet-age-the-story-behind-optimizelys-new-stats-engine/...
  3. E

    What alpha spending formula to use for chi square test of independence ?

    Hi all, For a website CRO (conversion rate optimization) trajectory project of a client, I’m trying to setup a way that they can sequentially check whether an A/B test ‘reached’ significant results (i.e. Does website B lead to more transactions, than website A?). Much like clinical trials, data...