Search results

  1. J

    Bonferoni test

    Algorithms.. . I am working on software development effort estimation where different algorithms like linear regression, support vector regression are applied to perform predictions. Data generated is not normally distributed. I performed Wilcox test to get p values. 3 algorithms compared with...
  2. J

    Bonferoni test

    If not p values, then what is the alternative? How can we perform analysis for significant differences?
  3. J

    What is n in bonferoni test

    Thanks again for your help. I run A with B, A with C and A with D for dataset 1. Then A with B, A with C and A with D for dataset 2. Similarly, for 4 datasets. So it means for a particular algorithm A, I will have 3*4=12 experiments, so n will be 12,right? First I thought, n will be 3...
  4. J

    What is n in bonferoni test

    Thanks obh, I will definitely look into it for my next project. Currently, I need to use bonferoni as it is a requirement. I want to ask here that do I need to divide the. 05 by 3 or by 12, based on the situation I explained in my post. Regards
  5. J

    What is n in bonferoni test

    I want to compare and calculate the prediction accuracy of 4 algorithms, linear regression, support vector regression, bagging and multilayer perception. So each algorithm will be compared with other three. I have to evaluate their performance with 4 different datasets, so in total 3 algorithms...
  6. J

    Bonferoni test

    Indeed, but it explains at least A and B have significant difference
  7. J

    Bonferoni test

    Thanks for your reply. Yes it would be a problem. For example, algorithm A significantly perform better than B with the p value of 0.0001, it means algorithm A is quite better than B, but after the bonferoni analysis, we would end with no algorithm performed better than the other.
  8. J

    Bonferoni test

    In my example, I have about 50 statistical analysis, so is it feasible to use bonferoni test in this case?. 05/50 will be very very small value and it will be impossible for one type of algorithm to significantly outperform the other. Thanks
  9. J

    Vargha and delaney effect size

    I performed vargha effect size on two samples, A and B. The algorithm A has better performance than B, but still when I perform the effects size in R, the value I get is 1.187 (large). What does this value mean? Does it mean, Algorithm B performed better? In the experiment, where these two...
  10. J

    Baysian statistical test

    My data is about the error (absolute residuals) of two algorithms like linear regression and support vector regression. The dataset is about school results where the actual values are contnous from 0 to 1 and the predicted values are also like that. For example, students spend time in lab is a...
  11. J

    Baysian statistical test

    The data is between - 1 and 1. It can be 0.3,0.002, or - 0.01
  12. J

    Baysian statistical test

    Sample size is more than 500
  13. J

    Baysian statistical test

    Thanks for the reply. Data is continuous. Let's say, algorithm A has data like, 0.01, 0.15, 0.03, - 0.21 etc and algorithm B : 0.12,0.002, 0.13, 0.4 etc. The number of samples could be more than 100 like this.
  14. J

    Baysian statistical test

    Hi, how can we perform a baysian test which is alternative of Wilcox test.? My data is not normalized so can't do baysian t tests.
  15. J

    (Wilcox signed tank test)

    Thanks a lot Karabiner But when I perform the test, it says there is no (significant) difference though there is a clear difference between the mean/average of the two set of values. I am not sure what exactly I am doing wrong?
  16. J

    (Wilcox signed tank test)

    That it gives us an idea if there is a difference between the set of values or not? If we get the p-value less than 0.05, then we can say that there is a significant difference, otherwise, we can not claim it.
  17. J

    (Wilcox signed tank test)

    Hi, I want to ask about the theory/concept behind the statistical significance tests to find out the p values. For instance, I got two types of data, one has the mean value of 75 and another 86 and the test shows there is no significant difference. How it is possible? These tests test depends on...