+ Reply to Thread
Results 1 to 3 of 3

Thread: Goodness of fit test for categorical data with non-negative real numbersca

  1. #1
    Points: 6, Level: 1
    Level completed: 11%, Points required for next Level: 44

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Goodness of fit test for categorical data with non-negative real numbersca




    An experiment that I conduct has 5 outcomes: A, B, C and D. I conduct 12 trials for this experiment. I observe, for example:

    Outcome : Frequency
    A : 2
    B : 3
    C : 0
    D : 5
    E : 2

    Now, I have a model that predicts the frequency. However, the predictions are non-negative real numbers. For example:

    Outcome : Predicted frequency
    A : 1.75
    B : 2.77
    C : 0.11
    D : 3.82
    E : 3.55

    I attempted to use the Pearson's Chi-square goodness of fit test to evaluate . However, since the values of frequency are below 5, I read that this test is not the best choice (= reliable). So, I attempted to use Fisher's exact test. The limitation of Fisher's exact test is that the data has to be non-negative integers.

    My question: Is there a way to evaluate the p-value between the observed and predicted sets of data where the predicted data are not integers, but non-negative real numbers. The values of frequency are often lesser than 5.

  2. #2
    TS Contributor
    Points: 12,227, Level: 72
    Level completed: 45%, Points required for next Level: 223
    rogojel's Avatar
    Location
    I work in Europe, live in Hungary
    Posts
    1,470
    Thanks
    160
    Thanked 332 Times in 312 Posts

    Re: Goodness of fit test for categorical data with non-negative real numbersca

    hi,
    part of the problem is that in the measured dataset you do not have frequencies but the number of occurrences , in the prediction you have probably some kind of frequencies, though they do not sum to 100% . I guess the first step should be to unify the outputs of the experiments and the model and then see how you can compare them.

    regards

  3. #3
    Points: 47, Level: 1
    Level completed: 94%, Points required for next Level: 3

    Posts
    4
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Goodness of fit test for categorical data with non-negative real numbersca


    Thank you for posting! Your post will not be visible until a moderator has approved it for post

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats