+ Reply to Thread
Results 1 to 13 of 13

Thread: Calculating ensemble value for data with non-gaussian errors

  1. #1
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Calculating ensemble value for data with non-gaussian errors




    I have 10 data points each of which have non-symmetric (i.e., non-Gaussian) errors. That is, if 'a' is the central value (representing the median), then a^{+b}_{-c} means that 'b' is the positive 1-sigma error and 'c' is the negative 1-sigma error. I want to be able to get a representative value with positive and negative errors for the ensemble of 10 points. How does one do this?

    The reason I ask is because I have some constant number which I want to compare to the representative value and uncertainty of the ensemble.

  2. #2
    Devorador de queso
    Points: 97,539, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent PosterActivity Award
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,987
    Thanks
    309
    Thanked 2,640 Times in 2,255 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    I don't understand what you're asking
    I don't have emotions and sometimes that makes me very sad.

  3. #3
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    Can I ask where the confusion is coming from in my post?

  4. #4
    Devorador de queso
    Points: 97,539, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent PosterActivity Award
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,987
    Thanks
    309
    Thanked 2,640 Times in 2,255 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    Pretty much all of it other than the first sentence.
    I don't have emotions and sometimes that makes me very sad.

  5. #5
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    I have ten data points with non-gaussian errors. I want to somehow combine these ten data into one datum that would be representative of the total ten. Given the non-symmetric nature of the error bars, how can one do this?

  6. #6
    Devorador de queso
    Points: 97,539, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent PosterActivity Award
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,987
    Thanks
    309
    Thanked 2,640 Times in 2,255 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    I guess that depends on how you measure if the value is representative. Typically for non symmetric data we would just use the median.
    I don't have emotions and sometimes that makes me very sad.

  7. #7
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    Thank you for your response.

    So currently all the ten data have a median value and 1-sigma errors which are asymmetric. What I want is a robust statistical representation of the ten data in the form of one data point. I can imagine that the median value for the representative point could just be the mean of the 10 median values of the data. But how do I then get the asymmetric errors on this point?

  8. #8
    Devorador de queso
    Points: 97,539, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Posting AwardCommunity AwardDiscussion EnderFrequent PosterActivity Award
    Dason's Avatar
    Location
    Tampa, FL
    Posts
    12,987
    Thanks
    309
    Thanked 2,640 Times in 2,255 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    How are the errors being calculated?
    I don't have emotions and sometimes that makes me very sad.

  9. #9
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    Basically, I have a posterior probability distribution for some quantity. The central value of the data is the median value of the posterior distribution, and the 1-sigma values are computed numerically and represent ~34% (in analogy to the gaussian 1-sigma) of the solutions to either side of the median value. But because the posterior distribution could be skewed and is not generally gaussian, the error bars are non-symmetric.

  10. #10
    TS Contributor
    Points: 12,501, Level: 73
    Level completed: 13%, Points required for next Level: 349
    rogojel's Avatar
    Location
    I work in Europe, live in Hungary
    Posts
    1,491
    Thanks
    162
    Thanked 334 Times in 314 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    how about combining the distributions using the total probability formula and calculating the mean / median of the resulting distribution?

  11. #11
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    Thanks for the response. Can you be more specific?

  12. #12
    TS Contributor
    Points: 12,501, Level: 73
    Level completed: 13%, Points required for next Level: 349
    rogojel's Avatar
    Location
    I work in Europe, live in Hungary
    Posts
    1,491
    Thanks
    162
    Thanked 334 Times in 314 Posts

    Re: Calculating ensemble value for data with non-gaussian errors

    Quote Originally Posted by puma31 View Post
    Thanks for the response. Can you be more specific?
    Hi,
    if you have 10 distributions f1(x)...f10(x) and you have an estimate of the relative frequencies of when each distribution applies p1 ..p10 then you could have f(x)=SUM(pi*fi(x)) where SUM(pi)=1. Then use f(x) to calculate the mean of x or the median of x or, even better, the mode.

    regards

  13. #13
    Points: 39, Level: 1
    Level completed: 78%, Points required for next Level: 11

    Posts
    9
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Re: Calculating ensemble value for data with non-gaussian errors


    Thank you for your nice response. I would go about doing it but then there is ambiguity in assigning p1, p2, ..., pn. I wonder if you might know how to use a chi-square test on the ten data with their asymmetric errors to test if their total representative value is consistent or not with some constant reference value (that doesn't have errors, but is just a number).

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats