+ Reply to Thread
Results 1 to 4 of 4

Thread: Citation needed for removing 3 Stdev outliers

  1. #1
    Points: 8, Level: 1
    Level completed: 15%, Points required for next Level: 42

    Posts
    1
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Citation needed for removing 3 Stdev outliers



    Hi,
    In a research paper, I had remove values that were 3 standard deviations away from the mean. The values simply didn't make any sense.
    I have been searching all over for a citation supporting the 3 standard deviation rule but haven't found much as most researchers don't seem to include one... but I do need one.

    Does anyone know of one?

  2. #2
    IBM Rules
    Points: 13,422, Level: 75
    Level completed: 44%, Points required for next Level: 228
    Awards:
    Activity Award

    Posts
    2,601
    Thanks
    124
    Thanked 381 Times in 369 Posts

    Re: Citation needed for removing 3 Stdev outliers

    You won't find any such rule in all liklihood. The conventional wisdom (given that statisticians always disagree on everything) is that there is no specific level at which you can automatically remove outliers. Generally, you need to try to explain why the outliers are occuring (if they are not simply a mistake in data collection). Commonly extreme outliers reflect model mispecification, multiple populations etc. Three standard deviations is a useful tool to identify extreme outliers, but you use it to explain why they occur rather than removing them.

    I spent a fair time reading various material on outliers. It is common to see warnings about automatically removing them.
    "Facts are stubborn things, but statistics are more pliable." Mark Twain

  3. #3
    Points: 2,499, Level: 30
    Level completed: 33%, Points required for next Level: 101
    SmoothJohn's Avatar
    Location
    Edmonton, Canada
    Posts
    156
    Thanks
    11
    Thanked 9 Times in 7 Posts

    Re: Citation needed for removing 3 Stdev outliers

    What was your reason for removing them?

  4. #4
    RotParaTon
    Points: 47,169, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Awards:
    Discussion EnderPosting AwardCommunity AwardMaster TaggerFrequent Poster
    Dason's Avatar
    Location
    Ames, IA
    Posts
    9,199
    Thanks
    212
    Thanked 1,642 Times in 1,403 Posts

    Re: Citation needed for removing 3 Stdev outliers


    Results look better without them of course.
    "His programming is malfunctioning. It begins! Get your weapons, he's going to become a killbot!!!" - bryangoodrich

+ Reply to Thread

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts








Advertise on Talk Stats