+ Reply to Thread
Results 1 to 9 of 9

Thread: How to compare multiple testers wine ratings?

  1. #1
    Points: 18, Level: 1
    Level completed: 35%, Points required for next Level: 32

    Posts
    4
    Thanks
    1
    Thanked 0 Times in 0 Posts

    How to compare multiple testers wine ratings?




    Newbie alert!

    Problem description: I have 20 wines and 6 tasters. Each taster ranks the wines from 1 to 20.

    Question: How do I test the hypothesis that the taster's rankings were the same?

    Many thanks!

  2. #2
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: How to compare multiple testers wine ratings?

    Can you explain what your hypothesis is in a bit more detail? Do you mean that you hypothesise that the tasters will rank all the wines in exactly the same order?

  3. #3
    Points: 18, Level: 1
    Level completed: 35%, Points required for next Level: 32

    Posts
    4
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Re: How to compare multiple testers wine ratings?

    Correct. That is what I would use as the null hypothesis.

  4. #4
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: How to compare multiple testers wine ratings?

    If there were any differences in the rankings, then that null hypothesis is false.

  5. #5
    Points: 18, Level: 1
    Level completed: 35%, Points required for next Level: 32

    Posts
    4
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Re: How to compare multiple testers wine ratings?

    Right. So back to my question: How do I conduct a statistical test of that hypothesis?

  6. #6
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: How to compare multiple testers wine ratings?

    You open up your data on your computer screen. You look at the rankings. Are they exactly the same for all the raters?

  7. #7
    TS Contributor
    Points: 18,889, Level: 87
    Level completed: 8%, Points required for next Level: 461
    CowboyBear's Avatar
    Location
    New Zealand
    Posts
    2,062
    Thanks
    121
    Thanked 427 Times in 328 Posts

    Re: How to compare multiple testers wine ratings?

    Achalk, I'm not "bullying" you as you claim in your report. The point I am trying to guide you to is that you don't need any sophisticated statistical test to reject the (implausible) null hypothesis that you've specified. Quite literally, if you look at the rankings, and some of the tasters ranked the wines differently from others, that's enough to reject the null hypothesis you've chosen.

    The bigger point here is that a useful statistical analysis depends heavily on what specific questions or hypotheses you decide to investigate. Forgetting about statistical jargon and null hypotheses, what are you actually trying to find out here?

  8. #8
    TS Contributor
    Points: 12,287, Level: 72
    Level completed: 60%, Points required for next Level: 163
    rogojel's Avatar
    Location
    I work in Europe, live in Hungary
    Posts
    1,471
    Thanks
    160
    Thanked 332 Times in 312 Posts

    Re: How to compare multiple testers wine ratings?

    hi,
    you could look at Cohens Kappa , and at Appraiser Agreement Analysis.
    regards
    Sandor

  9. The Following User Says Thank You to rogojel For This Useful Post:

    achalk (06-25-2013)

  10. #9
    Points: 18, Level: 1
    Level completed: 35%, Points required for next Level: 32

    Posts
    4
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Re: How to compare multiple testers wine ratings?


    Many thanks, rojojel. I will follow up on both of those.

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats