+ Reply to Thread
Results 1 to 4 of 4

Thread: Delphi study / 9 point Likert scales

  1. #1
    Points: 4,231, Level: 41
    Level completed: 41%, Points required for next Level: 119

    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Delphi study / 9 point Likert scales




    We are conducting a Delphi study.

    Each statement in our questionnaire is scored on a nine point likert scale ranging from 1(strongly disagree) to 9 (strongly agree).

    Previous Delphi studies from our college and department of health have all interpreted 7-9 as agreement, 4-6 as indeterminate, and 1-3 as disagreement.

    Can anyone tell me why 7-9 is taken as agreement, when on a nine point scale anything above 5 indicates agreement? I have asked locally, but even though everyone uses this method, nobody knows why.

    Many thanks.

  2. #2
    TS Contributor
    Points: 13,042, Level: 74
    Level completed: 48%, Points required for next Level: 208
    JohnM's Avatar
    Posts
    1,948
    Thanks
    0
    Thanked 5 Times in 4 Posts
    Not every response above 5 on a 9-point scale indicates agreement - it depends heavily on the individual's interpretation of the scale.

    That's why 4-6 is considered indeterminate - it's "in the middle"

    In my opinion, anything above a 5-point scale is a bit of a stretch - I just don't believe that people can really distinguish a difference as narrow as 1 point on a 7 or 9-point scale, and people tend to not use the entire scale (sometimes even at 5 points).

    At my place of work I send out an annual 5-point Likert customer satisfaction survey, and I have never, ever received a "1" on any question, ever.

    The only exceptions to this might be a poll of subject-matter experts where the subject of the poll itself is their area of expertise.

  3. #3
    Points: 4,231, Level: 41
    Level completed: 41%, Points required for next Level: 119

    Posts
    2
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Thanks, that is helpful.

    This is a poll of experts on their subject matter. Still not sure of the logic of giving them 9 choices if we are going to group the responses anyway.

    The other decision that we've had to make is what to accept as consensus agreement for each item. In the literature people have used mean 7-9, median 7-9, upper three quartiles (75% of respondents) 7-9.

    I don't want to use the mean because it will be distorted by the outliers. But I'm not sure about median score v 75% of responders. I've gone for 75% as it seems to be the more rigorous of the two, but am worried about excluding too many items, especially as this is an area where there is no 'right' answer.

  4. #4
    TS Contributor
    Points: 13,042, Level: 74
    Level completed: 48%, Points required for next Level: 208
    JohnM's Avatar
    Posts
    1,948
    Thanks
    0
    Thanked 5 Times in 4 Posts

    For consensus I would use the 75% rule or some other % threshold - possibly even higher than 75%. It just seems to make more sense, considering the dictionary definition of "consensus."

+ Reply to Thread

           




Similar Threads

  1. Z-scores for two likert scales?
    By Ab12 in forum Statistics
    Replies: 0
    Last Post: 09-04-2009, 02:14 PM
  2. Replies: 0
    Last Post: 05-12-2008, 12:10 AM
  3. can i use nine point Likert Scale insted of five point Likert
    By sanaa in forum Psychology Statistics
    Replies: 2
    Last Post: 03-03-2008, 02:07 AM
  4. Likert scales and statistics
    By kerry1113 in forum Statistics
    Replies: 1
    Last Post: 03-29-2006, 03:03 PM
  5. Likert Scales
    By jdorward in forum Psychology Statistics
    Replies: 7
    Last Post: 01-22-2006, 05:57 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats