+ Reply to Thread
Results 1 to 3 of 3

Thread: multiple questionnaire item chi square?

  1. #1
    Points: 4,846, Level: 44
    Level completed: 48%, Points required for next Level: 104

    Posts
    12
    Thanks
    0
    Thanked 0 Times in 0 Posts

    multiple questionnaire item chi square?




    I have three questions:

    Question 1

    I have a questionnaire (5 point Likert) and I want to compare student responses to 4 items. The 4 items (main variables) ask about 1) student preferences for interaction with the teacher 2) student preferences for interaction with other students, 3) student prefs for well organized materials and 4) student prefs for self-directed learning. I want to see which prefs are stronger/weaker in this group.

    If I average responses to get a mean of the likert scores for each item I can do an anova to find if there is a significant difference somewhere among the 4 items. This I would follow with a post hoc - i.e scheff, ect. to test individual differences. So far so good?

    Also, I believe I could do a chi square test for independence (I am imagining a 4 down X 5 across grid) to see if there was a difference somewhere. What post hoc would I then do to compare responses on indiviual items to test for significance?

    Question 2 -

    In fact - I have 4 items for each of the 4 variables - so there are 4 items that I use to operationalize: 1) prefs for Student-teacher interaction, prefs for Student-student interaction, etc.

    So if I want to group the 4 related items and compare these variable groups. Using mean scores could I average means for the 4 related items and do an anova with averaged means?

    Question 3 -

    With chi square- what would I do? One idea is to add the raw scores for each likert choice for each of the 4 related items that comprise a variable. For example if there are 4 items that ask about student prefs for Student-teacher interaction, and if the number of likert 5s is...4,5,6,3, I could aggregate them and say that the total number of 5s for this variable is 18. In other words I would collapse a 4X5 matrix into a 1X5 matrix. I could then do this to each of the 4 variables and do chi square as in the example above. Would this the best way to go?

    Many thanks!
    Last edited by ehb23; 12-07-2006 at 07:30 PM. Reason: title typo

  2. #2
    TS Contributor
    Points: 13,042, Level: 74
    Level completed: 48%, Points required for next Level: 208
    JohnM's Avatar
    Posts
    1,948
    Thanks
    0
    Thanked 5 Times in 4 Posts
    Question 1

    I have a questionnaire (5 point Likert) and I want to compare student responses to 4 items. The 4 items (main variables) ask about 1) student preferences for interaction with the teacher 2) student preferences for interaction with other students, 3) student prefs for well organized materials and 4) student prefs for self-directed learning. I want to see which prefs are stronger/weaker in this group.

    If I average responses to get a mean of the likert scores for each item I can do an anova to find if there is a significant difference somewhere among the 4 items. This I would follow with a post hoc - i.e scheff, ect. to test individual differences. So far so good? Yep.

    Also, I believe I could do a chi square test for independence (I am imagining a 4 down X 5 across grid) to see if there was a difference somewhere. What post hoc would I then do to compare responses on indiviual items to test for significance? Do chi-squared tests on the post-hoc comparisons that you are focusing on.

    Question 2 -

    In fact - I have 4 items for each of the 4 variables - so there are 4 items that I use to operationalize: 1) prefs for Student-teacher interaction, prefs for Student-student interaction, etc.

    So if I want to group the 4 related items and compare these variable groups. Using mean scores could I average means for the 4 related items and do an anova with averaged means? Yes.

    Question 3 -

    With chi square- what would I do? One idea is to add the raw scores for each likert choice for each of the 4 related items that comprise a variable. For example if there are 4 items that ask about student prefs for Student-teacher interaction, and if the number of likert 5s is...4,5,6,3, I could aggregate them and say that the total number of 5s for this variable is 18. In other words I would collapse a 4X5 matrix into a 1X5 matrix. I could then do this to each of the 4 variables and do chi square as in the example above. Would this the best way to go? You could do it that way or try other ways of collapsing, i.e., three categories: 1-2, 3, 4-5

  3. #3
    Points: 4,846, Level: 44
    Level completed: 48%, Points required for next Level: 104

    Posts
    12
    Thanks
    0
    Thanked 0 Times in 0 Posts

    Question what to do before the chi square to narrow it down


    Quote Originally Posted by JohnM

    Also, I believe I could do a chi square test for independence (I am imagining a 4 down X 5 across grid) to see if there was a difference somewhere. What post hoc would I then do to compare responses on indiviual items to test for significance? Do chi-squared tests on the post-hoc comparisons that you are focusing on.
    I am clear on all the answers except this one. Before doing the chi-square comparisons post hoc on individual items what do I do? How do I know which comparisons to focus on? Is there a type of chi-square that does many items like anova does which preceeds a post hoc? If I just do a series of comparisons with chi square don't I run into the same problem of doing multiple t-tests that anova was designed to avoid? Also, If have two items for 4 variables that turns into a lot of chi-square tests,

    Thanks!

+ Reply to Thread

           




Similar Threads

  1. Item analysis - multiple tests ... or not?
    By hlm in forum Statistics
    Replies: 3
    Last Post: 03-10-2011, 03:43 PM
  2. R-square and interactions (multiple regression)
    By williaml in forum Regression Analysis
    Replies: 1
    Last Post: 03-16-2010, 09:50 PM
  3. Questionnaire data with multiple categories.. urgent!
    By AndyK in forum Applied Statistics
    Replies: 0
    Last Post: 02-28-2010, 08:01 AM
  4. Multiple chi-square or logistic regression?
    By Chris Webber in forum Regression Analysis
    Replies: 1
    Last Post: 06-22-2009, 08:36 PM
  5. Chi square ok for questionnaire responses?
    By BJ82 in forum Statistics
    Replies: 2
    Last Post: 04-03-2009, 04:04 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats