Thanks for stopping by,

I have a question about analysing responses from a multiple choice question.

I'm looking at a question on what topics people talk discuss most online- there was a list of about 30 topics, and participants were able to pick more than one option.

I'm not sure how to test if there is a significant difference between the two most popular options- of if that is even possible.

The top 3 are:

Movies -62%

Music -60%

COmedy – 55%

movies ranks first, but if the margin of error is +/- 5 %, the difference between movies and music is not actually statistically significant, right?

So my question is, what test do you use to show which proportions are significantly higher, aside from eyeballing it?

I've thought of using a z-test for proportions, but that is for 2 independent samples... http://www.dimensionresearch.com/resources/calculators/ztest.html

But these aren’t independent samples, right? They’re the same sample!

But it’s not like it’s a pair-wise design either....

Chi – square also works to show that there is a statistical difference between the different options, but doesn’t show which ones are different: music and movies don’t have to be significantly different to get an overall significant difference.

Right?

Is a z-test for proportions legitemate? I've read through a bunch of textbooks and websites and can't find anything that deals with this particular problem.

Thanks!

-Tony

I have a question about analysing responses from a multiple choice question.

I'm looking at a question on what topics people talk discuss most online- there was a list of about 30 topics, and participants were able to pick more than one option.

I'm not sure how to test if there is a significant difference between the two most popular options- of if that is even possible.

The top 3 are:

Movies -62%

Music -60%

COmedy – 55%

movies ranks first, but if the margin of error is +/- 5 %, the difference between movies and music is not actually statistically significant, right?

So my question is, what test do you use to show which proportions are significantly higher, aside from eyeballing it?

I've thought of using a z-test for proportions, but that is for 2 independent samples... http://www.dimensionresearch.com/resources/calculators/ztest.html

But these aren’t independent samples, right? They’re the same sample!

But it’s not like it’s a pair-wise design either....

Chi – square also works to show that there is a statistical difference between the different options, but doesn’t show which ones are different: music and movies don’t have to be significantly different to get an overall significant difference.

Right?

Is a z-test for proportions legitemate? I've read through a bunch of textbooks and websites and can't find anything that deals with this particular problem.

Thanks!

-Tony

Last edited by a moderator: