+ Reply to Thread
Results 1 to 6 of 6

Thread: Generalizability of results / External validity

  1. #1
    Points: 20, Level: 1
    Level completed: 39%, Points required for next Level: 30

    Posts
    4
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Generalizability of results / External validity




    Hi everyone,

    Employment of probability sampling to draw a sample from the population in a quantitative study (cross-sectional design, data collected via surveys) is one of the criteria needed to make inferences to the population.

    What other criteria are in play? How to determine, where the results are generalizable to the population.

    Thanks in advance for your help :-)

    Reference to the relevant article or book will be as well much appreciated.

    Cheers,
    Renata

  2. #2
    Fortran must die
    Points: 58,790, Level: 100
    Level completed: 0%, Points required for next Level: 0
    noetsi's Avatar
    Posts
    6,532
    Thanks
    692
    Thanked 915 Times in 874 Posts

    Re: Generalizability of results / External validity

    The only other criteria I know for external validity is that you have to actually randomly sample the population you are interested in. This comes into play, practically if not usually commented on in theory, in two ways. First you may not have any way to know what the true population is or what their address is. It is very rare you have a way to know or to contact the true population - so even if you can randomly sample you can't randomly sample the real population. This is an issue of sampling frame.

    Second is that virtually never will you get a full response. Indeed response rates below 50 percent (often well below) are increasingly common. In my area of research it is often 15 percent. When you get a low response rate those who respond may vary from those that do not which will reduce the external validity - sometimes seriously even if you randomly sample. This is an issue that often gets ignored in discussions of random sampling.
    "Very few theories have been abandoned because they were found to be invalid on the basis of empirical evidence...." Spanos, 1995

  3. The Following User Says Thank You to noetsi For This Useful Post:

    Renāta (09-19-2013)

  4. #3
    Omega Contributor
    Points: 38,334, Level: 100
    Level completed: 0%, Points required for next Level: 0
    hlsmith's Avatar
    Location
    Not Ames, IA
    Posts
    6,998
    Thanks
    398
    Thanked 1,186 Times in 1,147 Posts

    Re: Generalizability of results / External validity

    Another key structural concept is that you have to ensure internal validity before you ever think about external validity. So are you really collecting what you intended to collect.
    Stop cowardice, ban guns!

  5. The Following User Says Thank You to hlsmith For This Useful Post:

    Renāta (09-19-2013)

  6. #4
    Pirate
    Points: 15,159, Level: 79
    Level completed: 62%, Points required for next Level: 191
    victorxstc's Avatar
    Posts
    875
    Thanks
    229
    Thanked 332 Times in 297 Posts

    Re: Generalizability of results / External validity

    Quote Originally Posted by Renāta View Post
    What other criteria are in play? How to determine, where the results are generalizable to the population.
    Well there are several factors than can favor the generalizability (external validity). For example broader Age ranges of the subjects, sampling from more centers, sampling from a broader range of socioeconomic statuses, sampling from a broader range of ethnicities, sampling from a broader range of businesses, etc. etc... See the pattern? If you sample from a broader range of a characteristic continuum (whatsoever), your study has a better external validity.
    "victor is the reviewer from hell" -Jake
    "victor is a machine! a publication machine!" -Vinux

  7. The Following User Says Thank You to victorxstc For This Useful Post:

    Renāta (09-19-2013)

  8. #5
    Points: 20, Level: 1
    Level completed: 39%, Points required for next Level: 30

    Posts
    4
    Thanks
    3
    Thanked 0 Times in 0 Posts

    Re: Generalizability of results / External validity

    Hi All,

    Thanks a lot for the input! Much appreciated!

  9. #6
    Fortran must die
    Points: 58,790, Level: 100
    Level completed: 0%, Points required for next Level: 0
    noetsi's Avatar
    Posts
    6,532
    Thanks
    692
    Thanked 915 Times in 874 Posts

    Re: Generalizability of results / External validity


    Victor's comments above are effectively methods to address what I was discussing above. When you don't have the sampling frame, the complete list of the entire population or at least how to contact them, you have problems with randomly sampling the population. So you try to extend who you sample to partially address this [cluster sampling is another variation of this].
    "Very few theories have been abandoned because they were found to be invalid on the basis of empirical evidence...." Spanos, 1995

+ Reply to Thread

           




Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts






Advertise on Talk Stats