First question: How have you decided how many factors to retain? The fact that you say "SPSS has established" the number of factors hints to me that perhaps you have used the default setting in SPSS, which is simply to extract all factors with an eigenvalue greater than one ("Kaiser's stopping rule"). This, unfortunately, is quite possibly the worst way to select the appropriate number of factors (it will tend to overestimate the number of factors). Of the selection methods available in SPSS, referring to the scree plot is probably the best way to decide how many factors to choose (but is rather subjective). Better methods are Velicer's MAP and parallel analysis, but these aren't available as menu options in SPSS. They can be done in R.
This sounds fine (though the chosen number of factors may differ with one of the above-mentioned techniques).Because SPSS found four factors, I will create four subscales for the four the factors I have identified.
It might be better to just add up the responses to all items to get your overall internationalism score. This will deal with the problem you mention of the subscales being of different sizes, resulting in some items having more influence than others if you average the four subscale scores.I will then take an average score of these four factors and combine to create an overall score for internationalism.
Deciding how big a loading has to be before an item is considered to "load" on a subscale is a bit subjective, but .6 seems like a rather high cutoff. .3 might be more common.Should I only keep items that load greater than .6?
This would seem a little superfluous, yes.Once I recode new variables for each subscale, should I run a new factor analysis to see if they load on a single factor? Is this nonsense and would such a test yield identical results as the first factor analysis? (My brain hurts trying to figure this out).
This does sound a little dodgy, yes When you start to talk about percentage point differences on the internationalism scale you're making the implicit assumption that your scale has a meaningful zero point (i.e. that it is a ratio scale). In fact, for a percentage score you also need a meaningful 100% point too (i.e. a point at which someone has "complete" internationalism). As much as I'm skeptical about the S.S. Stevens levels of measurement, this does seem to be going a bit overboard in terms of assumptions about the meaningfulness of measurements via your scale. Is it really meaningful to talk about someone having no internationalism, or complete internationalism?Is it statistically sound to score 5-level variables into scores of (0, 25, 50, 75, 100) so I can get a percentage score, so when analyzing the regression tables I can talk about differences in terms of percentage points on my internationalism scale? Alternatively, can I calculate a summative score of 1-5 and then multiply by 20 to get a percentage score? Is this entering dodgy territory?