EFA in Practice: Choosing the Number of Factors, Interpreting Cross-Loadings, and Removing Items
A low loading or cross-loading is a signal to investigate, not an automatic deletion order. Trustworthy EFA starts with the correlation matrix, factor count and extraction method before item retention decisions.
Distinguish EFA from PCA, choose Pearson or polychoric correlations, use parallel analysis and MAP, extract common factors, rotate obliquely, inspect pattern matrices, remove justified items individually, and validate on different data.
EFA: decisions need several layers of evidence
- Data
Check items and the correlation matrix
- Factor retention
Parallel analysis, scree and theory
- Rotation
Choose for the factor relationships
- Interpret loadings
Review cross-loadings and item meaning
Conceptual diagram. Do not delete items solely to achieve a loading cutoff or better index.
Source: Lê Minh · Conceptual illustration, not software output.1. Objectives and prerequisites for EFA
EFA seeks latent factors that explain covariance among observed variables. Software sees associations; researchers must supply conceptual meaning, item content and the analytical rationale. Without an expected-content map and retention criteria, deletion can become a search for an attractive matrix (Finch et al., 2016).
EFA suits uncertain structures, newly developed scales or substantially adapted measures. CFA usually better addresses testing a prespecified model. Do not claim both exploration and confirmation on the same sample.
- Define each construct and its content domain.
- Check coding, reversed items, out-of-range values and missingness.
- Identify continuous, ordinal and binary variables.
- Plan factor-count selection before inspecting loadings.
- Provide an independent validation sample or acknowledge its absence.
2. EFA, PCA and CFA answer different questions
PCA derives components from total variance to reduce data. Common factor analysis models shared variance and better suits inference about latent structure. CFA tests a prespecified measurement model. Selecting Principal Components in SPSS is therefore not another way of performing EFA (Fabrigar et al., 1999; Watkins, 2018).
Principal axis factoring (PAF) is a common practical choice for common factors with imperfectly normal data. Maximum likelihood supports tests and CIs under suitable assumptions. Do not choose extraction merely because it is the software default.
| Method | Objective | Variance modeled | Application |
|---|---|---|---|
| PCA | Data reduction | Total variance | Create composites or summarize variables |
| Common-factor EFA | Explore latent structure | Shared variance | Develop or revise scales |
| CFA | Test a prespecified structure | Specified measurement model | Confirm and compare models |
3. Step 1: inspect data before correlations
Check category frequencies, missingness, reversed items, skewness, kurtosis and nearly duplicate pairs. Almost identical wording may create a method factor. A variable with insufficient variation cannot inform the structure.
KMO and Bartlett support initial assessment but do not establish a correct model. High KMO can coexist with an incorrect factor count or redundant items. Bartlett is often significant in large samples. Also inspect the determinant, correlation matrix, communalities and residuals (Watkins, 2018).
- Reverse-code correctly before analysis.
- Check unused categories and sparse frequency cells.
- Describe missing-data treatment; do not automatically mean-impute.
- Identify near-perfect correlations and repeated wording.
- Do not rely solely on KMO and Bartlett.
4. Step 2: Pearson or polychoric correlations for Likert data
Pearson uses observed scores and is often chosen for items with many categories, moderate distributions and approximately continuous treatment. Polychoric correlations estimate associations between latent continuous variables underlying ordinal responses. Consider them with fewer categories, skewness or concentrated responses (Flora & Curran, 2004).
Not every Likert item requires polychoric correlations. Consider category count, distribution, sample size and sparse cross-tabulations. Polychoric estimates can be unstable with small samples or many empty cells. Report the matrix analyzed rather than only naming SPSS.
| Data | Starting choice | Sensitivity check |
|---|---|---|
| 5-7 categories, reasonably balanced distribution | Pearson may be acceptable | Compare with polychoric results for consequential decisions |
| 2-4 categories or strong skewness | Prioritize considering polychoric correlations | Check sparse cells and stability |
| Binary items | Tetrachoric correlations or a categorical model | Check rare responses |
| Approximately continuous total scores | Pearson depending on the objective | Do not infer item-level suitability from totals |
The usual SPSS FACTOR procedure uses Pearson correlations. For polychoric correlations and ordinal parallel analysis, use R, FACTOR, Mplus or another suitable tool and report the software.
5. Step 3: select the factor count before deleting items
Eigenvalues greater than 1 can retain too many or too few factors. Scree plots help but involve judgment. Parallel analysis compares observed with random-data eigenvalues; MAP seeks the component count minimizing average partial correlations. Combine these methods with theory and interpretability (O'Connor, 2000; Watkins, 2018).
Ordinal parallel analysis should use an appropriate matrix and simulation. Garrido et al. (2013) show that ordinal characteristics matter. Do not automatically generalize Pearson-based results to every Likert distribution.
- Run parallel analysis appropriate to the data.
- Inspect the scree plot and neighboring solutions.
- Use MAP as complementary evidence where suitable.
- Compare the factor count with the content map.
- Do not fix the count merely to match earlier research.
6. Step 4: choose extraction and rotation
For latent structure, choose PAF or an appropriate common-factor estimator. Rotation aids interpretation but cannot repair an inappropriate correlation matrix or factor count.
Social science constructs often correlate, making Direct Oblimin or Promax reasonable starting points. Varimax constrains factor correlations to 0. Use orthogonal rotation only when theory and data support independence (Fabrigar et al., 1999; Finch et al., 2016).
| Decision | Choice | Meaning |
|---|---|---|
| Extraction | PAF | Estimates shared variance with less dependence on normality than ML |
| Extraction | ML | Useful under suitable assumptions when model tests are required |
| Rotation | Direct Oblimin or Promax | Allows correlated factors |
| Rotation | Varimax | Constrains orthogonal factors; requires strong theoretical justification |
7. Step 5: pattern, structure and factor-correlation matrices
With oblique rotation, pattern coefficients describe each factor’s unique contribution to an item conditional on other factors. Structure coefficients are item–factor correlations and may be high because factors correlate. Prioritize the pattern matrix for primary and cross-loadings while using the structure matrix for context (Finch et al., 2016).
The factor-correlation matrix describes relationships between factors. Very high correlations can signal indistinct constructs or overextraction. Do not switch to Varimax merely to hide cross-loadings.
Pattern coefficients resemble partial regression coefficients; structure coefficients are item–factor correlations. The matrices differ when factors correlate.
8. Step 6: inspect four item-level signals
Low communality indicates little item variance explained by retained factors. A low primary loading indicates a weak association. Cross-loadings indicate contributions to several factors. Content mismatch means an item no longer represents the intended domain despite attractive loadings.
Loadings of 0.30, 0.40 or 0.50 and loading differences of 0.20 are heuristics. Requirements depend on sample size, stability, indicator count, item quality and objectives. Do not turn a reference point into an automatic deletion rule (Costello & Osborne, 2005).
| Signal | Question | Avoid |
|---|---|---|
| Low communality | Does the common structure explain the item? | Deleting solely for falling below a cutoff |
| Low primary loading | Is the item clearly related to its factor? | Retaining solely because alpha increases |
| Cross-loading | Does the content genuinely span one or more constructs? | Inspecting only the largest loading |
| Content mismatch | Does the item preserve the measurement domain? | Sacrificing content validity for a simple matrix |
9. Step 7: handle cross-loadings without chasing an attractive matrix
For each cross-loading item, review wording, reverse coding, reference object, recall period and level of abstraction. An item may genuinely bridge concepts, be ambiguous or reflect wording effects. Combine pattern loadings, communality, content and coverage consequences.
If removing an item, remove one justified item per iteration and rerun factor-count selection, extraction, rotation and loadings. The new solution may reorder the problems. Do not preselect many deletions from one run.
A difficult item representing a unique part of the domain may require rewriting or new data rather than deletion. Shorter is not automatically better.
10. SPSS practice: Pearson, PAF and oblique rotation
Open Factor
Choose Analyze > Dimension Reduction > Factor and move all exploratory items into Variables.
Descriptives
Request KMO and Bartlett, anti-image, reproduced and correlation matrices as needed.
Extraction
Choose Principal Axis Factoring and a scree plot; do not treat eigenvalue > 1 as the final decision.
Determine the factor count
Run parallel analysis or MAP outside the default dialog, then enter the Fixed number of factors.
Rotation
Choose Direct Oblimin or Promax when factors may correlate.
Options
Sort loadings for readability but retain low coefficients in the analysis record.
Read the solution
Inspect communalities, pattern, structure, factor correlations and reproduced residuals.
Address one item
Record the rationale, remove or revise one item, then rerun the full configuration.
Maintain a record
Export each iteration with a versioned name and update the disposition log.
Validate
Assess the final solution with CFA or an independent sample rather than calling the same sample confirmation.
11. Ordinal EFA when Pearson is insufficient
For few-category or strongly skewed items, obtain polychoric correlations in suitable software. R offers psych::polychoric and fa.parallel or equivalents; FACTOR supports ordinal analysis and parallel analysis. Check sparse-cell, non-positive-definite-matrix and Heywood warnings.
Run parallel analysis on the appropriate ordinal matrix, extract common factors using a suitable estimator and rotate obliquely. Compare with Pearson results for sensitivity. Report substantial changes in factor count or item placement rather than selecting only the favorable solution.
| Objective | Suggested tools | What to report |
|---|---|---|
| Routine Pearson EFA | SPSS Factor | PAF/ML, rotation and factor-count selection |
| Polychoric correlations and parallel analysis | R psych or FACTOR | Correlation type, estimator and retention criteria |
| Categorical CFA after EFA | R lavaan, Mplus or equivalent | WLSMV and parameterization |
| Sensitivity analysis | Two workflows | Similarities and differences between solutions |
12. Hypothetical example: EFA of 18 Likert items
These numbers are constructed illustrations, not empirical results. An 18-item, five-category scale was administered to 420 people. Two items were strongly skewed and one response category was rare. Polychoric parallel analysis suggested three factors, whereas Pearson eigenvalues > 1 suggested four. The scree plot and theory supported three.
The team fitted common factors with oblique rotation. Q07 had pattern loadings of 0.31 on F1 and 0.29 on F2, a difference of 0.02; cognitive review showed combined professional and emotional support content. It was earmarked for rewriting rather than reassigned. Q14 had communality 0.18 and duplicated Q13, justifying removal. Rerunning yielded primary loadings of 0.52 to 0.83 and factor correlations of 0.28 to 0.47.
| Item | Evidence | Decision | Consequence to check |
|---|---|---|---|
| Q07 | Cross-loading and double-barreled wording | Retain for rewriting; exclude from final scoring | Collect new data |
| Q14 | Communality 0.18 and duplicate content | Remove alone in iteration 1 | Reassess the factor count |
| Q03R | Negative loading from unreversed coding | Correct coding; do not delete | Check all reversed items |
13. Ten common mistakes
| Mistake | Why it is risky | Correction |
|---|---|---|
| Calling PCA EFA | Different objectives and variance components | Use common factors for latent structure |
| Using only eigenvalue > 1 | Can select the wrong factor count | Use parallel analysis, MAP, scree and theory |
| Always using Varimax | Forces factor independence | Prefer oblique rotation when correlation is plausible |
| Reading only the Rotated Matrix | Ignores pattern, structure and factor correlations | Read all relevant tables |
| Treating every Likert item as continuous | Pearson may distort ordinal relationships | Consider categories and distributions |
| Requiring polychoric correlations for all Likert items | Sparse cells can create instability | Choose according to data and check sensitivity |
| Deleting many items together | The solution changes after every deletion | Address items individually with a record |
| Using absolute cutoffs | Ignores sample size and content | Treat cutoffs as heuristics |
| Retaining a factor with two weak items | Fragile structure | Revisit the domain and collect additional items |
| EFA and CFA on the same sample | Overoptimistic evaluation | Use an independent confirmation sample |
14. Read the final solution before naming factors
Name a factor from the shared content of its strongly loading items, not one standout item. Check sufficient quality indicators, consistent abstraction and a label no broader than the evidence. If factors differ only in wording, consider a method factor.
Explained variance is not the sole criterion. A stable, meaningful solution preserving content may be preferable despite lower variance explained. Report deleted items and imperfect retained items with reasons.
15. APA 7 reporting template and checklist
Reporting example in English
EFA used [n] participants and [number] items. Screening addressed [missingness, distributions, coding]. The [Pearson/polychoric] matrix was analyzed in [software/version] using [PAF/ML/estimator] and [Promax/Oblimin] rotation. Factor count reflected parallel analysis, MAP, scree and interpretability. After [number] documented iterations, [number] items were removed for [reasons]. The final solution contained [number] factors, pattern loadings [range], communalities [range] and factor correlations [range]. Example values are not universal thresholds.
- State the EFA objective and why PCA or CFA was not chosen.
- Describe the sample, missingness, distributions and reverse coding.
- Identify Pearson, polychoric or other correlations.
- State extraction or estimator.
- Explain communality estimation.
- Describe parallel analysis, MAP, scree and theory.
- State and justify rotation.
- Report the complete pattern matrix.
- Report structure matrices when substantially different.
- Report factor correlations.
- Document each deletion iteration and content rationale.
- Do not hide low coefficients in the analysis record.
- Explain factor naming.
- Describe CFA or independent validation plans.
- Identify hypothetical examples when values are not empirical.
Conclusion
Good EFA does not result from successive cutoff-based deletions. It requires an appropriate correlation matrix, factor count, extraction and rotation, followed by integrating statistics with content coverage.
Document and recheck every decision. The final solution is a stronger measurement hypothesis, not confirmation until evaluated on independent data.
References
- Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7).https://doi.org/10.7275/jyj1-4868
- Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272-299.https://doi.org/10.1037/1082-989X.4.3.272
- Finch, W. H., Immekus, J. C., & French, B. F. (2016). Applied psychometrics using SPSS and AMOS. Information Age Publishing.https://www.infoagepub.com/products/Applied-Psychometrics-using-SPSS-and-AMOS
- Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466-491.https://doi.org/10.1037/1082-989X.9.4.466
- Garrido, L. E., Abad, F. J., & Ponsoda, V. (2013). A new look at Horn's parallel analysis with ordinal variables. Psychological Methods, 18(4), 454-474.https://doi.org/10.1037/a0030005
- O'Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396-402.https://doi.org/10.3758/BF03200807
- Watkins, M. W. (2018). Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44(3), 219-246.https://doi.org/10.1177/0095798418771807
Methodological note: Loading and communality thresholds depend on context. For ordinal data, identify the correlation matrix and examine stability rather than naming software alone.
