Common Method Variance: Recognition and Prevention Through Research Design

Common method variance is variance associated with the measurement method rather than the intended construct. No single post hoc test proves that data are completely unaffected.

CMV, CMB AND SURVEY DESIGNPrepared by Lê Minh4 minUpdated 16/10/2026

KEY ARGUMENT

Prioritize design remedies: separate sources/occasions, protect anonymity, improve questions and reduce demand characteristics. After collection, combine suitable marker, CFA/UMLV, CLF or sensitivity approaches instead of relying on Harman’s test or VIF alone.

Start reading

CMV: prevention and diagnosis have distinct roles

Design
Sources, wording and question order
Collection
Procedures and response context
Diagnosis
Combine relevant evidence
Reporting
State measures and limitations

Conceptual diagram. One test cannot establish that a dataset is entirely free of CMB.

Source: Lê Minh · Conceptual illustration, not software output.

1. CMV and CMB are not identical

CMV describes variance attributable to shared measurement sources, such as the same respondent, time, format or wording. CMB is bias in estimated relationships caused by these methodological sources (Podsakoff et al., 2003, 2012).

CMV can increase or decrease correlations depending on its mechanism; collecting data in one questionnaire does not mean every coefficient is inflated.

Table 1
Source	Example	Precollection remedy
Same respondent	Self-reported X and Y	Use different data sources where feasible
Same occasion	A single survey	Temporal/psychological separation
Item wording	Ambiguous, leading or negative wording	Pilot and use neutral wording
Response context	Fear of evaluation	Anonymity and reduced evaluation apprehension

2. Prevention is preferable to post hoc testing

Map method sources

Identify the respondent, occasion, channel and format for each variable.

Separate sources or occasions

When theory permits, obtain predictors and outcomes from different sources or occasions.

Improve items

Avoid double-barreled, ambiguous and leading questions; use reversed items cautiously.

Protect respondents

Ensure anonymity and emphasize that there are no right or wrong answers.

Prespecify post hoc assessment

Choose marker/CLF/UMLV/sensitivity approaches before examining results.

3. Post hoc procedures answer different questions

Table 2
Procedure	Strengths	Limitations
Harman single-factor	Easy to implement	Low detection ability; does not estimate bias
Marker variable	Linked to a measured method source	Depends on a valid marker
CLF/UMLV	Models item-level variation	A common factor can absorb misspecified substantive content
Full collinearity VIF	Compact score-level diagnostic	Does not rule out CMB
Measured method factor	More specific about the mechanism	Requires advance planning

No single clean/unclean test

A result below a cutoff is one piece of evidence. Examine how much the main relationships change under plausible method models.

*Application screenshot 1. One-factor analysis settings in the original SPSS screenshot. This limited post-hoc procedure does not establish that data are entirely free of CMV or CMB.* Source: amosleminh.com · View full size

4. Reporting template

Reporting example in English

CMV risk was reduced through [anonymity/source separation/temporal separation/item design]. After collection, we used [procedure] because [justification]. Relative to the baseline model, [coefficients/CIs/R²] changed by [ ]. Conclusions were [stable/sensitive], but this was not interpreted as proof of a complete absence of CMB.

Distinguish CMV from CMB.
Use design remedies before collection.
Do not rely on Harman’s test alone.
Do not treat CLF/VIF as a definitive test.
Report sensitivity of the main relationships.
State the limitations of same-source data.

Conclusion

CMV is a design issue before it is a software issue. A convincing approach combines deliberate prevention with transparent sensitivity analysis.

References

Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.https://doi.org/10.1037/0021-9010.88.5.879
Podsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2012). Sources of method bias in social science research and recommendations on how to control it. Annual Review of Psychology, 63, 539–569.https://doi.org/10.1146/annurev-psych-120710-100452

Methodological note: CMV and CMB are often conflated. Describe the specific risk mechanism rather than merely stating that CMB was tested.