Methods of validating questionnaire
The second review should come from someone who is an expert on question construction, ensuring that your survey does not contain common errors such as leading, confusing or double-barreled questions.Step 2: Run a Pilot Test Select a subset of your intended survey participants and run a pilot test of the survey.
Dave Collingridge noticed the same phenomenon when he was a social sciences graduate student unable to find a professor or other faculty member who would or could help him with survey validation.Your overall goal at this stage is to determine what the factors represent by seeking out common themes in questions that load onto the same factors.You can combine questions that load onto the same factors, comparing them during your final analysis of data.Like PCA, CA can be complex and most effectively completed with help from an expert in the field of survey analysis.Step 6: Revise Your Survey The final stage of the validation process is to revise your survey based on the information you gathered from your principal components analysis and Cronbach’s Alpha.If you’ve used a five-point scale and you see a response indicating the number six, you may have an error with data entry.
Step 4: Use Principal Components Analysis (PCA) Principal components analysis, or PCA, allows you to identify underlying components that are being measured by your survey questions.
These are known as factor loadings, and questions point back to the same elements should load into the same factors. Solid values to look for are factor loadings of 0.6 or above.
You’ll occasionally run across questions that don’t appear to load onto any factors, which may necessitate a question removal or separate analysis.
You can review the internal consistency with a standard test known as Cronbach’s Alpha (CA).
Test values range from 0 to 1.0, and values should generally be at least 0.6 to 0.7 or higher to indicate internal consistency.
Because there are multiple, tough-to-control factors that can influence the dependability of a question, validating a survey is neither a quick nor easy task.