Chapter 8 - Criminal Justice and Criminology Research Methods, 2nd Edition

Chapter 8 Survey and Interview Methods 1 Choosing the Survey: Factors to Consider Researchers use surveys to collect data for all four purposes of research: Exploratory Descriptive Explanatory Evaluative The following are example topics appropriate for survey research: Behavior Attitudes, beliefs, and opinions Characteristics Expectations Self-classification Knowledge Policies 2 The Logic of Survey Research What is a survey? Surveys sample many respondents who answer the same questions, measure many variables, test multiple hypotheses, and infer temporal order and correlation. Correlational Survey research is sometimes referred to as correlational research because it often examines which independent variables best correlate with a dependent variable. 3 Steps in Conducting a Survey Step 1 Develop hypotheses Decide on type of survey (mail, interview, telephone) Write survey questions Decide on response categories Design layout Step 2 Plan how to record data Pilot test survey instruments Step 3 Decide on target population Get sampling frame Decide on sampling size Select sample 4 Steps in Conducting a Survey Step 4 Locate respondents Conduct interviews Carefully record data Step 5 Enter data into computers Recheck all data Perform statistical analysis on data Step 6 Describe methods and findings in research report Present findings to others for critique and evaluation 5 Principles of Good Question Writing A good questionnaire forms an integrated whole. The researcher weaves questions together so they flow smoothly and in no way annoy, distract, or confuse. There are two key principles for good survey questions: Avoid respondent confusion. Have empathy (always keep the respondent’s perspective in mind). Good survey questions yield valid and reliable measures of their constructs, and help respondents feel that they understand the question. 6 Things to Avoid Avoid Jargon, Slang, and Abbreviations Avoid Ambiguity, Confusion, Vagueness Avoid Emotional Language and Prestige Bias Avoid Double-Barreled Questions Avoid Leading Questions Avoid Asking Questions That Are Beyond Respondent’s Capabilities Avoid False Premises Avoid Asking About Distant Future Intentions Avoid Overlapping or Unbalanced Response Categories 7 Getting Honest Answers Survey researchers use many techniques to increase honest answering to questions about sensitive topics: Establish a comfortable setting before asking questions. Use an enhanced phasing of questions. Ask respondents about other people’s involvement in an activity rather than their own. 8 Open-Ended and Closed-Ended Questions Advantages of open-ended questions: Permit an unlimited number of possible answers. Respondents can answer in detail and can qualify and clarify responses. Unanticipated findings can be discovered. Disadvantages of closed-ended questions: Different respondents give different degrees of detail in answers. Responses may be irrelevant or buried in useless detail. Comparisons and statistical analysis become very difficult. 9 Advantages of Open-Ended Questions: They permit an unlimited number of possible answers. Respondents can answer in detail and can qualify and clarify responses. Unanticipated findings can be discovered. Disadvantages of Open-Ended Questions: Different respondents give different degrees of detail in answers. Responses may be irrelevant or buried in useless detail. Comparisons and statistical analysis become very difficult. Open-Ended and Closed-Ended Questions Advantages of Closed-Ended Questions: It is easier and quicker for respondents to answer. The answers of different respondents are easier to compare. Answers are easier to code and statistically analyze. Disadvantages of Closed-Ended Questions: They can suggest ideas that the respondent would not otherwise have. Respondents with no opinion or no knowledge can answer anyway. Respondents can be frustrated because their desired answer is not a choice. Open-Ended and Closed-Ended Questions Nonresponses Researchers have identified five types of nonresponse: Nonlocation (could not find a sampled respondent) Noncontact (respondent was not at home or not reached after many attempts) Ineligible (respondent was reached but was not the proper age, race, sex, etc. for the survey responses) Refusal to participate (respondent was not willing to be interviewed) Incomplete participation (respondent stopped answering before the end or began answering every question with “do not know” or “no opinion”) 12 Mail and Self-Administered Questionnaires Advantages Cheapest Can be conducted by a single researcher Questionnaires can be sent to wide geographical areas Respondent can complete the questionnaire when convenient and check records if necessary Offer anonymity and avoid interviewer bias Disadvantages Low response rates Researchers cannot control the conditions under which mail questionnaires are completed The format limits the kinds of questions that a researcher can use Ill-suited for the illiterate 13 Face-to-Face Interviews Advantages Highest response rate Longest questionnaires Have the advantages of the telephone interview and interviewers can observe the surroundings and can use nonverbal communication and visual aides Disadvantages High cost (training, travel, supervision, etc.) Interviewer bias 14 Telephone Interviews Advantages 95% of the population can be reached by telephone Respondents can be quickly reached, even across long distances Same strength as a face-to-face interview, but for about half the cost Technology Disadvantages High cost Limited interview length Respondents without telephones are impossible to reach Cell phones and Internet phones are rapidly changing availability Use of an interviewer reduces anonymity and may have bias Open-ended questions are difficult to use Use of visual aides is impossible 15 Web Surveys Advantages Fast and inexpensive Flexible design Can use visual (and audio or video) images Disadvantages Coverage (unequal access and use of the Internet) Privacy and Verification Design Issues (Web software and hardware compatibility) 16 Interviewing Survey Research Interviewing A special type of interviewing designed to obtain specific and accurate quantitative-based information. 17 Stages of an Interview The interview begins with an introduction and entry. The key part of interviewing consists of asking and recording questions. The interviewer uses the exact wording on the questionnaire. The interviewer also knows how and when to probe. The last stage of the interview is the exit, when the interviewer thanks the respondent and leaves to a private place to edit the questionnaire and record details of the interview and respondent. Ethical Survey Research People can conduct surveys in ethical or unethical ways. Major ethical issues involved in survey research include: Invasion of privacy Voluntary participation by respondents Mass reporting of survey results 19