Research Instrument and data collection Technique

1 1 Research Instrument development and data collection Technique Asst. Prof. Dr. Hashima E Nasreen Contents Steps in questionnaire design How to develop a Research Instrument Concepts of validity Types ad measurement of reliability How to construct data dictionary 2 Steps in questionnaire designing S1 Purpose & goal Objectives Research questions Hypothesis Knowledge Attitude Opinion Behavior Facts Questionnaire format data analysis Generate: Statement Questions Items Variables: DV, IV, MV S2 Appropriate scales of measurement S3 BACKGROUD CONCEPTUALIZATION QUESTIONNAIRE FORMAT Panel of expert Readability test IRB Field test Revision & readability test S4 ESTABLISH VALIDITY Pilot test Reliability Run Revision Rerun Instrument ready for mailing ESTABLISH RELIABILITY What is a Research Instrument The Paper/document on which data is collected in called Research Instrument .

2 Form with no questions-only points for recording particular information check list used to observed some situation, put tick marks against the particular point questionnaire - all information is collected by putting questions Interviewer-administered questionnaire Self-administered questionnaire 3 TYPES OF QUESTIONS Open-ended questions (Unstructured) Closed questions (Structured) Semi-structured questionnaires (containing completely open as well as partially pre-categorized and closed questions) OPEN-ENDED QUESTIONS Such questions are useful for obtaining in-depth information on: opinions, attitudes and suggestions of informants, or sensitive issues. For example: What is your opinion on the services provided in the ANC? (Explain why.) What do you think are the reasons some adolescents in this area start using drugs?

3 The answers to these questions are written down as closely as possible in the words of the respondents. 4 Advantages of completely open-ended questions Allow you to probe more deeply into issues of interest being raised. Issues not previously thought of when planning the study may be explored, thus providing valuable new insights on the problem. Information provided in the respondents own words might be useful as examples or illustrations, which add interest to the final report. Often, re-reading an answer in a later phase of the analysis offers the possibility for different interpretations in relation to other data collected, which would have been impossible if the answer had been pre-categorised. Risks of completely open-ended questions Skilled interviewers are needed to get the discussion started and focused on relevant issues and to record all information collected.

4 A big risk is incomplete recording of all relevant issues covered in the discussion. Analysis is time-consuming and requires experience; otherwise important data may be lost. 5 Closed / Structure questions CLOSED QUESTIONS have a list of possible options or answers from which the respondents must choose. Advantages of closed questions: It saves time Comparing responses of different groups, or of the same group over time, becomes easier Risks of closed questions: In case of illiterate respondents, the interviewer may be tempted to read the list of possible answers in the given sequence, thereby influencing the choice of response and introducing bias. For example: What is your opinion on the following statement Women who have induced abortion should be severely punished. 6 For example: Did you eat any of the following foods yesterday?

5 (Circle yes if at least one item in each set of items is eaten CHECKLISTS 7 Prerequisite for developing a Research Instrument Before developing a Research Instrument : Hypothesis, objectives and all variables of interest should be known Operational definitions of the variables should be clear and stated Decision about scaling or categories of the variables should be made Qualities of a Good questionnaire The questionnaire should be of appropriate length (20-30 minutes acceptable) Question should be relevant to the hypothesis Question should be in specific, not vague Language of the question should be simple and clear Layout is easy to read and pleasant to eye Sensitive questions must be worded exactly Double barreled questions should be avoided 8 Points to be noted for designing a Questionnaire Follow your hypotheses & objectives and to determine the content of your questions Make sure your questions are valid.)

6 The question must ask for information which the respondent is capable of providing an informed response Make the question as specific as possible Ask others to review and proofread your survey Always pretest Make instructions as clear as possible. The quality of your Research depends on the quality of your questionnaire Quantitative Instruments (Wording Questions) Do not use leading questions that suggest a particular answer or the researcher s viewpoint , Why does working in the public sector make people lazy and careless?) Do not use loaded questions that bias people towards particular answers , Do you think it is important to have a strong police force in this time of crisis?) Beware of double-barreled questions. Rephrase them into two questions whenever possible , Should the government reduce its financial help and its technical assistance to other countries?

7 Avoid double negatives ( , not prohibit), they can be confusing. If absolutely necessary, emphasize the not by underlining it 9 OVERVIEW OF data collection TECHNIQUES data - collection techniques allow us to Systematically collect information about our objects of study (people, objects, phenomena) and about the settings in which they occur. In the collection of data we have to be systematic. If data are collected haphazardly, it will be difficult to answer our Research questions in a conclusive way Various data collection techniques Using available information Observing Interviewing (face-to-face) Self administering questionnaires Focus group discussions Measurement 10 Using available information Usually there is a large amount of data that has already been collected by others, although it may not necessarily have been analyzed or published For example, analysis of the information routinely collected by health facilities can be very useful for identifying problems in certain interventions or in flows of drugs supply, or for identifying increases in the incidence of certain diseases.

8 Analysis of health information system data , census data , unpublished reports and publications in archives and libraries or in offices at the various levels of health and health-related services, may be a study in itself. OBSERVATION It is a Technique that involves systematically selecting, watching and recording behaviour and characteristics of living beings, objects or phenomena. Observation of human behaviour is a much-used data collection Technique . It can be undertaken in different ways. Participant observation: The observer takes part in the situation he or she observes. (For example, a doctor hospitalized with a broken hip, who now observes hospital procedures from within). Non-participant observation: The observer watches the situation, openly or concealed, but does not participate. 11 Interview An INTERVIEW is a data - collection Technique that involves oral questioning of respondents, either individually or as a group.

9 Administering written questionnaires Self-administered questionnaire is a data collection tool in which written questions are presented that are to be answered by the respondents in written form. A written questionnaire can be administered in different ways, such as by: Sending questionnaires by mail with clear instructions on how to answer the questions and asking for mailed responses; Gathering all or part of the respondents in one place at one time giving oral or written instructions , and letting the respondents fill out the questionnaires; or Hand-delivering questionnaires to respondent and collecting them later. Parts of a questionnaires title: Clear and brief Introductory remark identification number questions ending 12 23 Designing Questionnaires Orient the respondent First, briefly describe the purpose of the Research study, explain how data gathered by the survey will be used, and by whom it will be used.

10 Is the survey confidential or anonymous? requesting the informant s consent to be interviewed and assuring confidentiality of the data obtained. 24 Designing Questionnaires First Questions The first several questions should be relevant to the study itself so that the respondent quickly understands what the survey is about and becomes engaged. The first questions should be straightforward with relatively few categories of response. 13 25 Designing Questionnaires Middle Questions Respondents should be eased into sensitive topics by asking them what they think is important or what they do prefer. Do not first ask respondents to agree or disagree with a position or sensitive issue. 26 Designing Questionnaires Sequence your questions logically! Questions should be grouped in sections Each section should have a logical sequence Avoid making the respondent jump around mentally Help respondents shift gears by introducing a new section.