CHAPTER 3: RESEARCH METHODOLOGY
3.4 Data collection tools
3.4.5 Validity and reliability of tools
Quantitative tools: Validity of the quantitative tools was tested for face and content validity. Validity refers to the degree to which the outcomes of the research can be attributed to the manipulated, independent variable rather then to uncontrolled
53 extraneous factors (Brink et al, 2012). Face validity refers to a tool measuring what it supposes measure (Brink, 2003). Face validity was evaluated by providing the questionnaire, check-list and usage record sheet to evaluation and clinical specialists to approve. A clinical research expert and the ethical committee were used to ensure face validity. Content validity refers to how well the instrument represents all the components of the variable to be measured (Brink, 2003). Content Validity was established by relating the tools to the evaluation framework for process evaluations (Table 2).
Reliability was established by doing a pilot study where the tools were given to fourth year students (basic program) to evaluate the tool. No changes were made as the criteria were met. These students were selected for the pilot study as they did not make use of the clinical skills laboratory throughout their academic year, but have sustained knowledge through their three years of prior training in both the clinical setting and the usage of the clinical skills laboratory. The third and fourth year nursing students did not necessarily complete their first and second year training at the Private Nursing School and therefore brought more insight to the pilot study by bringing outside experience to the questionnaire used. To ensure reliability in the checking of equipment, the equipment was examined and evaluated by both the researcher and a second colleague independent from one another. The second evaluator was also briefed.
54 Table 2: Table of content validity process for tool development
Objective Tool Model
To evaluate the first and second year basic students’
satisfaction with the quality and availability of the equipment
Questionnaire for students - q7, q8 and q9
Satisfaction
Quality of equipment
To evaluate the first and second year basic students’
satisfaction with the support received when using the laboratory
Questionnaire for students -q3, q4, q5, q14, q15 and q16
Satisfaction Reach
Program implemented To evaluate the first and
second year basic students’
satisfaction with the clinical lab assisting their learning of clinical skills
Questionnaire for students - q6, q11, q12, q13, q17,q18, q19, q20, q21and q22
Satisfaction Reach
Program implemented To evaluate the support staff
satisfaction with the quality and availability of clinical equipment
Interview – Clinical facilitators -q3, q4, q5
Satisfaction
Quality of equipment To evaluate the support staff
satisfaction with the clinical laboratory assisting their learning of clinical skills
Interview – Clinical facilitators -q6, q7, q8, q9
Satisfaction
Program implemented
To evaluate the equipment used in the clinical skills laboratory to gain
competence and clinical skills in terms of:
• Quality
• Availability
• Usage
Check-list was used to rate
the equipment and usage Quality of equipment
To evaluate the usage of the clinical skills laboratory over a six month period.
Spreadsheet was used to capture the usage of clinical skills laboratory
Reach
55 Semi-structured open ended interview schedule: ‘Trustworthiness’ was maintained by the researcher which includes credibility, transferability, conformability and dependability (Polit & Beck, 2004). Polit and Beck (2004) refer to trustworthiness as evidence that is consistent and stable (dependability), the degree to which study results are derived from participants (confirmability), the extent that the research methods engenders confidence in the truth of the data (credibility) and the extent to which findings can be transferred to other settings or groups (transferability). All questions were asked to all four clinical facilitators to ensure consistency.
This research project adopted Guba’s Model to maintain trustworthiness in the qualitative research. Guba’s model of trustworthiness provides rigor to the research without sacrificing the relevance of the research. According to Krefting (1991) there are four criteria to Guba’s model of trustworthiness which includes:
• Truth value: this establishes how confident the researcher is with the truth of the findings based on the research design. Accurate descriptions or interpretation of human experience that people would also share that experience would immediately recognize the descriptions. This was established by the researcher by actually doing the interview sessions and recoding the interview sessions by a tape recorder and writing down notes. The researcher was not part of the clinical facilitator division and did not influence the results that were collected.
56
• Applicability: it is the degree to which the findings can be applied to other contexts and settings. The researcher ensured that enough information was gathered to allow comparison to other studies.
• Consistency: This refers to the findings, as to whether they would be consistent if the inquiry was repeated with the same subjects. The whole experience of the subjects whether it is normal or not needs to be included in the results. The researcher conducted a pilot study to evaluate the tool and get feedback from the participants. This was also done to ensure consistency.
• Neutrality: This refers to the freedom from bias in the research procedure and results. Neutrality is achieved when truth value and applicability is achieved.
The researcher ensured that trustworthiness was maintained throughout the research procedure by following the above criteria.