Chapter 4: Data Analysis
4.10 Reliability Analysis
Cronbach’s alpha was used to determine the reliability of the hypothesized factors for the study. Scores over 0.6 indicate statistical reliability (Hulin et al., 2001; Konting et al., 2009). That is, scores from 0.6 to 0.7 indicate an acceptable level of reliability, and those over 0.8 reflect very good reliability (Konting et al., 2009). The scores for questions aligned with each of the two Likert scales from the May 2021 and June 2022 data collection period are displayed below.
The reliability analysis of the constructs is valuable for various reasons, including the improvement of the methodological robustness, the ability to conduct effective research, the provision of solidity to the triangulation of outcomes, and the facilitation of a comprehensive discussion of the subject of the investigation (Hair et al., 2014).
The item-to-total correlation was used to assess reliability in this study, so any construct indicator with low correlations could be removed unless it generated an additional domain of interest. Most researchers employ this method to ensure the dependability of a multi-item construct (May, 1997). The procedure creates a construct comprising items that share a common core (May, 1997). If the item is to be retained for further
analysis, it should have an item-to-total correlation score of 0.30 or higher at this stage (Cooper & Emory, 1995).
The average correlation among items is also used to assess the consistency of items reflecting a construct. Internal consistency is calculated using the basic formula by calculating the alpha coefficient (Cronbach’s alpha) (Nunnally & Bernstein, 1978). This method yields an accurate estimate of reliability. Nunnally and Bernstein (1978) propose that an alpha value of 0.60 is a reliable indicator.
Tables 11 and 12 present the results of the reliability analyses for the various measurement constructs in the pre-intervention and post-
intervention surveys: OHS Hazards, OHS Policies and Procedures, OHS Awareness, and OHS Participation. The item-to-total correlation and alpha coefficients served as the foundation for determining the constructs’
reliability. They are accepted as appropriate techniques for measuring reliability in the social science domain (Price & Muller, 1986).
Item-to-total correlations were high for all indicators except one from each period (greater than the cutoff point of 0.30). One item in the OHS Participation section (At my workplace, if my work environment was unsafe, I would not say anything and hope that the situation eventually improves [reverse scored]) had a pre-intervention item-to-total correlation of 0.117 (0.015). (post-intervention). As a result, it was dropped from further consideration. As shown in the last column of Tables 9 and 10, the reliability coefficients for the pre-intervention (post-intervention) survey ranged between 0.796 (0.765) and 0.922 (0.941), well above the cutoff point of 0.60 (Nunnally & Bernstein, 1978). These results show that reliable measures were used in this study. Tables 11 and 12 show the reliability coefficient and item-total correlations for all research variables.
Table 11: Pre-Intervention Reliability Analysis
Item Code Variable Item-Total
Correlation
Cronbach’s Alpha Pre-Intervention Occupational Health and Safety Hazards 0.805
PreHazard1
In your job, how often do you manually lift, carry, or push items heavier than 20 kg at least 10 times during the day?
0.551
PreHazard2
In your job, how often do you do repetitive movements with your hands or wrists (packing, sorting, assembling, cleaning, pulling, pushing, typing) for at least 3 hours during the day?
0.318
PreHazard3
In your job, how often do you perform work tasks, or use work methods, that you are not familiar with?
0.414 PreHazard4
In your job, how often do you interact with hazardous substances such as chemicals, flammable liquids, and gases?
0.546 PreHazard5 In your job, how often do you work in a bent,
twisted, or awkward work posture? 0.589 PreHazard6
In your job, how often do you work at a height that is 2 meters or more above the ground or floor?
0.564
PreHazard7
In your job, how often do you work in noise levels that are so high that you must raise your voice when talking to people less than one meter away?
0.606
PreHazard8 In your job, how often do you experience being
bullied or harassed at work? 0.424
PreHazard9 In your job, how often do you stand for more
than 2 hours in a row? 0.576
Pre-Intervention Occupational Health and Safety Policies and Procedures 0.894
PrePolicy1
At my workplace, everyone receives the necessary workplace health and safety training when starting a job, changing jobs, or using new techniques
0.694
PrePolicy2
At my workplace, there is regular communication between employees and management about safety issues
0.755 PrePolicy3 At my workplace, systems are in place to
identify, prevent, and deal with hazards at work 0.695 PrePolicy4
At my workplace, health and safety are considered to be at least as important as production and quality
0.525 PrePolicy5
At my workplace, there is an active and effective health and safety committee or worker health and safety representative
0.733
Table 11: Pre-Intervention Reliability Analysis (Continued)
Item Code Variable Item-Total
Correlation
Cronbach’s Alpha
PrePolicy6
At my workplace, incidents and accidents are investigated quickly to improve workplace health and safety
0.731 PrePolicy7
At my workplace, communication about workplace health and safety procedures is done in a way that I can understand
0.744
Pre-Intervention Occupational Health and Safety Awareness 0.922
PreAware1
At my workplace, I am clear about my rights and responsibilities regarding workplace health and safety
0.78
PreAware2
At my workplace, I am clear about my employers’ rights and responsibilities regarding workplace health and safety
0.787 PreAware3 At my workplace, I know how to perform my
job in a safe manner 0.777
PreAware4
At my workplace, if I became aware of a health or safety hazard at my workplace, I know whom (at my workplace) I would report it to
0.781 PreAware5
At my workplace, I have the knowledge to assist in responding to any health and safety concerns
0.72 PreAware6 At my workplace, I know the necessary
precautions to take while doing my job 0.822
Pre-Intervention Occupational Health and Safety Participation 0.796
PreParticipate1
At my workplace, I feel free to voice concerns or make suggestions about workplace health and safety
0.658
PreParticipate2 At my workplace, if I notice a workplace
hazard, I would point it out to the management 0.67 PreParticipate3
At my workplace, I know that I can stop work if I think something is unsafe and management will not give me a hard time
0.642
PreParticipate4 (Removed)
At my workplace, if my work environment was unsafe, I would not say anything and hope that the situation eventually improves (reverse scored)
0.117 (Excluded
from Cronbach’s
Alpha) PreParticipate5 At my workplace, I have enough time to
complete my work tasks safely 0.474
Table 12: Post-Intervention Reliability Analysis
Item Code Variable Item-Total
Correlation
Cronbach’s Alpha Post-Intervention Occupational Health and Safety Hazards 0.765
PostHazard1
In your job, how often do you manually lift, carry or push items heavier than 20 kg at least 10 times during the day?
0.515
PostHazard2
In your job, how often do you do repetitive movements with your hands or wrists (packing, sorting, assembling, cleaning, pulling, pushing, typing) for at least 3 hours during the day?
0.348
PostHazard3
In your job, how often do you perform work tasks, or use work methods, that you are not familiar with?
0.415 PostHazard4
In your job, how often do you interact with hazardous substances such as chemicals, flammable liquids, and gases?
0.377 PostHazard5 In your job, how often do you work in a
bent, twisted, or awkward work posture? 0.429 PostHazard6
In your job, how often do you work at a height that is 2 meters or more above the ground or floor?
0.589
PostHazard7
In your job, how often do you work in noise levels that are so high that you have to raise your voice when talking to people less than one meter away?
0.593 PostHazard8 In your job, how often do you experience
being bullied or harassed at work? 0.369 PostHazard9 In your job, how often do you stand for more
than 2 hours in a row? 0.536
Post-Intervention Occupational Health and Safety Policies and Procedures 0.921
PostPolicy1
At my workplace, everyone receives the necessary workplace health and safety training when starting a job, changing jobs, or using new techniques
0.723
PostPolicy2
At my workplace, there is regular communication between employees and management about safety issues
0.754 PostPolicy3
At my workplace, systems are in place to identify, prevent, and deal with hazards at work
0.779 PostPolicy4
At my workplace, workplace health and safety are considered to be at least as important as production and quality
0.664 PostPolicy5
At my workplace, there is an active and effective health and safety committee or worker health and safety representative
0.783 PostPolicy6
At my workplace, incidents and accidents are investigated quickly to improve workplace health and safety
0.779 PostPolicy7
At my workplace, communication about workplace health and safety procedures is done in a way that I can understand
0.813
Table 12: Post-Intervention Reliability Analysis (Continued)
Item Code Variable Item-Total
Correlation
Cronbach’s Alpha Post-Intervention Occupational Health and Safety Awareness 0.941
PostAware1
At my workplace, I am clear about my rights and responsibilities regarding workplace health and safety
0.844 PostAware2
At my workplace, I am clear about my employers’ rights and responsibilities regarding workplace health and safety
0.838 PostAware3 At my workplace, I know how to perform
my job in a safe manner 0.812
PostAware4
At my workplace, if I became aware of a health or safety hazard at my workplace, I know whom (at my workplace) I would report it to
0.83
PostAware5
At my workplace, I have the knowledge to assist in responding to any health and safety concerns
0.777 PostAware6 At my workplace, I know the necessary
precautions to take while doing my job 0.832
Post-Intervention Occupational Health and Safety Participation 0.825
PostParticipate1
At my workplace, I feel free to voice concerns or make suggestions about workplace health and safety at my job
0.7
PostParticipate2
At my workplace, if I notice a workplace hazard, I would point it out to the management
0.72 PostParticipate3
At my workplace, I know that I can stop work if I think something is unsafe and management will not give me a hard time
0.697
PostParticipate4 (Removed)
At my workplace, if my work environment was unsafe, I would not say anything and hope that the situation eventually improves (reverse scored)
0.015 (Excluded
from Cronbach’s
Alpha) PostParticipate5 At my workplace, I have enough time to
complete my work tasks safely 0.51