O R I G I N A L R E S E A R C H P A P E R
Validity and reliability of the Indonesian version of the Pittsburgh Sleep Quality Index in adolescents
Anggi Setyowati Ners, MSc, Doctoral Student
1,2| Min-Huey Chung RN, PhD, Professor
2,31Public Health Faculty, Universitas Airlangga, Surabaya, Indonesia
2School of Nursing, College of Nursing, Taipei Medical University, Taipei, Taiwan, ROC
3Department of Nursing, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan, ROC
Correspondence
Min-Huey Chung, School of Nursing, College of Nursing, Taipei Medical University, 250 Wu-Xing Street, Taipei 110, Taiwan, ROC.
Email: [email protected]
Abstract
Aim:
The study aims to examine the psychometric properties of the Pittsburgh Sleep Quality Index-Indonesian version.
Background:
The Pittsburgh Sleep Quality Index has never been translated into Bahasa.
Design:
This study employs a cross-sectional and correlational study.
Methods:
Data were collected from 528 adolescents of junior high school age (13
–- 16 years) during August to September 2014. All participants agreed on the Indone- sian version of Pittsburgh Sleep Quality Index and Beck Depression Inventory-II.
Psychometric properties were examined including internal consistency, construct validity and known group validity, and the receiver operating characteristic curve was used to measure the cut-off point.
Results:
The Cronbach's alpha for the Pittsburgh Sleep Quality Index-Indonesian ver- sion was adequate. There were positive correlations between the total score and seven component scores. Construct validity revealed that the total score of the Pittsburgh Sleep Quality Index-Indonesian version was correlated with the total score of the Indonesian version of the Beck Depression Inventory-II. Known group validity indicated that adolescents without depression risk had better sleep quality.
According to receiver operating characteristic curve analysis, the cut-off point at a score of 6.5 indicated the best possible relationship of sensitivity and specificity.
Conclusion:
The Pittsburgh Sleep Quality Index-Indonesian version has high reliabil- ity and validity for screening sleep quality among adolescents.
K E Y W O R D S
adolescent, questionnaire, sleep disturbances, sleep quality, validation
S U M M A R Y S T A T E M E N T
What is already known about this topic?
• The original Pittsburgh Sleep Quality Index has adequate internal consistency and favourable reliability.
• It is easy for patients and health-care providers to use for inter- preting sleep disturbances.
What this paper adds?
•
The results support the validity and reliability of the Pittsburgh Sleep Quality Index-Indonesia in screening sleep quality among adolescents.
• The cutoff score for the Pittsburgh Sleep Quality Index-Indonesian version for adolescents was 6.5.
Int J Nurs Pract.2020;e12856. wileyonlinelibrary.com/journal/ijn © 2020 John Wiley & Sons Australia, Ltd 1 of 7 https://doi.org/10.1111/ijn.12856
The implications of this paper:
• The cut-off point could detect poor sleep quality among Indone- sian adolescents.
• This simple tool is capable of quickly assessing sleep quality for health-care providers.
1 | I N T R O D U C T I O N
Sleep disturbance in adolescents is not rare (Danielsson, Harvey, MacDonald, Jansson-Fröjmark, & Linton, 2013) and has been associated with sleep quality (LeBourgeois, Giannotti, Cortesi, Wolfson, & Harsh, 2005). Adolescents in Europe, Asia and the United States have multiple behaviours that influence sleep quality, such as difficulty going to bed, falling asleep, getting undisturbed sleep and waking up in the morning (LeBourgeois, Giannotti, Cor- tesi, Wolfson, & Harsh, 2004). Haryono et al. (2016) observed that 62.9% of adolescents aged 12–15 years who live in Indonesia, especially in East Jakarta, have sleep disorders and 72.9% have dif- ferences in their awake and sleep times between weekdays and weekends.
Poor sleep quality can affect adolescents' concentration, atten- tion, memory and physical and mental health (Suen, Tam, &
Hon, 2010). Furthermore, among adolescents, poor sleep is associated with emotional disturbance (Roberts, Roberts, & Chen, 2002), nega- tive mood (Lund, Reider, Whiting, & Prichard, 2010) and depression (Owens & Adolescent Sleep Working Group, 2014). Adolescents are often unaware that sleep disturbances influence their health. There- fore, an appropriate tool to measure the sleep quality among adoles- cents is relevant to conduct rapid screening inthe clinical settings to improve sleep quality (Tzeng, Fu, & Lin, 2012).
Sleep quality is a crucial factor related to sleep (Buysse, Reynolds, Monk, Berman, & Kupfer, 1989). The quantitative aspects of sleep comprise various domains such as sleep duration, sleep latency and number of arousals, and the purely subjective aspects include the depth or restfulness of sleep (Krystal & Edinger, 2008). In this study, the Pittsburgh Sleep Quality Index (PSQI) was used to determine self- reported sleep quality and sleep disturbances for the preceding month. The original PSQI has adequate internal consistency and favourable test–retest reliability (Buysse et al., 1989). It is a consistent and easy for patients and health-care providers in interpreting the indicators of sleep quality (Buysse et al., 1989; Mollayeva et al., 2016).
2 | M E T H O D S 2.1 | Aim
The PSQI has never been translated into Bahasa, and no study has been conducted to evaluate the psychometric efficiency of the PSQI- Indonesian version (PSQI-I). The aim of this study was to develop the
psychometric efficiency of the PSQI-I, including translation, validation, reliability and cut-off point, in assessing Indonesian adolescents.
2.2 | Participants and settings
This study employed a cross-sectional and correlational design, using self-reported questionnaires. Data were collected from adolescents who lived at a junior high school, Darul Ulum Islamic Boarding School.
The inclusion criteria were junior high school students who lived in a dormitory and had no history of psychiatric or neurological disorders.
The exclusion criteria were students whose parents disapproved of their participation in this study and students who did not provide informed consent. Previous study recommended that 60% response rate (Dong & Peng, 2013). The final sample has a total of 528 adoles- cents, with a 75% response rate.
2.3 | Instruments
2.3.1 | Beck Depression Inventory-II
The Beck Depression Inventory (BDI)-II was created by Aaron T. Beck (Beck, Steer, & Brown, 1996). Each adolescent was assessed using the Indonesian version of the BDI-II (Indo BDI-II; Ginting, Näring, van der Veld, Srisayekti, & Becker, 2013). The BDI-II is a valid measure of depression in the Indonesian general population. The BDI-II has 21 items, each scored from 0 to 3. The total score of the BDI-II ranges from 0 to 63, and the cut-off point of for the Indo BDI-II is 17. It has a high coefficient alpha (0.90). For validity, the BDI is more closely asso- ciated with the diagnostic criteria for depression (Beck et al., 1996).
The convergent validity of the Indo BDI-II is acceptable (Ginting et al., 2013). BDI-II had three dimensions: Items 1–3, 5–9 and 14 rep- resenting cognitive; Items 4, 10, 12 and 13 representing affective; and Items 11 and 15–21 representing somatic (Titov et al., 2011). In this study, Item 21 was excluded based on suggestion made by the ethics committee and the head of the boarding school. They considered age, religion and culture that prohibited to conduct sexual activity before marriage. The Cronbach's alpha for the Indo BDI-II was 0.82 (Items 1–20) in this study.
2.3.2 | Pittsburgh Sleep Quality Index
The PSQI was designed by Daniel J. Buysse (Buysse et al., 1989). The PSQI is used to measure self-reported sleep quality and sleep distur- bances during the preceding month. It is a 19-item test and consists of seven components: (1) subjective sleep quality, (2) sleep latency, (3) sleep duration, (4) sleep efficiency, (5) sleep disturbance, (6) sleeping medication use and (7) daytime dysfunction. Each component is scored from 0 to 3, and the total score ranges from 0 to 21, with a lower score (<5) indicating favourable sleep quality. The PSQI has adequate internal consistency (Cronbach alpha = 0.73) (Buysse et al., 1989).
2.4 | Ethical considerations
This study was approved by the ethics committee of Universitas Airlangga, Indonesia (number: 1190/UN3.14/LT/2014).
2.5 | Procedures
Data were collected from August to September 2014. Permission to use the PSQI was granted by the original inventors. The final English version of the PSQI was translated into Bahasa based on the World Health Organization guidelines (World Health Organization, 2014).
The guidelines were implemented as follows:
1. Forward translation: One expert translator who was familiar with the terminology of this instrument and knew English but whose mother tongue was Bahasa translated the PSQI into Bahasa.
2. Expert panel: Two experts, namely, a mental health nurse and com- munity nurse, reviewed the PSQI after translation into Bahasa.
3. Back translation: The instrument was translated back to English by a professional translator.
4. Pretesting and cognitive interviewing: A pilot study was conducted in which 10 adolescents were recruited to examine whether the Indonesian questionnaire was easily understood by adolescents.
5. Final version.
After finalizing the questionnaire, the researcher requested the Islamic boarding school for permission to conduct the research. After obtaining permission from the leader and headmaster of the school, the researcher introduced and explained the study to the participants.
Next, informed consent forms were distributed to the participants to be given to their parents or guardians for approval to participate in the study. The next day, participants who were granted permission by their parents or guardians were given the research questionnaire in sealed envelopes. The participants were allowed to withdraw from the study at any time even after reading the questionnaire. After a stipulated time, the participants were asked to return their question- naires in the envelopes provided. These envelopes ensured answer confidentiality.
2.6 | Statistical analyses
All analyses were conducted using SPSS (Version 22) for Windows. A P< 0.05 was considered statistically significant. Descriptive statistics were used to evaluate all variables. The Cronbach's alpha for each item of the PSQI-I and the item-total correlations, which were calcu- lated using the Pearson-moment correlation coefficient between seven component score and a total score of the PSQI-I (Kline, 1986), were used to measure internal consistency. Testing hypothesized rela- tionships based on a theory or previous research can be used to eval- uate construct validity (DeVellis, 2003; Pedhazur & Schmelkin, 1991).
In this study, we hypothesized that depression would be negatively
correlated with sleep quality (Borbély & Wirz-Justice, 1982). Known group validity was assessed by comparing each component scores of samples (Kotronoulas, Papadopoulou, Papapetrou, & Patiraki, 2011;
Tzeng et al., 2012) between boys and girls and between the depres- sion risk (Indo BDI-II > 17) and normal groups (Indo BDI-II≤17) using independent samplettest. We hypothesized that adolescents with a high score for depression have poor sleep quality. In addition, we used receiver operating characteristic (ROC) (de la Vega et al., 2015) analy- sis to establish the cut-off point of the PSQI-I among adolescents with and without sleep disturbance. Previous study noted that sleep disturbance can be assessed by sleep quality (Buysse et al., 1989; Lund et al., 2010; Tzeng et al., 2012). Thus, ROC was also used to measure sleep disturbance with PSQI-I. Sleep disturbance was defined as >30 min of sleep onset latency (Berger &
Higginbotham, 2000; Espie, Inglis, & Harvey, 2001), total sleep time of
≤6.5 h (Lacks & Morin, 1992) or ≤85% sleep efficiency (Berger &
Higginbotham, 2000).
3 | R E S U L T S
3.1 | Description of the sample
The characteristics of the respondents are listed in Table 1. Most respondents were aged 13–14 years (87.9%). The proportion of male (53.2%) and female (46.8%) participants was almost equal. In terms of residence, most of the respondents were from East Indonesia (88.8%).
On the basis of the Indo BDI-II, the majority of the respondents did not have depression (70.5%), with 29.5% of the respondents having depression. The total scores of the PSQI-I ranged from 2 to 16, with a mean total score of 7.25 and a standard deviation (SD) of 2.50. The mean score of seven component of the PSQI-I ranged from 0.24 to 1.50 (SD = 0.58–0.89) (Table 1).
3.2 | Reliability
Further analyses were conducted to determine internal consistency for the PSQI-I. Cronbach's alpha for the PSQI-I was 0.72, and that for each item ranged from 0.69 to 0.72. There were statistically signifi- cant and positive correlations between the total score of the PSQI-I and seven component scores of the PSQI-I. The range of correlation between each domain wasr= 0.36–0.56,P< 0.05.
3.3 | Validity
3.3.1 | Construct validity
The total score of the PSQI-I was significantly correlated with the total score of the Indo BDI-II (r= 0.22,P< 0.05). The somatic, affec- tive and cognitive component in BDI-II showed significant correlation with the total score of PSQI-I (r= 0.17–0.19,P< 0.05). Among seven
component of PSQI-I, sleep quality, sleep disturbances, sleep medica- tion use and daytime dysfunction were significantly correlated with the total score of Indo BDI-II (r= 0.11–0.25,P< 0.05) (Table 4). This supported our hypothesis that there is a correlation between depres- sion and sleep quality.
3.3.2 | Known group validity
We hypothesized that a low score of depression indicates favourable sleep quality. An independent samplettest was employed to compare normal and depression risk adolescents in order to develop known group validity. The total score of the PSQI-I in adolescents with depression risk (Indo BDI-II > 17,n= 139; mean = 8.08, SD = 2.89) T A B L E 1 Demographic characteristics of the participants
(n= 528)
Variables n %
Age (years)
13 211 40.0
14 253 47.9
15 63 11.9
16 1 0.2
Gender
Female 247 46.8
Male 281 53.2
Residence
East Indonesia 469 88.8
Central Indonesia 51 9.7
West Indonesia 8 1.5
BDI
Normal 372 70.5
Depression 156 29.5
Sleep disturbance 438 83.0
Sleep onset latency, >30 min 84 15.9
Total sleep time,≤6.5 h 429 81.3
Sleep efficiency,≤85% 55 10.4
Mean SD
Total score of the PSQI-I 7.25 2.50
Total sleep time (min) 320.89 82.24
Sleep efficiency (%) 93.06 6.51
Sleep quality 1.10 0.67
Sleep latency 1.06 0.73
Sleep duration 1.49 0.89
Sleep efficiency 0.24 0.68
Sleep disturbances 1.50 0.58
Sleep medication use 0.38 0.78
Daytime dysfunction 1.47 0.88
Total score of the BDI-II 14.30 8.73
Abbreviations: BDI-II, Beck Depression Inventory-II; PSQI-I, Pittsburgh Sleep Quality Index-Indonesian version; SD, standard deviation.
T A B L E 2 Correlation coefficients of the component of PSQI-I and BDI-II
Variables
Somatic Affective Cognitive Total score of the BDI-II
γ P γ P γ P γ P
Sleep quality 0.102 <0.05 0.136 >0.05 0.126 <0.05 0.141 <0.05
Sleep latency 0.11 >0.05 0.067 >0.05 0.003 >0.05 0.024 >0.05
Sleep duration 0.71 >0.05 0.084 >0.05 0.051 >0.05 0.078 >0.05
Sleep efficiency 0.87 <0.05 0.039 >0.05 0.035 >0.05 0.064 >0.05
Sleep disturbances 0.227 <0.05 0.206 <0.05 0.209 <0.05 0.253 <0.05
Sleep medication use 0.070 >0.05 0.071 >0.05 0.130 <0.05 0.112 <0.05
Daytime dysfunction 0.108 <0.05 0.081 >0.05 0.158 <0.05 0.144 <0.05
Total score of the PSQI-I 0.174 <0.05 0.192 <0.05 0.194 <0.05 0.219 <0.05
Abbreviations: BDI-II, Beck Depression Inventory-II; PSQI-I, Pittsburgh Sleep Quality Index-Indonesian version.
T A B L E 3 Sensitivity and specificity values of the PSQI-I total score using ROC curve analysis
Total Sensitivity 1−specificity Specificity
Sensitivity + specificity
1 1.00 1.00 0.00 1.00
2.5 1.00 0.98 0.02 1.01
3.5 0.97 0.84 0.16 1.13
4.5 0.91 0.63 0.37 1.27
5.5 0.79 0.39 0.61 1.40
6.5 0.66 0.26 0.74 1.41
7.5 0.49 0.21 0.79 1.28
8.5 0.32 0.12 0.88 1.20
9.5 0.16 0.02 0.98 1.14
10.5 0.09 0.02 0.98 1.07
11.5 0.05 0.00 1.00 1.05
12.5 0.02 0.00 1.00 1.02
13.5 0.01 0.00 1.00 1.01
14.5 0.01 0.00 1.00 1.01
15.5 0.00 0.00 1.00 1.00
17 0.00 0.00 1.00 1.00
Abbreviations: PSQI-I, Pittsburgh Sleep Quality Index-Indonesian version;
ROC, receiver operating characteristic.
was significantly higher than that in normal adolescents (Indo BDI- II≤17,n= 317; mean = 6.89, SD = 2.22), withP< 0.05 (Table 2).
Regarding gender, there was no statistically significant difference between the total score of PSQI-I in boys (mean = 7.36, SD = 2.56) and girls (mean = 7.11, SD = 2.43).
3.4 | Cut-off point determination
ROC curves were employed to measure the cut-off point of the PSQI- I (Figure 1). The area below the ROC curve was 0.74, which means that the PSQI was acceptable for differentiating between adolescents with and without sleep disturbance. The result showed that 6.5 of the total score of PSQI-I represented the best possible relationship of sen- sitivity and specificity for measuring sleep quality among adolescents with and without sleep disturbance (Table 3).
4 | D I S C U S S I O N
To the best of our knowledge, this is the first study to examine the psychometric efficiency of the PSQI among Indonesian adolescents.
The results were consistent with a previous study of psychometric analysis in a youth population (de la Vega et al., 2015). Our findings revealed that the PSQI-I has adequate reliability and validity. Reliabil- ity was supported by internal consistency, with a Cronbach's alpha of 0.72 and item-total correlations of 0.36–0.56. This finding was similar to those of previous studies (Beck, Schwartz, Towsley, Dudley, &
Barsevick, 2004; Sohn, Kim, Lee, & Cho, 2012; Tzeng et al., 2012;
Zheng, Li, Wang, & Lv, 2016). Studies have noted that considered cut- off for Cronbach's alpha (>0.7) (Cho & Kim, 2015; Morera &
Stokes, 2016; Nunally, 1978) and item-total correlations (>0.4) (Kline, 1986) indicated acceptable reliability of PSQI-I.
The PSQI-I was supported by construct validity and known group validity. Based on the theory, depression leads to reduced sleep qual- ity (Borbély & Wirz-Justice, 1982). Therefore, construct validity was established using Pearson correlation between the total and each component scores of the PSQI-I and Indo BDI-II. As Table 4 showed, the total score of the PSQI-I not only significantly correlated with total score of Indo BDI-II (r= 0.22) but also with score of somatic, affective and cognitive component of the Indo BDI-II. The results is consisted with previous studies (Isaac & Greenwood, 2011; Skouteris, Wertheim, Germano, Paxton, & Milgrom, 2009). A correlation of >0.2 between each domain was considered satisfactory (Kline, 1986).
Therefore, the construct validity of PSQI-I was confirmed satisfactory.
In contrast to a previous study (Tsai & Li, 2004), our study found that the total score of the PSQI-I was not statistically different between boys and girls. Many factors can contribute to sleep distur- bance among adolescents, for example, the presence of a bed partner (Beninati, Harris, Herold, & Shepard, 1999). These adolescents lived at a dormitory, and they have partner in their room; therefore, both girls and boys had a similar environment. However, our study still retained favourable known group validity. The total score of the PSQI-I in the normal group of adolescents was found to be significantly lower than that of the adolescents with depression risk. This supports our F I G U R E 1 Receiver operating characteristic (ROC) curve of the
Pittsburgh Sleep Quality Index-Indonesian version (PSQI-I). Area below the ROC curve: 0.74; SE: 0.03; asymptotic sig. <0.001; lower bound: 0.69; and upper bound: 0.80
T A B L E 4 Mean difference between adolescents of the normal and depression-risk groups
Boys Girls
tvalue
Adolescents normal group Adolescents depression risk group
tvalue
Mean SD Mean SD Mean SD Mean SD
Sleep quality 1.07 0.67 1.12 0.66 0.80 1.02 0.60 1.27 0.77 −4.03*
Sleep latency 1.10 0.73 1.00 0.72 −1.60 1.04 0.70 1.08 0.79 −0.49
Sleep duration 1.51 0.89 1.46 0.88 −0.60 1.45 0.85 1.59 0.94 −1.71
Sleep efficiency 0.23 0.69 0.24 0.67 0.14 0.20 0.63 0.32 0.78 −1.70
Sleep disturbances 1.50 0.57 1.49 0.59 −0.22 1.41 0.56 1.69 0.58 −5.03*
Sleep medication use 0.44 0.86 0.315 0.66 −1.89 0.34 0.74 0.47 0.86 −1.71
Daytime dysfunction 1.48 0.87 1.46 0.88 −0.19 1.40 0.87 1.64 0.87 −2.97*
Total score of PSQI-I 7.36 2.56 7.11 2.43 −1.14 6.89 2.22 8.08 2.89 −5.11*
Abbreviations: PSQI-I, Pittsburgh Sleep Quality Index-Indonesian version; SD, standard deviation.
*P< 0.05.
hypothesis that there is a positive correlation between depression and sleep quality and is consistent with the findings of previous stud- ies (Lund et al., 2010; Tsai et al., 2013). These results indicate that the PSQI-I is valid for use in assessing sleep quality among Indonesian adolescents.
Scores of three components (sleep quality, sleep disturbance and daytime dysfunction) of the PSQI-I were significantly different between the depression risk and normal adolescents. This might reflect the different sleep patterns of these two groups. That is, the major sleep complaints of depressive adolescents are poor sleep qual- ity, excessive daytime sleepiness and symptoms of sleep disturbances.
Studies have mentioned excessive daytime sleepiness as a common symptom among depression disorders (Chellappa & Araújo, 2006), and as subjective sleep sufficiency decreased, symptoms of depression increased (Kaneita et al., 2006). Adolescent insomnia symptoms have also been validated as increasing depression risk (Roane &
Taylor, 2008). Thus, the present PSQI-I tool can help health-care pro- viders when screening sleep quality among adolescents in Indonesia, enabling them to take positive measures to prevent depression.
The cut-off mean value of the PSQI-I was 6.5 based on the ROC curves. This finding was different than that with the original PSQI, which suggested a cut-off mean of 5 (Buysse et al., 1989). This is simi- lar to previous studies that have suggested a cut-off point ranging from 5.5 to 6.5 (Doi et al., 2000; Manzar et al., 2015). The results of our study suggest that a PSQI-I score of <6.5 indicates that sleep quality is favourable, whereas a score of >6.5 indicates poor quality sleep.
4.1 | Study limitations
A limitation of this study was that we recruited junior high school ado- lescents who lived in a dormitory, and thus, a heterogonous sample was unavailable to compare adolescents who lived elsewhere. Fur- thermore, the assessment periods of the instruments used for mea- surement in this study were different. For example, the PSQI measured sleep quality for preceding month, whereas the BDI mea- sured current depression.
5 | C O N C L U S I O N S
The results of this study support the validity and reliability of the PSQI-I in screening sleep quality among both normal and depression risk adolescents. The cut-off point may detect poor sleep quality. Fur- thermore, this simple tool is capable of quickly assessing sleep quality for health-care providers. The findings indicate that the PSQI-I has high validity and reliability and is reliable for screening sleep quality among Indonesian adolescents.
A C K N O W L E D G E M E N T
The authors received no financial support for the research, authorship and/or publication of this article.
C O N F L I C T O F I N T E R E S T
The authors declare that they have no conflicts of interest.
A U T H O R S H I P S T A T E M E N T
AS and MHC designed the study. AS collected the data and prepared the manuscript. All authors analysed the data and approved the final version for submission.
R E F E R E N C E S
Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck Depression Inventory-II.San Antonio,78(2), 490–498.
Beck, S. L., Schwartz, A. L., Towsley, G., Dudley, W., & Barsevick, A.
(2004). Psychometric evaluation of the Pittsburgh Sleep Quality Index in cancer patients.Journal of Pain and Symptom Management,27(2), 140–148. https://doi.org/10.1016/j.jpainsymman.2003.12.002 Beninati, W., Harris, C. D., Herold, D. L., & Shepard, J. W. Jr. (1999). The
effect of snoring and obstructive sleep apnea on the sleep quality of bed partners. Paper presented at the Mayo Clinic Proceedings Berger, A. M., & Higginbotham, P. (2000). Correlates of fatigue during and
following adjuvant breast cancer chemotherapy: A pilot study. Paper presented at the Oncology nursing forum
Borbély, A., & Wirz-Justice, A. (1982). Sleep, sleep deprivation and depres- sion.Human Neurobiology,1(205), 10.
Buysse, D. J., Reynolds, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J.
(1989). The Pittsburgh Sleep Quality Index: A new instrument for psy- chiatric practice and research.Psychiatry Research, 28(2), 193–213.
https://doi.org/10.1016/0165-1781(89)90047-4
Chellappa, S. L., & Araújo, J. F. (2006). Excessive daytime sleepiness in patients with depressive disorder. Revista Brasileira de Psiquiatria, 28(2), 126–129. https://doi.org/10.1590/S1516- 44462006000200010
Cho, E., & Kim, S. (2015). Cronbach's coefficient alpha: Well known but poorly understood.Organizational Research Methods,18(2), 207–230.
https://doi.org/10.1177/1094428114555994
Danielsson, N. S., Harvey, A. G., MacDonald, S., Jansson-Fröjmark, M., &
Linton, S. J. (2013). Sleep disturbance and depressive symptoms in adolescence: The role of catastrophic worry.Journal of Youth and Ado- lescence, 42(8), 1223–1233. https://doi.org/10.1007/s10964-012- 9811-6
DeVellis, R. F. (2003).Scale development: Theory and applications(2nd ed.), Vol. 26, Thousand Oaks, California: Sage publications.
Doi, Y., Minowa, M., Uchiyama, M., Okawa, M., Kim, K., Shibui, K., &
Kamei, Y. (2000). Psychometric assessment of subjective sleep quality using the Japanese version of the Pittsburgh Sleep Quality Index (PSQI-J) in psychiatric disordered and control subjects. Psychiatry Research, 97(2–3), 165–172. https://doi.org/10.1016/S0165-1781 (00)00232-8
Dong, Y., & Peng, C.-Y. J. (2013). Principled missing data methods for researchers. Springerplus, 2(1), 222. https://doi.org/10.1186/2193- 1801-2-222
Espie, C. A., Inglis, S. J., & Harvey, L. (2001). Predicting clinically significant response to cognitive behavior therapy for chronic insomnia in general medical practice: Analyses of outcome data at 12 months posttreatment. Journal of Consulting and Clinical Psychology, 69(1), 58–66. https://doi.org/10.1037/0022- 006X.69.1.58
Ginting, H., Näring, G., van der Veld, W. M., Srisayekti, W., & Becker, E. S.
(2013). Validating the Beck Depression Inventory-II in Indonesia's gen- eral population and coronary heart disease patients.International Jour- nal of Clinical and Health Psychology,13(3), 235–242. https://doi.org/
10.1016/S1697-2600(13)70028-0
Haryono, A., Rindiarti, A., Arianti, A., Pawitri, A., Ushuluddin, A., Setiawati, A., … Sekartini, R. (2016). Prevalensi gangguan tidur
pada remaja usia 12-15 tahun di sekolah lanjutan tingkat pertama.
Sari Pediatri,11(3), 149–154. https://doi.org/10.14238/sp11.3.2009.
149-54
Isaac, F., & Greenwood, K. M. (2011). The relationship between insomnia and depressive symptoms: Genuine or artifact?Neuropsychiatric Dis- ease and Treatment,7, 57.
Kaneita, Y., Ohida, T., Uchiyama, M., Takemura, S., Kawahara, K., Yokoyama, E.,…Fujita, T. (2006). The relationship between depression and sleep disturbances: A Japanese nationwide general population sur- vey.The Journal of Clinical Psychiatry.,67, 196–203. https://doi.org/
10.4088/JCP.v67n0204
Kline, P. (1986).A handbook of test construction: Introduction to psychomet- ric design. New York: Methuen.
Kotronoulas, G. C., Papadopoulou, C. N., Papapetrou, A., & Patiraki, E.
(2011). Psychometric evaluation and feasibility of the Greek Pittsburgh Sleep Quality Index (GR-PSQI) in patients with cancer receiving che- motherapy.Supportive Care in Cancer,19(11), 1831–1840. https://doi.
org/10.1007/s00520-010-1025-4
Krystal, A. D., & Edinger, J. D. (2008). Measuring sleep quality.Sleep Medi- cine,9, S10–S17. https://doi.org/10.1016/S1389-9457(08)70011-X Lacks, P., & Morin, C. M. (1992). Recent advances in the assessment
and treatment of insomnia. Journal of Consulting and Clinical Psy- chology, 60(4), 586–594. https://doi.org/10.1037/0022-006X.60.
4.586
LeBourgeois, M. K., Giannotti, F., Cortesi, F., Wolfson, A., & Harsh, J.
(2004). Sleep hygiene and sleep quality in Italian and American adoles- cents.Annals of the new York Academy of Sciences,1021(1), 352–354.
https://doi.org/10.1196/annals.1308.044
LeBourgeois, M. K., Giannotti, F., Cortesi, F., Wolfson, A. R., & Harsh, J.
(2005). The relationship between reported sleep quality and sleep hygiene in Italian and American adolescents.Pediatrics,115 (Supplement 1), 257–265. https://doi.org/10.1542/peds.2004-0815H Lund, H. G., Reider, B. D., Whiting, A. B., & Prichard, J. R. (2010). Sleep pat- terns and predictors of disturbed sleep in a large population of college students.Journal of Adolescent Health, 46(2), 124–132. https://doi.
org/10.1016/j.jadohealth.2009.06.016
Manzar, M. D., Moiz, J. A., Zannat, W., Spence, D. W., Pandi- Perumal, S. R., BaHammam, A. S., & Hussain, M. E. (2015). Validity of the Pittsburgh sleep quality index in Indian university students.Oman Medical Journal, 30(3), 193–202. https://doi.org/10.5001/omj.
2015.41
Mollayeva, T., Thurairajah, P., Burton, K., Mollayeva, S., Shapiro, C. M., &
Colantonio, A. (2016). The Pittsburgh sleep quality index as a screen- ing tool for sleep dysfunction in clinical and non-clinical samples: A systematic review and meta-analysis. Sleep Medicine Reviews, 25, 52–73. https://doi.org/10.1016/j.smrv.2015.01.009
Morera, O. F., & Stokes, S. M. (2016). Coefficientαas a measure of test score reliability: Review of 3 popular misconceptions.American Journal of Public Health, 106(3), 458–461. https://doi.org/10.2105/AJPH.
2015.302993
Nunally, J. C. (1978).Psychometric theory(2ed ed.). New York: McGraw- Hill.
Owens, J., & Adolescent Sleep Working Group. (2014). Insufficient sleep in adolescents and young adults: An update on causes and conse- quences.Pediatrics, 134, 2014–1696. https://doi.org/10.1542/peds.
2014-1696
Pedhazur, E. J., & Schmelkin, L. P. (1991).Measurement, design, and analysis:
An integrated approach. New York: Psychology Press.
Roane, B. M., & Taylor, D. J. (2008). Adolescent insomnia as a risk factor for early adult depression and substance abuse.Sleep,31(10), 1351–1356.
Roberts, R. E., Roberts, C. R., & Chen, I. G. (2002). Impact of insomnia on future functioning of adolescents. Journal of Psychosomatic Research, 53(1), 561–569. https://doi.org/10.1016/S0022-3999(02) 00446-4
Skouteris, H., Wertheim, E. H., Germano, C., Paxton, S. J., & Milgrom, J.
(2009). Assessing sleep during pregnancy: A study across two time points examining the Pittsburgh Sleep Quality Index and associations with depressive symptoms. Women's Health Issues, 19(1), 45–51.
https://doi.org/10.1016/j.whi.2008.10.004
Sohn, S. I., Kim, D. H., Lee, M. Y., & Cho, Y. W. (2012). The reliability and validity of the Korean version of the Pittsburgh Sleep Quality Index.
Sleep and Breathing,16(3), 803–812. https://doi.org/10.1007/s11325- 011-0579-9
Suen, L. K. P., Tam, W. W. S., & Hon, K. L. (2010). Association of sleep hygiene-related factors and sleep quality among university students in Hong Kong.Hong Kong Medical Journal,16(3), 180–185.
Titov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M.
(2011). Psychometric comparison of the PHQ-9 and BDI-II for measuring response during treatment of depression.Cognitive Behav- iour Therapy, 40(2), 126–136. https://doi.org/10.1080/16506073.
2010.550059
Tsai, L. L., & Li, S. P. (2004). Sleep patterns in college students: Gender and grade differences.Journal of Psychosomatic Research,56(2), 231–237.
https://doi.org/10.1016/S0022-3999(03)00507-5
Tsai, Y. L., Chen, C. W., Cheng, H. C., Chang, C. H., Chen, C. Y., &
Yang, C. M. (2013). Cognitive and behavioral factors in insomnia comorbid with depression and anxiety.Sleep and Biological Rhythms, 11(4), 237–244. https://doi.org/10.1111/sbr.12030
Tzeng, J. I., Fu, Y.-W., & Lin, C.-C. (2012). Validity and reliability of the Tai- wanese version of the Pittsburgh Sleep Quality Index in cancer patients. International Journal of Nursing Studies, 49(1), 102–108.
https://doi.org/10.1016/j.ijnurstu.2011.08.004
de la Vega, R., Tomé-Pires, C., Solé, E., Racine, M., Castarlenas, E., Jensen, M. P., & Miró, J. (2015). The Pittsburgh Sleep Quality Index:
Validity and factor structure in young people.Psychological Assessment, 27(4), e22–e27. https://doi.org/10.1037/pas0000128
World Health Organization. (2014). Process of translation and adaptation of instruments. Retrieved from http://www.who.int/substance_
abuse/research_tools/translation/en/
Zheng, B., Li, M., Wang, K., & Lv, J. (2016). Analysis of the reliability and validity of the Chinese version of Pittsburgh sleep quality index among medical college students.Beijing da xue xue bao. Yi xue ban= Journal of Peking University Health Sciences,48(3), 424–428.
How to cite this article:Setyowati A, Chung M-H. Validity and reliability of the Indonesian version of the Pittsburgh Sleep Quality Index in adolescents.Int J Nurs Pract. 2020;e12856.
https://doi.org/10.1111/ijn.12856
