Validity and reliability of the Korean version of the Wisconsin Smoking Withdrawal Scale
Article information
Abstract
Background/Aims
This study evaluated the validity and reliability of the Korean version of the Wisconsin Smoking Withdrawal Scale (WSWS-K) for use in clinical practice and research on Korean smokers.
Methods
The Wisconsin Smoking Withdrawal Scale was translated into Korean and then back-translated into English. The authors reviewed the translation and back-translation and approved the final questionnaire draft. The validity and reliability of the WSWS-K were evaluated based on data collected from 300 participants. Construct validity was evaluated with a confirmatory factor analysis. Criterion-related validity was assessed by examining the relationships between the subscales of the WSWS-K and the matched items of the Korean version of the Minnesota Nicotine Withdrawal Scale (MNWS-K).
Results
The participants were predominantly male (93.6%) and the mean age was 59.23 ± 15.19 years. The confirmatory factor analysis revealed that fit indices (namely, the goodness-of-fit index, adjusted goodness-of-fit index, comparative fit index, and the normed fit index) exceeded or approached 0.9. Cronbach’s alpha for the entire scale was 0.87. The total score of the WSWS-K had a statistically significant positive correlation with that of the MNWS-K (Pearson’s correlation coefficient, 0.768; p < 0.01). Additionally, we performed linear regression between the WSWS-K and MNWS-K scores after adjusting for age, gender, comorbidity, and smoking history. After this adjustment, the p value of the WSWS- K was < 0.001.
Conclusions
The WSWS-K had satisfactory validity and reliability. The WSWS- K can be used with acceptable validity and reliability in research and clinical evaluation of Korean smokers.
INTRODUCTION
Cigarette smoking is the leading cause of preventable disease and death in the United States, accounting for more than 400,000 deaths every year [1]. Smoking-related illnesses in the United States cost more than $300 billion each year, including nearly $170 billion for direct medical care for adults and more than $156 billion in lost productivity [1]. In 2015, approximately 36.5 million adults in the United States smoked cigarettes and more than 16 million lived with a smoking-related disease [2]. In Korea, the prevalence of smoking is quite high: the 2015 Korean National Health and Nutrition Examination Survey reported an overall smoking rate of 22.6%, with rates of 39.3% and 5.5% among men and women over the age of 19, respectively [3].
People who smoke may have their lifespan shortened by more than a decade compared with those who have never smoked [4]. Current smokers have significantly higher risk of major cause-specific mortality than never smokers, including all cardiovascular disease, sudden death, pulmonary disease, lung cancer, and smoking-related cancers including larynx, oral cavity, esophageal, pancreatic and stomach cancer. Compared with current smokers, the risk of death is significantly reduced among past smokers within 10 years of smoking cessation. By 20 years of smoking cessation, the risk is further decreased to the level of never smokers [5].
Nicotine is the substance in tobacco that causes addiction [6]. When quitting smoking, nicotine withdrawal syndrome occurs, because the body has developed a homeostatic response [7]. Withdrawal syndrome is characterized by symptoms such as irritability, frustration, anger, restlessness, insomnia, anxiety, depression, poor concentration, increased appetite, and intense cravings for nicotine [7,8]. Accurate and effective assessment of withdrawal symptoms is important, both theoretically and clinically.
The Minnesota Nicotine Withdrawal Scale (MNWS) was developed in 1986 [9] and later revised in 2005 by John Hughes. The MNWS is sensitive enough to measure ‘difficulty concentration’ and ‘restlessness’ but not ‘depression’ and ‘disturbed sleep.’ Furthermore, each withdrawal symptom is measured with a single item, which may lead to problems of decreased validity and reliability [10]. The Wisconsin Smoking Withdrawal Scale (WSWS) was developed to more reliably assess withdrawal symptoms. The WSWS contains 28 items and seven subscales, including anger, anxiety, concentration, cravings, hunger, sadness, and sleep [11]. Questions are answered on 5-point Likert-type scales ranging from ‘strongly agree’ to ‘strongly disagree.’ In the WSWS, each withdrawal symptom is measured with several items, thus increasing reliability.
Alpha coefficients for the subscales range from 0.75 to 0.93. This self-reported outcome measure combines the strength of sensitivity to smoking withdrawal and is predictive of smoking cessation outcomes. Furthermore, the WSWS is sufficiently brief to be used in general clinical practice and research context [10-12]. Additionally, the psychometric properties of the WSWS have been tested in an internet cohort study (n = 4,644) [10]. Cronbach’s alpha was 0.91, and the test-retest correlation coefficient over a 14-day period was 0.80 for the total score, thus supporting the validity of this scale [10].
The Korean version of the MNWS (MNWS-K) has been validated previously [13]. However, the MNWS has had its name changed to Minnesota Tobacco Withdrawal Scale to reflect that non-nicotine factors can influence the scores. The Minnesota Tobacco Withdrawal Scale includes eight well-validated items reflecting smoking withdrawal symptoms and seven other promising candidate items. This new scale has not yet been translated into Korean. Therefore, validation of tools for measuring smoking withdrawal symptoms in Korean smokers is required. The aim of this study was to validate the Korean version of the Wisconsin Smoking Withdrawal Scale (WSWS-K).
METHODS
Translation of the WSWS
After obtaining the original author’s permission, stepwise processing was used to develop the WSWS-K: forward translation, backward translation for quality control, and pilot testing [14,15]. To ensure lexical equivalence, the translation of the original English version of the WSWS into the Korean language used the “back-translation” technique. First, the first and second authors, who are Korean-born and fluent in both English and Korean, translated the questionnaire into the Korean language. Back-translation was performed by two people. One was a professional translator, and the other was an American who lives in Korea and teaches the Korean language to non-native speakers at a university in Seoul. They independently and blindly translated the Korean version back into English; the back-translations were then compared to the original version. The authors reviewed the translation and back-translation and approved the final questionnaire draft (Supplementary Table 1). The Korean version was piloted with 20 physicians in our institute. When asked to comment on the clarity, comprehensibility, and readability of the Korean version, they reported that all items were clear and easy to understand.
Subjects and measurement
Participants for the validation study were enrolled from among outpatients visiting St. Paul’s Hospital between December 2016 and February 2017. Eligible participants were 15 years of age or older and were current smokers or had stopped smoking within the last year. Eligible participants had to be able to complete the scales independently and to provide informed consent after being informed of all the pertinent aspects of the questionnaire. We excluded participants who had a past or present history of depression or anxiety disorders according to the Diagnostic and Statistical Manual of Mental Disorders (DSM)-V, a past or present history of schizophrenia or other mental disorder, concomitant antidepressant, antianxiety, hypnotic or sedative medication, or current abuse of alcohol.
Participants were asked to complete the WSWS-K (Supplementary Table 2) based on the time since quitting smoking, and for criterion-related validity, they were asked to complete the MNWS-K [13] simultaneously. This study was approved by the Institutional Review Board/Ethics Committee of St. Paul’s Hospital, the Catholic University of Korea (PC16QISI0054). All patients gave written informed consent to participate in the study.
Sample size determination
The WSWS has 28 items. Therefore, a minimum of 280 participants were required to fulfill the requirement of at least 10 participants per item for factor analysis [16]. Taking the noneligibility of 15%, the sample size was calculated to be at least 318.
Statistical methods
Descriptive statistics and appropriate validity and reliability statistical tests were completed using SAS version 9.4 (SAS Institute, Inc., Cary, NC, USA) and R version 3.3.2 (R Foundation for Statistical Computing, Vienna, Austria). Data are expressed as mean ± standard deviation (SD). To test construct validity, a confirmatory factor analysis (CFA) was performed. Welsch et al. [11] performed a CFA and compared the seven-factor model that guided the original scale development with alternative models including four-factor, one-factor, and second-order models. The result was a comparative fit index (CFI) of 0.91 for the seven-factor model, and the fit indices revealed that the seven-factor model provided superior fit compared to the other models [11]. Thus, we also performed a CFA for the seven-factor model. Multiple indicators and multiple causes (MIMIC) CFA was used to test the effects of covariates; gender, age, comorbidity and smoking history. We used a structural equation model to understand how the WSWS is predicted by these variables. Model verification in the CFA can be conducted on the basis of chi-squared tests, degrees of freedom, goodness-of-fit index (GFI), adjusted goodness-of-fit index (AGFI), CFI, normed fit index (NFI), root mean square residual (RMR), and root mean square error of approximation (RMSEA). The model fit is judged to be good if the GFI, AGFI, CFI, and NFI are 0.90 or greater and the RMR is 0.5 or less [17]. For the RMSEA, the model fit is judged to be good model if it is below 0.05 and desirable if it is below 0.10 [18-20].
The Pearson’s correlation coefficient method was used to assess the relationship among subscales of WSWS- K and to assess criterion-related validity between the scores of the subscales of the WSWS and MNWS questionnaires. Simple linear regression was performed to examine the predictive validity of the two questionnaires. Cronbach’s alpha was used to examine the internal consistency, and item-to-total correlation coefficients were also computed. The cut-off of the correlation of Cronbach’s alpha was 0.70.
RESULTS
Participant characteristics
A total of 318 participants were initially enrolled in this study. Of those 18 were excluded (five had a history of depression, six were taking sedatives, and seven had current abuse of alcohol). Finally, 300 participants were included in analysis. (Fig. 1); their baseline characteristics are summarized in Table 1. The participants were predominantly male (93.67%) and the mean age was 59.23 ± 15.19 years. The mean total cigarette pack-years was 32.83 ± 18.19.
Flow diagram of the study.
Baseline characteristics of the participants (n = 30)
Construct validity
According to the results of the seven-factor model in the original version of the WSWS, the CFA was performed to examine the suitability of the seven-factor structure of the WSWS. Additionally, MIMIC CFA was performed with the seven-factor model, which was found to be more appropriate than the one-factor model. The fit indices obtained in the CFA and MIMIC CFA are shown in Table 2. The CFA of the seven-factor structure resulted in a GFI of 0.917, AGFI of 0.891, CFI of 0.849, NFI of 0.808, and RMSEA of 0.098. The MIMIC CFA resulted in a GFI of 0.905, AGFI of 0.082, CFI of 0.843, NFI of 0.788, and RMSEA of 0.086. As the age increased, the WSWS score decreased and was statistically significant. Other variables were not statistically significant. The results of the CFA were generally better than those of the MIMIC CFA. However, the GFI of the MIMIC CFA was also greater than 0.9 and the RMSEA was less than 0.1. The CFA model is shown in Fig. 2. A standard coefficient estimation demonstrates statistical significance at the level of 0.05.
Confirmatory factor analysis and multiple indicators and multiple causes confirmatory factor analysis of the Korean version of the Wisconsin Smoking Withdrawal Scale
Path diagram of a confirmatory factor analysis of the Korean version of Wisconsin smoking withdrawal scale. a p < 0.01.
Distribution and correlation
Table 3 shows the distributions of the subscale scores of the 28-item WSWS-K and the correlations among the scores of the subscales of the WSWS-K. Overall, the subscales were positively correlated with each other. Anxiety was strongly positively correlated with anger, sadness, and concentration (r = 0.749, r = 0.726, and r = 0.636, respectively), and sadness was strongly positively correlated with anger (r = 0.654). Some correlation coefficients were negative and statistically significant. Hunger was negatively correlated with sleep (r = –0.257). Some correlation coefficients were statistically significant (less than 0.01), but the effects size were all less than 0.250: r = 0.231 (craving, anxiety), r = 0.238 (craving, concentration), r = 0.170 (craving, sadness), r = 0.201 (sleep, anxiety), and r = 0.218 (sleep, concentration).
Distributions of subscale scores and Pearson’s correlation coefficients among 28-items of Korean version of the Wisconsin Smoking Withdrawal Scale (n = 300)
Criterion-related validity
Criterion-related validity was assessed by examining the relationships of the subscale scores of the WSWS-K with the matched items of the MNWS-K. The total score of the WSWS-K was statistically significantly positively correlated with the MNWS-K questionnaire’s total score (0.768; p < 0.01) (Table 4). Additionally, the subscales of the WSWS-K were statistically significantly positively correlated with the matched items of the MNWS-K. Thus, the WSWS-K was highly correlated with the MNWS- K, and the WSWS-K is sufficiently valid to measure smoking withdrawal symptoms among Koreans (the Pearson’s product moment correlation was 0.768, indicating a strong linear correlation). A simple linear regression was performed to examine the predictive validity of the two questionnaires. A good correlation was found between the total scores of the WSWS-K and MNWS- K (Fig. 3). Additionally, we performed linear regression between the WSWS-K and MNWS-K with adjustment of age, gender, comorbidity, and smoking history. After adjustment for these variables, the WSWS-K was also statistically significantly positively correlated with the MNWS-K. The results are shown in Table 5.
Validity of items on the Korean version of the Wisconsin Smoking Withdrawal Scale (n = 300)
Regression plot of the Wisconsin questionnaire total score versus Minnesota questionnaire total score (β = 0.35, p < 0.001, R2 = 0.59)
Linear regression between the MNWS-K and the WSWS-K with adjustment of age, sex, comorbidity, and smoking
Internal consistency reliability
As a result of the internal consistency of the scales, Cronbach’s alpha of the overall scale was 0.87 (above the pre-specified criterion of 0.70), thus reflecting good internal consistency reliability [21]. Cronbach’s alpha of the seven subscales ranged from 0.68 to 0.95. Generally, Cronbach’s alpha exceeded 0.70; it was below 0.70 (0.68) only for concentration. Although, the value for concentration was lower than that for the other variables, the overall Cronbach’s alpha value demonstrated competent reliability. The Cronbach’s alpha coefficients for the WSWS-K are summarized in Table 6.
Cronbach’s alpha coefficient for items on the Korean version of the Wisconsin Smoking Withdrawal Scale (n = 300)
DISCUSSION
To our knowledge, this is the first report on the translation and validation of the WSWS in the Korean language. Previous studies of interval consistency reliability of the seven subscales of the original version of the WSWS had reported values of Cronbach’s alpha of 0.91 (range, 0.75 to 0.93) [11] and 0.91 (range, 0.76 to 0.91) [10]. In this study, Cronbach’s alpha coefficient was 0.87 (range, 0.68 to 0.95). As Cronbach’s alpha coefficients for the overall instrument were shown to be relatively high and above the standard of 0.70, the WSWS-K was considered to be reliable. The value for concentration was relatively lower than that for the other variables. This difference could be explained by the fact that, compared to a previous validation study, this study had many older participants. The average age of the participants in this study was 59.23 years, and the study included 95 people over the age of 70 years. This demographic may have influenced the results of the survey because concentration decreases with age [22,23]. We conducted CFA to assess construct validity. In this study, the AGFI of the seven-factor model was 0.891 and RMSEA was 0.098. In a previous study, Etter and Hughes [10] examined validity by comparing the WSWS and the MNWS. They performed CFA of the original version of WSWS and AGFI was 0.87 [10], which falls below 0.90. Hence, the AGFI value obtained in the current study was above the value in the original study [10], and it would be appropriate to conclude that the structure of the questionnaire has been adequately designed. These results indicated that the WSWS-K was psychometrically sound and appropriate for evaluating nicotine withdrawal symptoms among Koreans.
Hughes and Hatsukami [9] developed the MNWS in 1986, and the scale was modified to reflect changes made in the DSM-IV criteria for nicotine withdrawal in 1996 [24]. The MNWS includes eight items (depressed mood [sad], insomnia, irritable/frustrated/angry, anxious [nervous], difficulty concentrating, restless [impatient], increased appetite, and desire or craving to smoke) answered on 5-point Likert-type scales raging from ‘none’ to ‘severe.’ It is the briefest scale available among the self-report measures of nicotine withdrawal currently used, and its psychometric properties have been reported to be as good as those for other, longer questionnaires (Cronbach’s alpha was 0.85, and the test-retest intraclass correlation coefficient over a 14-day period was 0.71). Thus, we decided to assess the criterion-related validity by examining the relationship of the subscales of the WSWS-K with matched items on the MNWS-K. Seven of eight items on the MNWS- K, except ‘restless,’ were matched to each other. The total score and the subscales of the WSWS-K were highly correlated with the MNWS-K, and the correlation analysis demonstrated that the WSWS-K has good validity to measure nicotine withdrawal symptoms.
Continuous and accurate assessment of nicotine dependence and withdrawal symptoms is required for effective smoking cessation and smokers’ education. The Fagerström Test for Nicotine Dependence (FTND) [25] is the most commonly used measure of nicotine dependence. However, it only measures physiological dependence, and has limitations that it cannot measure psychological dependence such as craving. The Mood and Physical Symptoms Scale (MPSS) [26] and MNWS have been widely used to measure withdrawal symptoms. However, both the MPSS and MNWS have the disadvantage that one withdrawal symptom is measured with on single item. Because the WSWS measures one withdrawal symptom with several items, it is able to measure withdrawal symptoms more accurately [10]. In this study, we developed the Korean version of the WSWS and its validity and reliability were confirmed in Korean smokers.
Our study has several limitations. First, the majority of participants (93.7%) in this study were male. However, from the Korean statics in 2016, the smoking rate was 39.1% and 3.1% in adult men and women, respectively [27]. More specifically, the smoking rates of men in fifties, sixties and seventies were 36.3%, 25.3%, and 15.5%, respectively. In contrast, the smoking rates of women in fifties, sixties and seventies were 2.9%, 1.9%, and 1.1%, respectively [28]. Overall, the smoking rate of women in Korea is very low, particularly at the age of 50 to70 years, which is reflective of the subjects in this study. In this respect, the number of women in this study was not very small. Second, the participants comprise current smokers and former smokers had stopped smoking within the last year. Therefore, there may be a difference in severity of the withdrawal symptoms. However, from the previous study [29], withdrawal symptoms can be last until 1 year after smoking cessation and significant craving symptom disappear after 1 year. Third, the participants were a convenient sample recruited exclusively from outpatients visiting our hospital, which means that no evaluation was made for smokers who do not visit the hospital. Fourth, the lack of sociodemographic information limits the ability to generalize the results. Finally, because the study utilized self-reported measures of nicotine withdrawal symptoms, there was no way of determining whether these symptoms were overreported or underreported.
Considering the appropriate psychometric evidentiary properties provided by our study, we conclude that the WSWS-K is an appropriate, reliable, and valid instrument for assessing nicotine withdrawal symptoms including cravings, among Korean smokers. In Korea, the national reimbursement program for medical costs of smoking cessation was launched in 2015. If a smoker succeeds in quitting smoking, all medical costs related to smoking cessation are supported by the Korean government. The smoking cessation program only evaluates the dependence of nicotine using the FTND [25] at the initiation of treatment, and there are no Korean language tools available to assess nicotine withdrawal symptoms that can occur during treatment. The WSWS- K can be used to evaluate the withdrawal symptoms in smokers who joined the reimbursement program for medical costs of smoking cessation. Additionally, the WSWS-K can be used in future research and clinical evaluations of Korean smokers with acceptable validity and reliability.
KEY MESSAGE
1. The original version of the Wisconsin Smoking Withdrawal Scale was translated into the Korean language.
2. The Korean version of the Wisconsin Smoking Withdrawal Scale (WSWS-K) was validated in smokers.
3. Satisfactory internal consistency coefficients together with the validity findings suggest the use of the WSWS-K in the Korean population.
Supplementary Material
Notes
No potential conflict of interest relevant to this article was reported.
Acknowledgements
The authors would like to thank Minyoung Park (The Korea Herald, Seoul, Korea) and Jennifer Cramer (USA) for back translation and Sun Hee Gang (St. Paul’s Hospital, Seoul, Korea) for assistance in data collection.