Portuguese Version

Year:  2011  Vol. 77   Ed. 5 - (21º)

Artigo Original

Pages: 663 to 669

PDF PT   PDF EN

Translation, cross-cultural adaptation and validation of SinoNasal Outcome Test (SNOT) - 22 to Brazilian Portuguese

Author(s): Eduardo Macoto Kosugi¹; Vitor Guo Chen²; Viviane Maria Guerreiro da Fonseca³; Milena Martins Pellogia Cursino⁴; José Arruda Mendes Neto⁵; Luís Carlos Gregório⁶

Keywords: nasal polyps, natural orifice endoscopic surgery, quality of life, questionnaires, sinusitis.

Abstract:
Quality of life questionnaires have been increasingly used in clinical trials to help establish the impact of medical intervention or to assess the outcome of health care services. Among disease-specific outcome measures, SNOT-22 was considered the most suitable tool for assessing chronic rhinosinusitis and patients with nasal polyps. Aims: To perform translation, cross-cultural adaptation and validation of the SNOT-22 to Brazilian Portuguese. Methods: Prospective study involving eighty-nine patients with chronic rhinosinusitis or nasal polyps submitted to functional endoscopic sinus surgery, who answered the questionnaire before and after surgery. Furthermore, 113 volunteers without sinonasal disease also answered the questionnaire. Internal consistency, test-retest reliability, measure validity, responsiveness and clinical interpretability were assessed. Results: Mean preoperative, postoperative and no sinonasal disease scores were 62.39, 23.09 and 11.42, respectively (p<0.0001); showing validity and responsiveness. Internal consistency was high (Cronbach's alpha = 0.9276). Reliability was sufficiently good, considering inter-interviewers (r=0.81) and intra-interviewers within a 10 to 14 day-interval (r=0.72). Surgery effect size was 1.55. Minimally important difference was 14 points; and scores up to 10 points were considered normal. Conclusion: The Brazilian Portuguese SNOT-22 version is a valid instrument to assess patients with chronic rhinosinusitis and nasal polyps.

INTRODUCTION

Quality of life questionnaires have been frequently used in clinical assays in order to determine the impact caused by an intervention or in order to assess healthcare results1. The goal of each questionnaire may be geared towards the health status, or quality of life. Health status may be described by physical limitations, functional handicaps or social experiences reported by the patients. Notwithstanding, the quality of life description is seen as a unique and personal experience, which reflects not only the health status, but also other factors and circumstances associated with the patient's life. According to this definition, physicians and other healthcare professionals may describe the health status of each individual, but it is only the patient, individually, who can describe his/her own quality of life2.

Chronic rhinosinusitis (CRS), with or without nasal polyps, is a prevalent disease, which can affect up to 14% of the North-American population, and cause a significant impact on quality of life3. Such impact may be demonstrated using quality of life questionnaires, such as the SF-36; and patients with CRS have impacts on physical pain and on social aspects which are even greater than patients with angina, congestive heart failure and chronic obstructive pulmonary disease4. Moreover, when we compare patients submitted to sinonasal surgery with a sample of the general population in the USA, we notice significant differences in physical pain, general health status, vitality and social aspects4.

General questionnaires, such as the SF-36, allow us to compare different situations and treatments, besides enabling us to establish the impact different diseases have in different groups of patients. On the other hand, specific disease questionnaires may identify more easily the important symptoms; they help focus the medical visit and may be used to define treatment objectives. Moreover, they are more sensitive to small changes after interventions than the general questionnaires. Therefore, specific questionnaires are preferrable5.

Two recent reviews have identified numerous outcome measure questionnaires used to assess patients with rhinitis and rhinosinusitis, both acute and chronic, evaluating them as to reliability, validity, responsiveness and ease of use6,7. As more outcome measure questionnaires are developed, there is the need to have an agreement among the many authors in the world, so as to standardize the assessment of rhinosinusitis patients. The SNOT-22 (Sinonasal Outcome Test) questionnaire has the advantage of combining issues which are specific of sinonasal disease with general health issues, which may be assessed alone or together, both in the pre and postoperative. Comparing the 15 sinonasal questionnaires, Morley & Sharp6 concluded that the SNOT-22 is the most adequate to assess patients with CRS, including the post-op of functional endoscopic surgery.

SNOT-22 is a modification of a pre-existing questionnaire, the SNOT-20, which is a modification of the RSOM-31 (Rhino-Sinusitis Outcome Measure) questionnaire of 31 questions. Based on the RSOM-31 validation work, 11 questions were taken out for being considered redundant and of little help; thus making up the SNOT-20. Moreover, the way to calculate the final score was simplified, it is only the summation of the scores from each question; however, with one relevance classification: the patient must point to the five items which are the most important for him/her. The scores from each question vary between 0 and 5 - meaning that higher scores mean greater problems. The impact of each treatment is measured by the difference in pre and post treatment scores2.

In order to create the SNOT-22, the classification of relevance was removed, and two new questions were included (nasal obstruction and reduction of olfaction and taste) because of the concern associated with content validity, i.e., the instrument's capacity to properly measure all the important aspects associated with the disease at hand; bearing in mind that nasal obstruction is the symptom which most forces patients to seek otorhinolaryngological care, and hyposmia is a symptom which does not frequently improve after surgery3.

Since this is a questionnaire in English, in order to use it in our country we need to translate it into Brazilian Portuguese. Nonetheless, a simple translation may not be effective, because of cultural and linguistic differences between the peoples. Moreover, the meaning of quality of life and the ways through which health problems are expressed vary between different cultures1. For this reason, there is the need to translate and to culturally adapt the SNOT-22 for the Brazilian setting.

The goal of the present paper is to do the translation, cultural adaptation and validation of the SNOT-22 questionnaire from English into Brazilian Portuguese (BR).


MATERIALS AND METHODS

This study was approved by the Ethics in Research Committee of the institution, under protocol No. 0516/11, and the participants signed an informed consent form.

Translation

The translation of the quality of life questionnaires required five main stages: (1) translation and (2) retranslation, (3) review by a translation and retranslation committee, (4) equivalence pre-test with bilingual individuals, and (5) re-examination of the scores' weights, when relevant, as proposed by Guillemin1.

Recruitment of subjects

After the translation, we started to recruit the subjects. Our sample was made up by patients being followed at the Rhinology Ward of the institution, diagnosed with chronic rhinosinusitis or sinonasal polyps (SNP), submitted to endoscopic sinonasal surgery. As exclusion criteria, we considered age below 18 years and the wish not to participate in the study.

The diagnosis of CRS and SNP was based on the European Consensus on Rhinosinusitis: inflammation of the nose and paranasal sinuses, characterized by two or more symptoms, one of them being nasal obstruction or rhinorrhea, besides facial pain and reduction in the sense of smell, for at least 12 consecutive weeks. The endoscopic exam of the nose may reveal mucous-purulent discharge from the middle meatus or edema and middle meatus block. In SNP, polyps may be present in both middle meatuses.

Eligible patients who consented with the study, answered the SNOT-22 questionnaire prospectively in the preoperative and 3 months after surgery. The total score may vary between 0 and 110, and higher scores mean worse quality of life associated with health. Moreover, in the post-op the patients answered as to the transition classification, i.e., if after the surgery they were: (1) much better, (2) a little better, (3) the same, (4) a little worse or (5) much worse, when compared to before surgery.

The test-retest reliability was carried out in a separate sample of patients with CRS or SNP. The SNOT-22 questionnaire was employed twice during the routine visit of the patient, by different physicians. 10 to 14 days afterwards, the patient answered the questionnaire again, by telephone, to one of the physicians.

The SNOT-22 scores in a normal population, knowingly without sinonasal disease was calculated. The subjects who participated in the study were recruited among members of the medical staff, hospital staff and students from a university, and companions to patients seen in our service. The volunteers were asked whether they suffered from or had suffered rhinitis, chronic rhinosinusitis or sinonasal polyps, and whether they were using nasal medication, and were taken off the study when answered yes to any of these questions.

Data analysis

The reliability was analyzed in two ways: internal consistency and test and re-test reproducibility. Internal consistency has to do with the way with which each question is associated with the others in the questionnaire, because there has to be homogeneity among the items, which is measured by the Cronbach's alpha coeficient3. The minimum acceptable value is 0.73. The test and retest reproducibility measures the stability of an instrument along time after repetitive tests, and it is evaluated by the use of the questionnaire in different occasions, examining the correlation among the scores. The test and retest correlation must be of, at least, 0.7.

The validity of the measures is the capacity the questionnaire has to reflect differences between known groups, using the non-paired T-test. We will analyze the questionnaire's capacity to produce different scores between the group of patients with CRS and SNP, and the group of volunteers without sinonasal disease.

Responsiveness is the questionnaire's capacity to detect clinical changes with time. We will compare the pre and postoperative scores using the paired T-test. Responsiveness can also be assessed measuring the magnitude of the effect, which is the mean value of the scores variation divided by the standard deviation of the initial values. By convention, an effect magnitude between 0.2 and 0.5 is considered a mild improvement; between 0.5 and 0.8, moderate improvement; and greater than 0.8, a great improvement in quality of life3.

Clinical interpretability can be calculated by the minimally important difference (MID)8, which is the best score difference that a group of patients can detect as real improvement. For that, the patients will be broken down into transition groups, telling whether or not they are, after the procedure: (1) much better, (2) a little better, (3) the same as before, (4) a little worse or (5) much worse. The score variation mean value will be calculated for each transition group. The MID will be the score variation mean value of the "little better" class subtracted from the score variation mean value of the "same as before" class3.

For statistical purposes, values of p<0.05 were considered significant results.


RESULTS

Translation

Chart 1 shows the results from the SNOT-22 translation and cultural adaptation.

Patients' characteristics

We grouped 89 patients who were submitted to sinonasal functional endoscopic surgery and filled out the questionnaire before and after surgery; 56.18% were women, with mean age of 44.87 years (18 to 70; SD=13.52). Of the 89 patients, 44 (40.44%) had SNP, with mean age of 49 years (18 to 70; SD=11.36) and 45 (50.56%) had CRS, with mean age of 40.65 years (18 to 68; SD=14.35).

Among volunteers without sinonasal disease, we recruited 113 people, 56.64% women, with mean age of 23.35 years (18 to 61; SD=8.13).

Data obtained

The internal consistency of the questionnaire in the preoperative period was high, with a Cronbach's alpha coefficient of 0.9276. As we measure the internal consistency, removing one question at a time, we noticed alpha values varying between 0.9198 and 0.9301, showing that all questions were homogeneous.

The test-retest reproducibility was assessed with 24 CRS or SNP patients. The questionnaire was deployed by two different physicians, during consultation, resulting in a correlation of 0.81. The questionnaire use by one of the two physicians by phone, after 10 to 14 days had a correlation coefficient of 0.72.

The mean values of the total scores from the groups studied (without sinonasal disease, in the pre-op and post-op) are presented on Table 1. The instrument was capable to differentiate the groups studied, demonstrating its validity (p<0.0001 for each comparison). Even considering the SNP and CRS groups separately in the pre and post-op, there was a difference between these groups and the group without sinonasal disease (Tables 2 and 3).

The mean value of the scores from each question in each of the groups studied is presented on Table 4, which also shows the mean variation between pre and post-op scores for each question.

The statistically significant reduction in the postoperative scores, vis-à-vis preoperative values, demonstrates the instrument's responsiveness, as we can see on Table 5. The magnitude of the surgery's effect after 3 months was 1.55 - considered high (>0.8). In patients with CRS, the magnitude effect was 1.50 and in those with SNP, the effect was higher: 1.60.

We obtained the classification as to the clinical condition after surgery from 81 patients. The mean score variation in the pre and post-op from each transition group can be seen on Table 6. The minimally important difference was 13.87 points. This means that changes smaller than 14 points in the SNOT-22 may not be seen as improvement or worsening for the patient.

DISCUSSION

Outcome questionnaires are usually employed by self-administration, as the origin questionnaire of the present study3. Nonetheless, given the difficulties in reading and understanding the text by part of the population seen in our service, we decided to standardize the way through which the SNOT-22 questionnaires are administered: we read the questions to the patients, as it has been done by some Brazilian authors9,10. The administration of the questionnaire to the patients by the examiner has some advantages over self-administration, such as faster filling out time, lower rate of missing data, and interviewees' preference11. Moreover, we believe that this way of using the questionnaires can reduce possible differences in results which its administration by telephone (in the test-retest reproducibility evaluation) could bring about, so much so that the questionnaire demonstrated a high reproducibility rate. Despite difficulties presented by some patients, non-specific questions presented heterogeneity in relation to the others, with a high Cronbach's alpha coefficient.

Responsiveness is one of the main qualities of the SNOT-22. Its predecessor - SNOT-20, had an important drawback because it is not very sensitive to clinical changes2,.3,5. The introduction of questions about hyposmia (question 21) and nasal obstruction (question 22) have clearly increased the questionnaire's validity, because they are two very important complaints that motivate the patient to seek medical care3. Our study has shown that the Brazilian version of the SNOT-22 is efficient to measure changes after surgical treatment. Question 22 was the one showing the greatest difference between pre-op and post-op situations (2.94 points), demonstrating its importance in this questionnaire. The mean score reduction was 39.53 points after surgery, with a greater impact on patients with SNP (a reduction of 44.16 points). The original SNOT-22, in English, demonstrated a lower reduction in the postoperative, but with a similar pattern (greater reduction in patients with SNP)3. The effect magnitude was considered high in our study as well as in the original study with the SNOT-22 in English (1.57 and 0.81, respectively), also with a higher effect on patients with SNP (1.60 and 0.90, respectively)3.

The SNOT-22 proved capable of differentiating groups of patients with sinonasal diseases from individuals without nasal disease. The mean values of the scores from patients with CRS or SNP are far from the mean score of healthy individuals. Our sample of healthy individuals had a mean score of 11.42 points, close to the one presented by Hopkins et al.3 - 9.3. A study from the same group advocated the use of the median as normality threshold, instead of the mean, since SNOT-22 values in healthy patients do not tend to normal distribution. Therefore, they considered 7 as the normality threshold for the SNOT-2212. Utilizing such criterion, the normality threshold for the Brazilian SNOT-22, given our sample, would be 10. With that, we would have only two patients with normal SNOT-22 indices in the pre-op and 24 in the post-op, of the 93 operated individuals. Even after surgery, the mean scores had significant differences between sick and healthy individuals, demonstrating how the instrument can capture differences between these groups, including after surgery. We chose to use a group without sinonasal diseases with a lower mean age than the study group, because since the questionnaire involves general and specific questions, a younger group would tend to present lower scores, they would present lower general complaints.

Clinical interpretability is the main challenge for the researchers interested in measuring life-quality questionnaires, because these questionnaires do not produce intuitively significant data, making it difficult to interpret the clinical importance of the differences between groups and individuals. Our study estimated the minimally important difference to be 14 points, near the estimated value in the original SNOT-22 in English, which was of 9 points3. This means that, in our questionnaire, variations up to 14 points may not be interpreted as improvement or worsening by the patient.


CONCLUSION

The Brazilian Portuguese version of the SNOT-22 is a valid instrument to assess patients with CRS and SNP, it demonstrated internal consistency, reproducibility, validity and responsiveness.


REFERENCES

1. Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417-32.

2. Picirillo JF, Merritt MG, Richards ML. Psychometric and clinimetric validity of the 20-item Sino-Nasal Outcome Test (SNOT-20). Otolaryngol Head Neck Surg. 2002;126(1):41-7.

3. Hopkins C, Gillett S, Slack R, Lund VJ, Browne JP. Psychometric validity of the 22-item Sinonasal Outcome Test. Clin Otolaryngol. 2009;34(5):447-54.

4. Glicklich RE, Metson R. The health impact of chronic sinusitis in patients seeking otolaryngologic care. Otolaryngol Head Neck Surg. 1995;113(1):104-9.

5. Hopkins C. Patient reported outcome measures in rhinology. Rhinology. 2009;47(1):10-7.

6. Morley AD, Sharp HR. A review of sinonasal outcome scoring systems - which is best? Clin Otolaryngol. 2006;31(2):103-9.

7. Van Oene CM, Van Reij EJF, Sprangers MAG, Fokkens WJ. Quality-assessment of disease-specific quality of life questionnaires for rhinitis and rhinosinusitis: a systematic review. Allergy. 2007;62(12):1359-71.

8. Jaeschke R, Singer J, Guyatt GH. Measurement of health status. Ascertaining the minimal clinically important difference. Control Clin Trials. 1989;10(4):407-15.

9. Klatchoian DA, Len CA, Terreri MT, Silva M, Itamoto CH, Ciconelli RM, et al. Quality of life of children and adolescents from São Paulo: reliability and validity of the Brazilian version of the Pediatric Quality of Life Inventory version 4.0 Generic Core Scales. J Pediatr (Rio J). 2008;84(4):308-15.

10. Fonseca ESM, Camargo ALM, Castro RA, Sartori MGF, Fonseca MCM, Lima GR, et al. Validation of a quality of life questionnaire (King´s Health Questionnaire) in Brazilian women with urinary incontinence. Rev Bras Ginecol Obstet. 2005;27(5):235-42.

11. Weinberger M, Oddone EZ, Samsa GP, Landsman PB. Are health-related quality-of-life measures affected by the mode of administration? J Clin Epidemiol. 1996;49(2):135-40.

12. Gillett S, Hopkins C, Slack R, Browne JP. A pilot study of the SNOT 22 score in adults with no sinonasal disease. Clin Otolaryngol. 2009;34(5):467-9.










1. MSc in Sciences, Chief Preceptor of the ENT Residency Program - UNIFESP-EPM (Paulista School of Medicine - Federal University of São Paulo).
2. MD - PUC-Sorocaba; 3rd-Year ENT Resident - UNIFESP-EPM.
3. MD - UNIFESP-EPM; 3rd-Year ENT Resident - UNIFESP-EPM.
4. 6th-Year Medical Student - UNIFESP-EPM.
5. MD. ENT - UNIFESP-EPM; MSc Student - UNIFESP-EPM.
6. Associate Professor of Rhino-Laryngology UNIFESP-EPM, Vice-Chief - Department of Otorhinolaryngology and Head and Neck Surgery - UNIFESP-EPM.

Rhinology sector - Rhinolaryngology Discipline - Department of Otorhinolaryngology and Head and Neck Surgery - Federal University of São Paulo - Paulista School of Medicine.

Send correspondence to:
Dr. Eduardo Macoto Kosugi
Rua Dr. Diogo de Faria, 1202, cj. 91, Vila Clementino
São Paulo - SP. CEP: 04037-003
E-mail: edumacoto@uol.com.br

Paper submitted to the BJORL-SGP (Publishing Management System - Brazilian Journal of Otorhinolaryngology) on May 29, 2011
Accepted on July 30, 2011. cod. 7969

Print: