- Open Access
- Open Peer Review
TRACE (Trunk Aesthetic Clinical Evaluation), a routine clinical tool to evaluate aesthetics in scoliosis patients: development from the Aesthetic Index (AI) and repeatability
Scoliosisvolume 4, Article number: 3 (2009)
Aesthetic appearance is of primary importance in the treatment of adolescent idiopathic scoliosis (AIS), but to date tools for routine clinical practice have not become available. The aim of the present study is to develop such a tool and to verify its repeatability.
Instrumentation: At first we developed the Aesthetic Index (AI), based on a three-point scale for asymmetry of the shoulders, scapulae and waist that we tested for 5 years. From this experience we developed another tool we called TRACE, the acronym of Trunk Aesthetic Clinical Evaluation; TRACE is a 12-point scale based on four sub-scales, shoulders (0–3), scapulae (0–2), hemi-thorax (0–2) and waist (0–4).
Population: Posterior-anterior (PA) photographs of one hundred-sixty AIS patients
Procedures: Each photograph was scored in two independent tests by four observers using AI, and subsequently TRACE.
Data analysis: Kappa statistical analysis and 95% level of agreement were used; we also identified the minimum significant change (95% confidence level).
We found the intra- and inter-raters repeatability of AI to be fair. Three points out of seven was the minimum significant change between two different evaluations. For TRACE, intra-rater repeatability was fair and inter-raters poor; but the minimum significant change was three (intra-rater), or four (inter-raters) out of twelve points.
Widening the scale from 7 (AI) to 12 points (TRACE) increased the clinical sensitivity to changes of the aesthetic scale, even if TRACE has only a fair repeatability. TRACE is a no-cost tool for routine clinical practice in AIS patients. Due to the absence of other comparable validated tools, once the inherent measurement error is known and understood, its routine clinical use by physicians is advised.
Aesthetic appearance is a primary consideration in the treatment of scoliosis. This has been clearly stated in a consensus by SOSORT experts, in which aesthetic improvement has become the main goal of scoliosis treatment. Orthopaedic surgeons share this view of the relevance of aesthetics; in a recent study concerning the importance of physical deformity of patients with adolescent idiopathic scoliosis, "the severity of deformity" consistently ranked as the most important clinical consideration when proposing surgical treatment to patients. Some attempts to measure and monitor aesthetics have been made. Some questionnaires, such as SRS 22, include domains concerning aesthetics, while some questionnaires have been designed and validated specifically to measure the perception of spinal deformity by the patient (or the parent). This is the case of the Walter Reed Visual Assessment Scale  and the more recently developed "Spinal Appearance Questionnaire" . These instruments have the advantages of considering the patient's subjective judgement of his own aesthetics, but this does not correspond to the objective situation as can be judged by an external observer. This means that these are more psychological than aesthetic evaluation tools.
Various high-tech instruments for trunk surface evaluation are available, such as ISIS, Formetric, Quantec, AUSCAN and others [6–12], but none has reached any kind of consensus or is used extensively in routine clinical practice. This is particularly attributable to the high cost of such instruments, which limits availability to hospitals and clinics while hindering the integration of these instruments into standardized procedures. Attempts have been made to establish the inter-rater reliability of aesthetics clinical evaluation in AIS patients, but the results have not been satisfactory . Thus, despite the judgment among physicians that aesthetics is of great importance in AIS patients, there are no clinical practice tools by which to assess its changes during treatment.
The objective of the present study was to develop an routine clinical tool and verify its intra- and inter-rater repeatability in the assessment of aesthetics in AIS patients.
For more than twenty years our group has evaluated the aesthetics of the posterior trunk, ranking the asymmetry of the shoulders, scapulae and waist (0 absent, 1 slight, 2 important) even if without giving to this evaluation a great importance. Facing the needs reported in the introduction, in the last five years we set out to build on our experience to develop a new clinical tool called the Aesthetic Index (AI), which corresponds to the sum of these three subscale scores.
Posterior-anterior (PA) photographs of one hundred-sixty AIS patients
Each photograph has been scored twice independently by four observers. In this way we had four pairs of intra-rater and four pairs of inter-rater evaluations. Each single observer performed the evaluation twice, and there was an interval of one week between observations.
We used Kappa statistics (0–0.2 poor, 0.2–0.4 fair, 0.4–0.6 moderate, 0.6–0.8 good, 0.8–1.0 very good), an index of the observer disagreement which compares the agreement found against that which might be expected by chance. Kappa can be thought of as the chance-corrected proportional agreement, and possible values range from +1 (perfect agreement) via 0 (no agreement above that expected by chance) to -1 (complete disagreement). Despite published controversies [14–16], Kappa statistics are still widely used. In particular, we are aware that Kappa may be low even though there are high levels of agreement and even though individual ratings are accurate. Whether a given kappa value implies a good or a bad rating system or diagnostic method depends on what model one assumes about the decision making of raters . Accordingly we also used the Percent of agreement, the percentage of the answers that were equal in the two repeated measures. Moreover, for clinical purposes, we present the 95% level of agreement, or the number of points of difference needed to reach an agreement of 95%. To give an example: for the rater who obtained the worst results the Percent of agreement for TRACE was 28.8% (Table 1), but if the repeated measurements one point above (or below) are considered, a 99.4% of agreement can be reached. This corresponds to a 95% of agreement of 2 points out of 12. This result has an high clinical significance, because it means that, in everyday practice, considering two evaluations made by the same rater, a real change occurs only if the variation is over the 95% level of agreement, that in the example given corresponds to 3 points out of 12.
Second Study: TRACE
Given the results from the first part of our study, we developed a new scale called TRACE, that is the acronym of Trunk Aesthetic Clinical Evaluation), for the purpose of improving the AI widening (and deepening) the scale.
TRACE is based on four sub-scales: shoulders, scapulae and waist (which were already present in the AI), and the hemi-thorax (Fig 1, 2, 3, 4). However, the scores for each sub-scale were changed with respect to AI: shoulders now ranged from 0–3, waist from 0–4, scapulae from 0–2 and hemi-thorax from 0–2. From these sub-scales we calculated TRACE, using the sum of the sub-scale scores to reach a 12-point scale. These changes were based on our experience in using the AI. We realized that for the shoulders it was easy to define more intermediate values, so we defined asymmetry as slight (1), moderate (2) or important (3). For the waist it was easy to define a total asymmetry (a score of 4) when one flank was straight or when there was a lateral decompensation of the trunk. It was easy as well to define a very slight (a score of 1) and an important but not complete (a score of 3) asymmetry. Between these points we defined a mild asymmetry (a score of 2). The hemi-thorax item was created as a complement of the scapulae, since we noted that occasionally there is an evident prominence of the last ribs of the back even when there is no real asymmetry in the scapulae.
The testing procedure of TRACE was similar to that of AI: The same 160 PA photographs of the trunks of AIS patients were evaluated by the same observers through the use of the same procedure.
The same statistical analysis used for AI was performed. We also correlated the AI scores with TRACE by comparing the values of the shoulders and waist, as well as the overall value of TRACE. The scapulae were not included in the analysis because the scores did not change.
Regarding the AI, we found the repeatability of both intra- and inter-raters to be fair (range of Kappa value 0.28–0.41 and 0.17–0.28 respectively). The waist was the more reproducible sub-score, rating good and fair, respectively, for intra- and inter-raters (Table 2). At the 95% level of agreement, we found that three points out of seven was the minimum change to be considered significant between two different evaluations both for the same and different raters.
Widening the scale with TRACE, we found intra-rater repeatability to be fair, while inter-raters were poor (Kappa value: 0.16–0.24 and 0.09–0.14 respectively; Table 1). All sub-scores graded as moderate for intra-rater, while the inter-rater was lower (moderate for the scapulae, poor for the waist and fair for the other subscores). At the 95% level of agreement, we found that three points out of twelve was the minimum change to be considered significant between two different evaluations for the same rater, while four out of twelve was the minimum for different raters.
With this paper we aimed to develop a routine clinical tool for aesthetic evaluation of scoliosis patients, evolving from our yearly experience in grading some parameters (shoulders, scapulae, waist).
The goal was to verify the intra- and inter-rater repeatability, but most of all the sensitivity to change in a clinical setting. A secondary aim was to build on our experience to develop a new tool to be studied. Our first evaluation showed an overall fair repeatability for AI. Buchanan et al.  found a similar reliability for the intra- and inter-observer cosmetic deformity rating among a group of orthopaedic surgeons. However, the present study revealed a low sensitivity of AI to changes; indeed, a three-point change out of seven is the minimum change that could be considered significant. This limits the application of the AI to the detection of major changes. Therefore, we broadened all applicable parameters, determined through our experience to be easily detectable, and developed TRACE. While maintaining the same fair intra-rater repeatability, a higher sensitivity to changes is the main feature of TRACE. In fact, the 95% level of agreement remained similar (2 points both for AI and TRACE for intra-rater) but the scale was now of 12 instead of 7 points (almost double that of AI): A score of three points out of twelve represents a significant change during treatment when the observer is the same. This makes TRACE much more useful than AI, since it makes it possible to objectively monitor the aesthetic effects of treatment. Both AI and TRACE have been used as research tools, and we documented that TRACE is sensitive enough to detect changes induced by a brace treatment [18–20]. Moreover, this is a "no-cost" tool that can be used easily and quickly during each clinical assessment. It requires neither expensive instruments nor prolonged evaluation sessions. Usually it is sufficient to mark the sub-scale values and calculate the total TRACE score, such that in routine clinical practice photographic comparison is not needed (as we usually do since 5 years with our ISICO database software) [19, 21–23].
Trunk deformity significantly influences AIS patients' perception of function and self-image . Therefore, both rehabilitation experts and surgeons emphasise this aspect in the decision-making process in AIS [1, 2, 25]. To date, the main outcome measures concerning the aesthetic effects of treatment are related to prominence changes  and the improvement of vertebral rotation  after brace treatment, to reduced Cobb angle after surgery [28, 29], or the improvement in self-perception of the deformity as assessed by questionnaire. Some attempts to quantify aesthetic deformity with a clinical assessment have been performed: Theologis proposed a "Cosmetic Spinal Score (CSS)," according to which ten non-medical judges evaluated colour pictures of AIS patients . The limit of this evaluation is that it gives a score pertaining to a general impression of the patient's back but is not based on precisely defined sub-scores. Nevertheless, CSS was shown to be related principally to rib hump and trunk side shift. Moreover, we have no data concerning its reliability when performed by expert physicians.
The principle that scoliosis is not simply a curvature indicated through x-ray imaging and that there is a need for appropriate outcome measures to supplement Cobb angle has been widely recognized [1, 25]. TRACE provides a semi-quantitative scale for clinical assessment of deformity in AIS, based on specifically defined sub-scales. Knowing the limits and the repeatability of this scale will give clinicians more reliability in the routine clinical assessment of deformity, and will provide other sensitive outcome measures. TRACE is consistent with this need, and it can readily be used in the clinical evaluation of AIS patients and for research.
One limitation of this study was the use of pictures instead of an immediate evaluation of patients. Nevertheless, evaluation through pictures has been the standard applied in previous studies,[2, 4, 5] and we can presume the repeatability to be even greater during routine clinical practice due to the opportunity for a three-dimensional evaluation of the patient. In fact, photographs are static while a three-dimensional clinical assessment presumably can be more consistently recorded by the physician, and in future studies can provide a tool to compare TRACE with the POTSI index. Another limit could be the low Kappa Statistics values obtained, even if comparable to those obtained by others evaluating aesthetics previously; but is less important for clinical routine use than the minimum significant change.
This study documents the evolution of TRACE from AI. TRACE is sufficiently repeatable and sensible for routine clinical practice, and therefore comprises is a no-cost tool designed for the conservative clinical setting.
Negrini S, Grivas TB, Kotwicki T, Maruyama T, Rigo M, Weiss HR: Why do we treat adolescent idiopathic scoliosis? What we want to obtain and to avoid for our patients. SOSORT 2005 Consensus paper. Scoliosis. 2006, 1: 4-10.1186/1748-7161-1-4.
Donaldson S, Hedden D, Stephens D, Alman B, Howard A, Narayanan U, Wright JG: Surgeon reliability in rating physical deformity in adolescent idiopathic scoliosis. Spine. 2007, 32 (3): 363-367. 10.1097/01.brs.0000253605.71168.2e.
Asher M, Min Lai S, Burton D, Manna B: The reliability and concurrent validity of the scoliosis research society-22 patient questionnaire for idiopathic scoliosis. Spine. 2003, 28 (1): 63-69. 10.1097/00007632-200301010-00015.
Sanders JO, Polly DW, Cats-Baril W, Jones J, Lenke LG, O'Brien MF, Stephens Richards B, Sucato DJ: Analysis of patient and parent assessment of deformity in idiopathic scoliosis using the Walter Reed Visual Assessment Scale. Spine. 2003, 28 (18): 2158-2163. 10.1097/01.BRS.0000084629.97042.0B.
Sanders JO, Harrast JJ, Kuklo TR, Polly DW, Bridwell KH, Diab M, Dormans JP, Drummond DS, Emans JB, Johnston CE: The Spinal Appearance Questionnaire: results of reliability, validity, and responsiveness testing in patients with idiopathic scoliosis. Spine. 2007, 32 (24): 2719-2722.
Weisz I, Jefferson RJ, Turner-Smith AR, Houghton GR, Harris JD: ISIS scanning: a useful assessment technique in the management of scoliosis. Spine. 1988, 13 (4): 405-408. 10.1097/00007632-198804000-00006.
Weisz I, Jefferson RJ, Carr AJ, Turner-Smith AR, McInerney A, Houghton GR: Back shape in brace treatment of idiopathic scoliosis. Clin Orthop Relat Res. 1989, 157-163. 240
Theologis TN, Jefferson RJ, Simpson AH, Turner-Smith AR, Fairbank JC: Quantifying the cosmetic defect of adolescent idiopathic scoliosis. Spine. 1993, 18 (7): 909-912. 10.1097/00007632-199306000-00016.
Liu XC, Thometz JG, Lyon RM, Klein J: Functional classification of patients with idiopathic scoliosis assessed by the Quantec system: a discriminant functional analysis to determine patient curve magnitude. Spine. 2001, 26 (11): 1274-1278. 10.1097/00007632-200106010-00020. discussion 1279.
Hackenberg L, Hierholzer E, Potzl W, Gotze C, Liljenqvist U: Rasterstereographic back shape analysis in idiopathic scoliosis after anterior correction and fusion. Clin Biomech (Bristol, Avon). 2003, 18 (1): 1-8. 10.1016/S0268-0033(02)00165-1.
Negrini A, Negrini S, Santambrogio GC: Data variability in the analysis of spinal deformity, a study performed by means of the AUSCAN system. Three Dimensional Analysis of Spinal Deformities. Edited by: D'Amico M, Merolli A, Santambrogio GC. 1995, Amsterdam: IOS Press, 101-106.
Negrini S, Negrini A, Rainero G, Sibilla P, Santambrogio GC: Correlation Between Trunk Gibbosity and the Spinal Torsion Measured by the AUSCAN System. Three Dimensional Analysis of Spinal Deformities. Edited by: D'Amico M, Merolli A, Santambrogio GC. 1995, Amsterdam: IOS Press – Ohmsha, 1: 279-283.
Buchanan R, Birch JG, Morton AA, Browne RH: Do you see what I see? Looking at scoliosis surgical outcomes through orthopedists' eyes. Spine. 2003, 28 (24): 2700-2704. 10.1097/01.BRS.0000103383.81904.5A. discussion 2705.
Cohen J: A coefficient of agreement for nominal scales. Educational and Psychological Measurement. 1960, 20: 37-46. 10.1177/001316446002000104.
Fleiss J: Measuring nominal scale agreement among many raters. Psychological Bulletin. 1971, 76: 378-381. 10.1037/h0031619.
Maclure M, Willett W: Misinterpretation and misuse of the kappa statistic. American Journal of Epidemiology. 1987, 126: 161-169.
Uebersax JS: Modeling approaches for the analysis of observer agreement. Invest Radiol. 1992, 27 (9): 738-743. 10.1097/00004424-199209000-00017.
Zaina F, Negrini S, Atanasio S: Brace treatment can change aesthetics in Adolescent Idiopathic Scoliosis (AIS) patients. 5th International Conference on Conservative Management of Spinal Deformities: 2008. 2008, Athens: SOSORT
Negrini S, Atanasio S, Zaina F, Romano M, Parzini S, Negrini A: End-growth results of bracing and exercises for adolescent idiopathic scoliosis. Prospective worst-case analysis. Stud Health Technol Inform. 2008, 135: 395-408.
Zaina F, Negrini S, Monticone M, Paroli C: TRACE (Trunk Aesthetic Clinical Evaluation), a new everyday clinical tool to assess adolescent idiopathic scoliosis patients aesthetics. 4th International Conference on Conservative Management of Spinal Deformities: 13–16 May 2007. 2007, Boston: SOSORT (Society on Scoliosis Orthopaedic and Rehabilitation Treatment)
Negrini S, Atanasio S, Fzaina F, Romano M: Rehabilitation of adolescent idiopathic scoliosis: results of exercises and bracing from a series of clinical studies. Europa Medicophysica-SIMFER 2007 Award Winner. Eur J Phys Rehabil Med. 2008, 44 (2): 169-176.
Negrini S, Atanasio S, Negrini F, Zaina F, Marchini G: The Sforzesco brace can replace cast in the correction of adolescent idiopathic scoliosis: A controlled prospective cohort study. Scoliosis. 2008, 3 (1): 15-10.1186/1748-7161-3-15.
Negrini S, Zaina F, Romano M, Negrini A, Parzini S: Specific exercises reduce brace prescription in adolescent idiopathic scoliosis: A prospective controlled cohort study with worst-case analysis. J Rehabil Med. 2008, 40 (6): 451-455. 10.2340/16501977-0195.
Asher M, Lai SM, Burton D, Manna B: The influence of spine and trunk deformity on preoperative idiopathic scoliosis patients' health-related quality of life questionnaire responses. Spine. 2004, 29 (8): 861-868. 10.1097/00007632-200404150-00008.
Turner-Smith AR, Harris JD, Houghton GR, Jefferson RJ: A method for analysis of back shape in scoliosis. J Biomech. 1988, 21 (6): 497-509. 10.1016/0021-9290(88)90242-4.
Grivas TB, Vasiliadis ES: Cosmetic outcome after conservative treatment of idiopathic scoliosis with a dynamic derotation brace. Stud Health Technol Inform. 2008, 135: 387-392.
Kotwicki T, Kinel E, Stryla W, Szulc A: Discrepancy in clinical versus radiological parameters describing deformity due to brace treatment for moderate idiopathic scoliosis. Scoliosis. 2007, 2: 18-10.1186/1748-7161-2-18.
Cochran T, Irstam L, Nachemson A: Long-term anatomic and functional changes in patients with adolescent idiopathic scoliosis treated by Harrington rod fusion. Spine. 1983, 8 (6): 576-584. 10.1097/00007632-198309000-00003.
Weinstein SL, Dolan LA, Cheng JC, Danielsson A, Morcuende JA: Adolescent idiopathic scoliosis. Lancet. 2008, 371 (9623): 1527-1537. 10.1016/S0140-6736(08)60658-3.
The Authors wish to thank Dr. Chiara Paroli and Dr. Marco Monticone for their kind help and collaboration in collecting data for this study.
The Authors wish to thank the "Officina Ortopedica Ortho Tecnica" – Via IV Novembre 93/B, 38014 GARDOLO (TN) of Fabrizio Tessadri for his contribution to covering the cost of this publication.
The authors declare that they have no competing interests.
All authors made substantial contributions to conception, design and acquisition of data; they have been involved in drafting and revising the manuscript; they have given final approval of the version to be published.