|
|
||||||||
Scientific Section |
York District Hospital, York, UK
Richard Cousley, Orthodontic Department, Peterborough District Hospital, Thorpe Road, Peterborough, Cambridgeshire, PE3 6DA, UK. Email: Richard.Cousley{at}pbh-tr.nhs.uk
| Abstract |
|---|
|
|
|---|
Design: A retrospective investigation involving the random selection of Class II orthognathic patients from surgical records.
Subjects: These 25 cases had undergone treatment aimed at producing Class I incisors. This involved fixed orthodontic appliances and a mandibular advancement osteotomy with rigid internal fixation.
Methods: Lateral cephalographs from three key stages were digitized and processed using the OPAL software. Pre-treatment predictions were generated and compared with the actual clinical changes.
Results: Prediction of some of the principal OPAL variables (SNA, ANB, LAFH%, OJ, OB) was reasonably accurate in terms of mean values. However, there were large individual variations for most measurements, and prediction of Wits, MxP/MnP, LAFH, and LPFH was prone to systematic error. In particular, there was a tendency towards over-prediction of the surgically-induced backward mandibular rotation.
Conclusion: In lieu of further validation caution should be exercised with the interpretation of individual OPAL predictions, especially vertical skeletal changes, and an explanation given to patients that orthognathic predictions are based on generalizations.
Key words: Class II, computerized prediction, OPAL, orthognathic surgery
| Introduction |
|---|
|
|
|---|
| Material and methods |
|---|
|
|
|---|
Each lateral cephalograph was digitized directly using a backlight-illuminated platform and a digitizing pad. Twenty-three radiographic landmarks were identified and digitized, along with the continuous (stream mode) tracing of five soft and hard tissue outlines. All of these tracings were undertaken by one operator (RC) and the radiographs for each individual were digitized serially in order to minimize random error variance, as recommended by Houston.14
The data were processed using the OPAL software. Significantly, the standard OPAL analysis utilizes values based on the Eastman Analysis,15
which is widely used by UK orthodontists. Twelve specific linear and angular dental and skeletal measurements were identified as being most relevant for this study: SNA, SNB, ANB, MxP/MnP, LAFH%, LAFH, LPFH, OJ, OB, U1/MxP, L1/MnP, and Wits.16
These were calculated and rounded to the nearest 0.1 mm/ degree.
Method error study
Twenty-five cephalographs were randomly selected and retraced at least 1 month after the original recordings. As recommended by Houston14
and Battagel,17
the method error was assessed for error variance using Dahlbergs formula: mean square error (SE2) =
d2/2n (where d is the difference between repeated measurements and n is the number of radiographs recorded). A repeated measures t-test was also performed to assess systematic error.
Cephalometric analysis
Each individuals cephalometric tracings were superimposed to evaluate the actual changes that occurred during the treatment period. The OPAL software was used to generate a pre-treatment prediction of the orthodontic and surgical treatment, where the incisor inclinations were normalized (according to Eastman values) and the mandible advanced to produce a Class I incisor relationship. Predicted changes were calculated as the differences between the prediction analysis and baseline measurements. This prediction was then compared to the actual post-treatment measurements, and the differences analysed in terms of data distribution and by a paired t-test.
| Results |
|---|
|
|
|---|
|
Comparison of the predicted and actual cephalometric changes
Five out of the 12 OPAL measurements (SNA, ANB, LAFH%, OJ and OB) displayed small mean differences (less than 0.5 unit) between the predicted and actual values (Table 2
). The SNA, LAFH%, OJ, and OB results also showed reasonable consistency with narrow data distributions. Conversely, the largest mean discrepancy was observed for the Wits variable (5.9 mm) and three other variables had clinically relevant differences: MxP/ MnP, LAFH and LPFH. Paired t-tests also revealed statistically significant differences (P < 0.05) for the Wits, LAFH and LAFH% values, and LPFH had marginal significance (P = 0.06). However, interpretation of these apparent prediction errors is complicated by the occurrence of residual vertical facial growth in many cases during the treatment period. In reality, the LAFH increased and LPFH reduced between the pre- and post-treatment stages (Table 1
), but OPAL under-predicted these changes. This was associated with a clinically significant systematic error in MxP/MnP. This value was over-predicted by a mean of 1.9 degrees, although this result was not statistically significant. MxP/MnP and four other variables (LPFH, Wits, L1/MnP and U1/Man) also had high standard deviations and wide confidence intervals.
|
| Discussion |
|---|
|
|
|---|
Assessment of TIOPS (Total Interactive Orthodontic Planning System) software in several consecutive studies also led to the observation that there were no statistically significant mean differences between the predictions and post-operative results.8,
9,
10
Initially, the authors concluded that the surgical results were acceptably predictable and, in common with other studies,6,
7,
12
they failed to discuss the large variability evident in their results.8
Subsequently, when large standard deviations were noted in a study of 40 consecutive cases it was opined that the errors occurred during the model surgery and surgical stages rather than the prediction process per se.9
An analysis of Dentofacial Planner pre-surgical predictions in mandibular setback cases revealed systematic errors in the OJ, mandibular angle and LAFH, but the distribution of the predicted versus actual differences was not discussed.3
The relatively large standard variations evident with both Dentofacial Planner and Quick Ceph was noted in a study of 28 cases, but this investigated soft tissues only.1
The authors concluded that there was generally good accuracy in the overall sample but with marked variability in the prediction consistency. This comparative study of Dentofacial Planner and Quick Ceph also found evidence of wide variations in the accuracy of specific (soft tissue) landmark predictions.1
Interestingly, these errors appeared to be related to the reproducibility/prediction of specific landmarks rather than any discernible difference between the two software packages. These wide sample variations are similar to that observed here with OPAL predictions, especially where MxP/MnP, LPFH, Wits, L1/ MnP, and U1/Man exhibited large standard deviations and confidence intervals (Table 2
). These wide individual deviations tended to be camouflaged by a regression to the mean. As such, it should not be assumed that individual patients will follow the mean pattern of small differences between their predicted and actual values, especially for vertical skeletal and incisor inclination measurements. In reality, it is very difficult to determine how much of the discrepancy between a predicted and actual result is due to inaccuracies in one or more of the following preparatory and surgical stages: landmark identification, digitizing, cephalometric software manipulation, transfer of movements from the prediction to articulated models, model surgery, surgical technique, and early settling/relapse. It is also worth remembering that predictions are two-dimensional representations of 3D features.
Aside from significant individual variability, systematic prediction error was seen in several measurements: MxP/MnP, LAFH and LPFH, with the differences in the latter two being statistically significant. As the mandible was advanced it underwent a backward rotation (Table 1
), but this increase in the MxP/MnP was over-estimated by the pre-treatment OPAL prediction (Table 2
). This is consistent with the subjective observation of an exaggerated mandibular plane angle on individual prediction tracings and may be associated with closure of molar open bites by the OPAL software. Conversely, when TIOPS was tested in nine mandibular advancement cases an under-prediction in the MxP/ MnP increase was observed.10
A Dentofacial Planner study of 18 mandibular setbacks also revealed a mean under-prediction of the MxP/MnP increase by at least 3 degrees, although the source of this discrepancy was not evaluated.3
The relatively greater inaccuracy of vertical change has also been noted in soft tissue analyses.19
It is likely that these discrepancies in mandibular height and inclination may be due to inaccuracies in simulation of the mandibular rotational effects and angle remodelling, especially given the alteration in gonion landmark identification.
Finally, it would be interesting to assess the correlation between the amount of orthodontic/skeletal changes and prediction accuracy, but the sample size here was insufficient for robust statistical analysis. Previously, Aharon et al.1
found a linear relationship between the prediction error and the surgical change for the majority of soft tissues landmarks, i.e. the greater the surgical movement the greater the prediction error. Indeed, in some cases the error exceeded the actual change observed. Unfortunately, their sample size of 28 cases prevented any further analysis of this relationship. Similarly, analysis of soft tissue changes in 25 cases of mandibular advancement showed a correlation between the magnitude of movement and error.4
| Conclusions |
|---|
|
|
|---|
| Acknowledgments |
|---|
| References |
|---|
|
|
|---|
2 Eales E, Newton C, Jones ML, Sugar A. The accuracy of computerised prediction of the soft tissue profile: a study of 25 patients treated by means of the Le Fort I osteotomy. Int J Adult Orthod Orthognath Surg 1994; 9: 14152.
3 Kolokitha OG, Athanasiou AE, Tuncay OC. Validity of computerized predictions of dentoskeletal and soft tissue profile changes after mandibular setback and maxillary impaction osteotomies. Int J Adult Orthod Orthognath Surg 1996; 11: 13754.
4 Schlutes G, Gaggl A, Karcher H. Accuracy of cephalometric and video imaging program Dentofacial Planner Plus in orthognathic surgical planning. Comput Aided Surg 1998; 3: 10814.[CrossRef][Medline]
5 Gerbo LR, Poulton DR, Covell DA, Russell CA. A comparison of a computer-based orthognathic surgery prediction system to postsurgical results. Int J Adult Orthod Orthognath Surg 1997; 12: 5563.
6 Hing, NR. The accuracy of computer generated prediction tracings. Int J Oral Maxillofac Surg 1989; 18: 14851.[CrossRef][Medline]
7 Loh S, Heng JK, Ward-Booth P, Winchester L, McDonald F. A radiographic analysis of computer prediction in conjunction with orthognathic surgery. Int J Oral Maxillofac Surg 2001; 30: 25963.[CrossRef][Medline]
8 Donatsky O, Hillerup S, Bjorn-Jorgensen J, Jacobsen PU. Computerized cephalometric orthognathic surgical simulation, prediction and postoperative evaluation of precision. Int J Oral Maxillofac Surg 1992; 21: 199203.[CrossRef][Medline]
9 Donatsky O, Bjorn-Jorgensen J, Holmqvist-Larsen M, Hillerup S. Computerized cephalometric evaluation of orthognathic surgical precision and stability in relation to maxillary superior repositioning combined with mandibular advancement or setback. J Oral Maxillofac Surg 1997; 55: 10719.[CrossRef][Medline]
10 Hillerup S, Bjorn-Jorgensen J, Donatsky O, Jacobsen PU. Precision of orthognathic surgery. Int J Oral Maxillofac Surg 1994; 23: 25561.[CrossRef][Medline]
11 Harradine NWT, Birnie DJ. Computerized prediction of the results of orthognathic surgery. J Maxillofac Surg 1985; 13: 2459.[CrossRef][Medline]
12 Eales EA, Jones ML, Newton C, Sugar AW. A study of the accuracy of predicted soft tissue changes produced by a computer software package (COG 3.4) in a series of patients treated by the Le Fort I osteotomy. Br J Oral Maxillofac Surg 1995; 33: 3639.
13 Bryan DC, Hunt NP. Surgical accuracy in orthognathic surgery. Br J Oral Maxillofac Surg 1993; 31: 34350.[CrossRef][Medline]
14 Houston WJB. The analysis of errors in orthodontic measurements. Am J Orthod 1983; 83: 38290.[CrossRef][Medline]
15 Harris M, Reynolds IR. Cephalometric analysis. In: Fundamentals of Orthognathic Surgery. London: WB Saunders Company, 1991: 3848.
16 Jacobson A. The Wits appraisal of jaw disharmony. Am J Orthod 1975; 67: 12538.[CrossRef][Medline]
17 Battagel JM. A comparative assessment of cephalometric errors. Eur J Orthod 1993; 15: 30514.
18 Trpkova B, Major P, Prasad N, Nebbe B. Cephalometric landmarks identification and reproducibility: a meta analysis. Am J Orthod Dentofac Orthop 1997; 112: 16570.[CrossRef][Medline]
19 Upton PM, Sadowsky PL, Sarver DM, Heaven TJ. Evaluation of video imaging prediction in combined maxillary and mandibular orthognathic surgery. Am J Orthod Dentofac Orthop 1997; 112: 65665.[CrossRef][Medline]
Received August 29, 2002; accepted September 26, 2002
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |