Comparison of the morphologic criteria (RECIST) and metabolic criteria (EORTC and PERCIST) in tumor response assessments: a pooled analysis
Article information
Abstract
Background/Aims
The Positron Emission Tomography Response Criteria in Solid Tumors (PERCIST) or European Organization for Research and Treatment of Cancer (EORTC) criteria are used to assess metabolic tumor responses. However, tumor responses have shown considerable discrepancies between the morphologic criteria (Response Evaluation Criteria in Solid Tumors [RECIST]) and metabolic criteria. We performed this pooled study to compare the RECIST and metabolic criteria in the assessment of tumor responses.
Methods
Electronic databases were searched for eligible articles with the terms “RECIST,” “PERCIST,” or “EORTC criteria.” The level of concordance in the tumor responses between the two criteria was estimated using κ statistics.
Results
A total of 216 patients were collected from eight studies comparing the RECIST and EORTC criteria. The agreement of tumor responses between the two criteria was moderate (κ = 0.447). Eighty-six patients (39.8%) showed disagreement: tumor response was upgraded in 70 patients and downgraded in 16 when adopting the EORTC criteria. The EORTC criteria significantly increased the overall response rate (53% vs. 28%, p < 0.0001). The agreement of tumor responses between the RECIST and PERCIST was deemed fair (κ = 0.389). Of 407 patients from nine studies, 181 (44.5%) showed a discrepancy: using the PERCIST, tumor response were upgraded in 151 patients and downgraded in 30. When adopting the PERCIST, the overall response rate was also significantly increased from 30% to 55% (p < 0.0001).
Conclusions
This pooled analysis demonstrates that the concordance of tumor responses between the morphologic criteria and metabolic criteria is not excellent. When adopting the metabolic criteria instead of the RECIST, overall response rates were significantly increased.
INTRODUCTION
The World Health Organization guidelines [1] and the Response Evaluation Criteria in Solid Tumors (RECIST) [2,3] are the morphologic criteria commonly used to assess tumor response in clinical practice. However, these criteria depending on the size changes based on computed tomography (CT) have limitations in tumors with obscure margins, cystic lesion, or scar tissue. In particular, measuring the longest diameter of lesions on CT is not always possible in gastrointestinal tumors. Because patients treated with targeted agents were not included in the data warehouse [4] when the RECIST version 1.1 was revised [3], there has also been concern regarding the assessment of tumor responses with the RECIST in patients receiving targeted agents [5]. Molecular targeted agents tend to induce necrotic or cystic change, not tumor shrinkage, in solid tumors [6]. Therefore, morphologic response criteria may be not well suited for assessing the efficacy of targeted therapies that stabilize diseases.
[18F]-fluorodeoxyglucose ([18F]-FDG) uptake is enhanced in most malignant tumors which in turn can be measured by positron emission tomography (PET). [18F]-FDG PET has been adopted as a new method for the diagnosis and staging of solid tumors. PET is also increasingly being used to monitor tumor responses to anti-cancer therapies. It can allow the assessment of tumor response even in the absence of anatomical changes [7-9]. There are two sets of criteria using FDG PET to quantify metabolic changes to anti-cancer treatment: the criteria developed by the European Organization for Research and Treatment of Cancer (EORTC) criteria [10] and the Positron Emission Tomography Response Criteria in Solid Tumors (PERCIST) [11]. Tumor response evaluations with the PERCIST and EORTC criteria have shown almost perfect agreement and correlated well with survival [12,13]. The metabolic response criteria may provide clinicians with a more accurate assessment of therapeutic response at an earlier stage of treatment course. However, their usefulness and advantage over the morphologic criteria (RECIST) need to be further investigated.
The assessment of tumor responses between the morphologic criteria and metabolic criteria has shown considerable discrepancies in a series of studies with a small number of patients [14-27]. We performed this pooled study to compare tumor response assessment between the morphologic criteria (RECIST 1.0 and RECIST 1.1) and metabolic criteria (EORTC criteria and PERCIST) in patients with solid tumors.
METHODS
Search strategy
A computerized systematic search of the electronic databases PubMed, Embase, Scopus, and Google Scholar (up to June 2017) was carried out to find articles with the following terms in their titles, abstracts, or keywords: “RECIST,” “PERCIST,” or “‘EORTC criteria.” In addition, we checked all the references of identified relevant articles and reviews. We also used the “related articles” feature in PubMed to identify relevant articles.
Study selection criteria
Studies comparing tumor responses by using the RECIST and metabolic criteria (EORTC or PERCIST) were considered for inclusion in this pooled study. As the RECIST 1.1 showed a high concordance with the RECIST 1.0 in the assessment of tumor responses [28,29], we included both versions without distinction in the analysis. For a more accurate comparison, however, articles adopting the modified RECIST versions developed for specific types of tumors were excluded. The searched articles were screened again by reviewing the full text, and the original articles that compared tumor responses between the morphologic criteria (RECIST 1.0 or RECIST 1.1) and metabolic criteria (PERCIST or EORTC) were included in the final analysis.
Tumor response assessment
The tumor responses according to the RECIST in each study were defined as follows [2,3]: (1) complete response (CR): disappearance of all lesions; (2) partial response (PR): at least a 30% decrease in the sum of diameters of the target lesions and no new lesions; (3) progressive disease (PD): more than a 20% increase in the sum of diameters of the target lesions (and also an absolute increase of at least 5 mm in the RECIST 1.1) or the appearance of new lesions on CT (or PET in the RECIST 1.1); and (4) stable disease (SD): neither sufficient shrinkage to qualify as PR nor sufficient increase to qualify as PD.
The tumor response guidelines for the PERCIST and EORTC criteria are briefly summarized in Table 1.
Statistics
The overall response rate (ORR) was defined as the percentage of patients with CR or PR (as determined by the two RECIST versions) and those with complete metabolic response (CMR) or partial metabolic response (PMR) (as determined by the PERCIST or EORTC criteria). The ORRs between the two groups were compared by using the McNemar test and p values less than 0.05 were considered significant. The level of agreement in tumor responses between the two criteria was estimated using unweighted κ statistics. The agreement was interpreted as poor (κ < 0), slight (κ = 0 to 0.20), fair (κ = 0.21 to 0.40), moderate (κ = 0.41 to 0.60), substantial (κ = 0.61 to 0.80), and almost perfect (κ > 0.80) [30].
Ethics
This study did not require approval by an ethics committee because it was a pooled analysis with systematic review of previously published studies. We performed this study according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines [31].
RESULTS
Eligible studies
Fig. 1 shows the flowchart of studies. A total of 132 studies were identified according to the search strategy: 110 were excluded after screening the titles and abstracts. The remaining 22 articles comparing tumor responses according to the RECIST and metabolic criteria were potentially relevant. However, eight studies were excluded based on the inclusion criteria: three articles used the modified RECIST and five had no details of response classification [32-36].
Finally, 14 studies with data comparing tumor responses by the RECIST and morphologic criteria (EORTC or PERCIST) were selected [14-27]. Five articles compared the RECIST and EORTC criteria [14,16-19] and six compared the RECIST and PERCIST [22-27]. The remaining three studies compared the RECIST and both metabolic criteria [15,20,21].
Patients’ characteristics
From the eight studies comparing the RECIST and EORTC criteria [14-21], 216 patients were included; 82 with lung cancer [19-21], 45 with colorectal cancer [14,20], 33 with head and neck cancer [18,20], 17 with malignant melanoma [17], 14 with basal cell carcinoma [15], 12 with stomach cancer [20], seven with desmoplastic small round cell tumors [16], and six with breast cancer [20] (Table 2). Eighty-nine patients (41.2%) were treated with targeted agents and 127 (58.8%) received cytotoxic chemotherapy.
From the nine studies comparing tumor responses by the RECIST and PERCIST, 407 patients were included [15,20-27]: 120 with colorectal cancer [20,23,27], 95 with lung cancer [20-22], 93 with breast cancer [20,25,26], 48 with esophageal cancer [24,25], 14 with basal cell carcinoma [15], 12 with stomach cancer [20], 10 with head and neck cancer [20,25], and 16 with other cancers (Table 3) [25].
Comparison of tumor responses between the RECIST and EORTC criteria
Because the RECIST 1.1 includes PET scans for the detection of new lesions, we reclassified tumor response of two patients with new focal FDG avid marrow lesions as PD [19]. The rate of discordance in tumor responses between the RECIST (RECIST 1.0 and RECIST 1.1) and EORTC criteria varied from 9.7% in non-small cell lung cancer [19] to 80% in colorectal cancer [14] (Table 2). The agreement of tumor response between the two criteria was moderate (κ = 0.447; 95% confidence interval, 0.356 to 0.537) (Table 4). Of 216 patients, 86 (39.8%) showed discordance in the assessment of their tumor responses between the two criteria. The details of the patients showing disagreement are described in Table 2. When adopting the EORTC criteria, tumor responses were upgraded in 70 patients and downgraded in 16. The shift in tumor responses occurred most frequently in patients with SD as determined by the RECIST. Among 68 patients with SD, the tumor response in 56 patients (82.46%) was upgraded to CMR (n = 3) or PMR (n = 53) and that in 12 was downgraded to progressive metabolic disease (PMD) by using the EORTC criteria. Of 10 patients with PR, six were reclassified as showing CMR, three as having stable metabolic disease (SMD), and one as having PMD. There were eight patients with PD who were upgraded as having PMR (n = 1) or SMD (n = 7). As a result, the estimated ORRs, which were estimated in total regardless of the primary tumor sites, were significantly different between the two criteria (28.2% by the RECIST vs. 52.8% by the EORTC, p < 0.0001).
Comparison of tumor responses between the RECIST and PERCIST
The rate of disagreement in tumor responses between the RECIST and PERCIST varied from 18.3% [20] to 62.9% [25]. Of 407 patients, 181 (44.5%) showed discordance in the assessment of their tumor responses between the two criteria. The details of the patients showing discordance are summarized in Table 3. The agreement of tumor response between the two criteria was fair (κ = 0.398; 95% confidence interval, 0.323 to 0.456) (Table 5). When adopting the PERCIST, the tumor response was upgraded in 151 patients and downgraded in 30. The shift in tumor responses was also observed most frequently in patients with SD by using the RECIST. Among 120 patients with SD, the tumor response of 96 patients (80%) was upgraded to CMR (n = 11) or PMR (n = 85) and that of 24 was downgraded to PMD by adopting the PERCIST. Of 37 patients with PR, 31 were reclassified as showing CMR and six as having SMD. There were 24 patients with PD who were upgraded as showing CMR (n = 4), PMR (n = 7), and SMD (n = 13). The estimated ORRs were also significantly different between the two criteria (30.2% by the RECIST vs. 55.0% by the PERCIST, p < 0.0001).
DISCUSSION
In this pooled study, we investigated the concordance between the metabolic criteria and morphologic criteria for the assessment of tumor responses in patients with solid tumors. There was a considerable discrepancy in the assessment of tumor responses between the morphologic criteria (RECIST) and metabolic criteria (EORTC or PERCIST). When adopting the EORTC criteria or PERCIST instead of the RECIST, the ORR was significantly increased, suggesting significant clinical impact of the metabolic criteria on making therapeutic decision.
In clinical practice, it is not always easy to distinguish necrotic tissue or fibrotic scar from residual tumor on CT scans [37]. In particular, with the increasing use of targeted agents, new evaluation methods are needed to accurately monitor tumor responses. [18F]-FDG PET has become a well-established method for the staging and detection of recurrence in patients with several malignancies [38]. It is also increasingly used to assess tumor responses to anti-cancer therapies [8-10]. FDG PET responses have correlated more significantly with survival than those assessed by CT [39]. However, the metabolic response criteria have shown differences compared with the morphologic criteria for the assessment of tumor responses.
In our pooled analysis of 216 patients from eight studies [14-21], the agreement of tumor responses between the RECIST and EORTC criteria was moderate (κ = 0.447). Eighty-six patients (39.8%) showed discrepancies in the assessment of tumor responses between the two criteria. Use of the EORTC criteria resulted in upgraded tumor responses in 70 patients and downgraded responses in 16. When adopting the EORTC criteria, the ORR significantly increased from 28.2% to 52.8% (p < 0.0001). The agreement of tumor responses between the RECIST and PERCIST was deemed fair (κ = 0.389). Of 407 patients from nine studies [15,20-27], 181 (44.5%) showed a disagreement in tumor responses between the two criteria. Use of the PERCIST resulted in upgraded tumor responses in 151 patients and downgraded responses in 30. When adopting the PERCIST instead of the RECIST, the ORR also significantly increased from 30.2% to 55.0% (p < 0.0001).
Early detection of the tumor response is of great value to avoid unnecessary toxicity and cost of ineffective treatments. Anatomical responses based on the size of the tumor may lag weeks or months behind metabolic response [40]. PET can detect metabolic changes after chemotherapy even when there are no or minimal morphological changes [7], which may explain the reason why tumor responses were upgraded by using the metabolic criteria in many patients who showed SD by using the RECIST in this study. In clinical practice, patients showing disease progression (PD or PMD) after anti-cancer treatment usually need a change in therapeutic approach. If the metabolic criteria had been used instead of the RECIST in this pooled study, it would have changed the treatment course in approximately 10% of the patients. This finding indicates that the clinical impact of the metabolic response criteria on making therapeutic decisions is significant.
The current pooled study has several inherent limitations. First, this study included heterogeneous patients with different types of tumors and different kinds of therapeutic agents. In addition, because of the limited number of studies, we could not compare two criteria in the subgroup with the same cancers. It is necessary to verify these results in studies with larger homogeneous patients’ cohort. Second, we included two versions of the RECIST without distinction in the analysis. Although the RECIST 1.1 has shown almost perfect agreement with the RECIST 1.0 in the assessment of tumor responses, a potential difference between the two versions might affect the results. Finally, this study could not evaluate the prognostic value of the metabolic criteria. Although the PERCIST and EORTC criteria were associated with prognosis in several studies, survival data were not enough to compare the prognostic value between the RECIST and the metabolic criteria.
In conclusion, this pooled study demonstrates that concordance in the assessment of tumor responses between the morphologic criteria (RECIST) and metabolic criteria (EORTC or PERCIST) is not excellent. When adopting the metabolic criteria instead of the RECIST, the ORR was significantly increased. The prognostic value of the metabolic criteria needs to be investigated in larger studies with homogeneous patient cohorts.
KEY MESSAGE
1. The assessment of tumor responses between the morphologic criteria and metabolic criteria has shown considerable discrepancies in studies with a small sample size.
2. The agreement of tumor responses was moderate between the morphologic (Response Evaluation Criteria in Solid Tumors [RECIST]) and metabolic criteria (European Organization for Research and Treatment of Cancer or Positron Emission Tomography Response Criteria in Solid Tumors).
3. When adopting the metabolic criteria instead of the RECIST, the overall response rate was significantly increased.
Notes
No potential conflict of interest relevant to this article was reported.