Skip to main content

Design characteristics of the CORRONA CERTAIN study: a comparative effectiveness study of biologic agents for rheumatoid arthritis patients



Comparative effectiveness research has recently attracted considerable attention. The C omparative E ffectiveness R egistry to study T herapies for A rthritis and I nflammatory Con ditions (CERTAIN) is an ongoing prospective cohort study of adult patients with Rheumatoid Arthritis (RA).


CERTAIN uses the existing Consortium of Rheumatology Researchers of North America (CORRONA) network of participating private and academic sites in order to recruit patients fulfilling the 1987 ACR criteria that have at least moderate disease activity. Patients starting or switching biologic agents either anti-TNF therapy or a non anti-TNF biologic are eligible for enrollment, depending on the treatment selected by their physician. Enrollment is expected to be completed by March of 2014, and 2711 patients will participate in the study. As of October 7th 2013, 2234 patients have been enrolled. Patient visits and laboratory blood work are mandated every three months for one year. Safety data is collected through one year and beyond. The primary comparative effectiveness endpoint is attainment of low RA disease activity at one year among patients who have been exposed to at least one prior TNF-α inhibitor agent prior to enrollment. Multiple secondary effectiveness and safety endpoints will be addressed by investigating the entire population enrolled (naïve and biologic experienced).


The unique design features of CERTAIN will inform comparative effectiveness and safety questions for choosing biologic agents for the management of RA.

Peer Review reports


Considerable attention and funding has recently been allocated to comparative effectiveness research (CER). In the U.S., for example, the American Recovery and Reinvestment Act (ARRA) devoted approximately 1 billion dollars in support of such studies in 2009 [1].

According to the Institute of Medicine, “The purpose of CER is to assist consumers, clinicians, purchasers, and policy makers to make informed decisions that will improve health care at both the individual and population levels” [2]. CER cannot only compare existing therapies in widespread use but also has the potential to establish standards and a mechanism by which newly available medications can be evaluated and compared to standard therapies. It may facilitate the creation of a more demanding scientific and medical community culture by which promotion of innovation in drug discovery will be encouraged, as opposed to the production of cloned “me too” therapeutics lacking robust evidence of superiority against existing medications [2].

Biologic agents in rheumatoid arthritis and the need for CER in rheumatology

Biologic agents have revolutionized the treatment of rheumatoid arthritis (RA) over the last decade. Their efficacy and safety has been clearly demonstrated in the setting of a multitude of randomized controlled trials (RCTs). Results for each agent are broadly comparable across all outcome domains including ACR (American College of Rheumatology) and EULAR (EUropean League Against Rheumatism) responses, improvement in quality of life, and arrest or reversal of radiologic damage [35]. With the approval of 2 additional TNF inhibitors (golimumab and certolizumab) and an IL-6 receptor inhibitor (tocilizumab) the current therapeutic armamentarium contains 9 biologic agents for the treatment of patients with inflammatory arthritis. However, these medications were studied and approved against comparator arms containing placebo, which may not have significant relevance to clinical practice. Despite regulatory requirements for drug approval, showing that a biologic agent is better than placebo does not provide a relevant context with which to choose among the available treatment options for RA patients.

Moreover, the magnitude of benefit of biologic agents in typical RA patients seen in every day practice – as opposed to clinical trial participants – has been less clearly demonstrated, especially for patients with mild or moderate RA disease activity or those with high burdens of medical comorbidities. These individuals would generally not qualify to participate in a clinical trial; indeed, only a minority of patients seen in clinical practice would qualify for a clinical trial [69].

Similar limitations in generalizability, and in understanding long term safety, are not available for industry-conducted head-to-head randomized control trials (RCT) comparing biologics, especially among patients with prior biologic exposure.

Lastly, the estimated per person cost of a typical biologic agent ranges between $15,000-22,000 per year, or more [10, 11]. While this may be justified by the extent of clinical benefit they offer to patients, the evidence from CER studies could be used to better inform cost-effectiveness considerations regarding the use of biologics in RA. The perception that all biologics “are overall the same” may be contributing to keeping cost high and at roughly comparable levels. As an example of prior comparative effectiveness research that has impacted clinical practice, it is now known that the first line anti-hypertensive treatment can be an inexpensive but effective thiazide diuretic instead of a more costly angiotensin converting enzyme inhibitor. If not for the ALLHAT study –the landmark CER study which demonstrated this outcome- it is rather doubtful that the prescribing habits of internists treating hypertension would have been altered to promote greater use of the less costly treatment option [2, 12].

The CORRONA network and registry. Mission, history, governance and funding

The Consortium of Rheumatology Researchers of North America (CORRONA) was founded in 2001. The CORRONA registry collects longitudinal, “real-world” data from patients and their treating physicians. At the time of this writing, data on 45,229 patients with rheumatologist-diagnosed inflammatory arthritis, including 38,776 patients with RA, have been collected. The CORRONA participating site network is comprised of more than 100 private and academic practices across 42 states within the United States, with more than 350 rheumatologists contributing data. All geographic regions in the continental United States are represented and there are no age, racial, disease activity or other restrictions to patient participation in the registry. As of October 7th 2013, CORRONA’s database included information about 290,020 patient visits, 119,955 patient years of follow-up observation time, with a mean time of patient follow up of 3.4 years (median 2.6 years).

At each CORRONA registry visit patients and physicians record data on disease severity and activity, RA and other medications, adverse events, quality of life, selected laboratory and imaging results, and socio-demographic information.

By way of providing a brief review of CORRONA’s history, an independent database collecting data from both rheumatologists and patients with inflammatory arthritis did not exist in the US at the time the organization was founded, and CORRONA aspired to fill this gap. A group of experienced academic and private rheumatologists founded and now serve on CORRONA’s board of directors which is entirely responsible for its governance and its scientific oversight. Operational needs are covered with funding predominantly derived from the pharmaceutical industry which may submit queries for data analysis but does not have access to CORRONA’s raw data. Instead all queries are evaluated and analyses are performed by academic-based biostatisticians and epidemiologists. Query results are generated and provided as summary reports to the requesting pharma company [13]. Pharmaceutical companies may submit an abstract or manuscript from the obtained data, but must follow CORRONA’s publication and authorship policies. A CORRONA investigator serves as the lead author, and has final authority on all elements of the published work.

CORRONA’s successes are exemplified by its contribution of multiple publications [721] in high-yield scientific journals. To date, CORRONA has collected data at office visits, as often as every 3 months unless a biologic agent is started, in which case more frequent data collection is allowable. For routine care in the absence of a change of these drugs, visits have occurred at a mean interval of 4.5 months. Unlike in CERTAIN, the CORRONA core registry does not mandate specific laboratory values, and thus the labs collected by the CORRONA registry reflect what is felt to be appropriate by the treating rheumatologist in the course of routine clinical care. Thus, certain values such as acute phase reactants are sometimes absent.

The C omparative E ffectiveness R egistry to study T herapies for A rthritis and I nflammatory Con ditions (CERTAIN)

In an attempt to expand the scope of clinical data, and to focus the scientific yield on comparative effectiveness, CORRONA launched the CERTAIN study in late 2010. CERTAIN is a prospective, non-randomized cohort study of adult patients with RA fulfilling the 1987 ACR criteria, having at least moderate disease activity defined by a clinical disease activity index (CDAI) score >10 who are starting or switching biologic agents [22]. As of October 7th 2013, 2234 patients were enrolled across 43 participating academic and private rheumatology practices.


The CERTAIN Sub-study has been designed to systematically collect and compare the effectiveness and safety of biologic medications (i.e. anti-TNF therapy, abatacept, rituximab, tocilizumab). The decision to recruit a patient into CERTAIN is made during a routine patient visit when a treating rheumatologist determines that a biologic agent for RA should be started. Even though the primary endpoint is to investigate comparative effectiveness among patients who have been exposed to at least one TNF-α inhibitor, CERTAIN will also enroll naïve to biologic agents patients in order to address multiple additional secondary endpoints and inform comparative safety research. For these secondary analyses of biologic-naïve patients, and in contrast to the main hypothesis to be examined by CERTAIN, it is likely that the anti-TNF and non anti-TNF groups would not be directly compared to one another given the anticipated small numbers and substantial heterogeneity in biologic-naïve patients initiating non anti-TNF therapy. Patients who initiate non anti-TNF agents as a first line biologic might be expected to have comorbidities (e.g. heart failure, cancer) that would make them dissimilar to new anti-TNF users.

Patients must fulfill the 1987 ACR criteria for RA and have moderate disease activity (i.e. CDAI > 10) in order to be eligible for participation. All existing or new CORRONA patients will be given the opportunity to participate. The first visit functions as the screening visit, during which patient’s consent is obtained and the process of insurance approval for the biologic to be started is initiated. After insurance approval is obtained, the patient returns for a baseline visit, and then for mandated follow up visits every three months through 1 year (i.e. baseline and 3,6,9,12 months follow up visits). Thus, the visit schedule of CERTAIN mimics that of an open-label controlled trial (RCT) with required follow visits at 3 month intervals. All biologic agents prescribed are approved by the Food and Drug Administration and the choice of which biologic to be initiated is entirely at the discretion of the prescribing physician.

The full set of data collected by the CORRONA registry are collected at each CERTAIN visit and in addition, mandated laboratory tests are performed, as indicated in Table 1. In addition, patients are requested to provide a sample of blood for DNA extraction and genotyping for future pharmacogenetics research. Whole blood for gene expression studies, as well as serum and plasma, is stored for future biomarker studies. All blood samples are shipped directly from the participating sites on the day of blood draw to a central laboratory where analyses are performed. The patients are reimbursed for their inconvenience, and physicians are provided with the results of some of the clinical lab tests at no cost to the patients or their insurance in order to facilitate clinical care and avoid redundant testing and phlebotomy.

Table 1 Clinical and laboratory assessments during CERTAIN

Quality assurance and quality control procedures for data collection

Investigators and staff at the 43 academic and private practices participating in CERTAIN completed a comprehensive online and on-site training on the study protocol prior to study initiation. The training materials were prepared and delivered by CORRONA personnel and were tailored to individuals’ roles (e.g. investigators, research coordinator). Ongoing quality control processes are in place to ensure high quality and rigorous data collection, overseen by a dedicated team. Study data are monitored via regular in-person site visits in order to ensure completeness and accuracy and to help sites resolve open queries.

Recruitment targets and ratios

CERTAIN is intended to focus on comparative effectiveness of established and newly approved biologic treatments for RA for patients who have failed to therapy with at least one TNF-α inhibitor prior to enrollment.

Given the well-characterized profile of existing biologics for RA, uptake of newer RA treatments is sometimes slow. For that reason, and to maximize statistical power for comparative analyses, CERTAIN established a goal to recruit anti-TNF and non anti-TNF therapies in an approximately 1:1 ratio. Perturbation of this ratio in up to a 3:2 ratio (in either direction) at each study site is permissible. In the case of exceeding the enrollment ratio, sites with extreme perturbations beyond the 3:2 limit will be instructed to temporarily not enroll patients starting biologics in the study arm in excess.

Individual agents within the anti-TNF and non anti-TNF categories are not differentiated in the primary analysis, nor are treatments within each category mandated. Treatment selection is fully under the control of the physician and patients are not randomized. The decision to not randomize patients was made in light of a dearth of evidence regarding the optimal treatment strategy for patients who fail one or more anti-TNF inhibitors. Given this state of relative equipoise in the decision to switch to another anti-TNF agent or to change to a biologic with a different mechanism of action, confounding in the form of channeling patients to specific medications is likely to be less problematic than comparisons of biologics vs. non-biologic DMARDs. Patients who do not qualify for CERTAIN based upon disease activity criteria or the enrollment ratio are recruited to the CORRONA “core” registry.

In order to reflect a ‘real world’ effectiveness setting, patients are permitted to change or discontinue biologic therapies at their physician’s discretion. If they start a new biologic, however, this action requires a new study visit at that time. This new study visit (i.e. an ‘early termination’ visit) ends follow-up time for the first drug and can define a new screening visit for the next biologic if the physician and patient so chooses. Patients are allowed to contribute multiple sets of observations if they initiate different biologics over the study period; if they do so, a new ‘baseline’ visit is established. Participants will continue to be followed longitudinally in the CORRRONA ‘core’ registry protocol after the completion of the one-year CERTAIN study. This important feature allows for long term follow-up for safety and effectiveness. The above are summarized in Figure 1.

Figure 1

Schematic of CERTAIN study design.

Primary endpoint and covariates of interest

The primary endpoint of CERTAIN is attainment of low disease activity (LDA) one year after starting or switching biologic agents and will be assessed only among patients who have previously been treated with one or more anti-TNF-α therapies. Patients who are biologic naïve at enrollment will contribute data to secondary analyses. LDA is defined as a CDAI ≤ 10. Although enrollment criteria and LDA could be defined using DAS28 (disease activity score using 28 joint counts), the DAS28 requires knowing the value of the acute phase reactant result in real time, which is generally not feasible. For that reason, the CDAI was chosen as the RA disease criterion for enrollment and primary outcome measure, given the high correlation between CDAI and DAS28 [22]. Using a dichotomous outcome (response vs non response) for the primary outcome has limitations, and any single threshold for considering a patient to be a ‘responder’ is arbitrary. However, LDA was chosen to reflect a clinically meaningful endpoint that would likely result in a patient continuing on that therapy. Thus, LDA is considered as a proxy outcome for a ‘responder’. Improvement in disease activity (as a continuous measure), controlling for baseline disease activity, will be examined in secondary effectiveness analyses. Consistent with our goals of evaluating effectiveness rather than efficacy, persons who switch to a new biologic (i.e. non-persistence), either for reasons of efficacy or safety, will be considered a non-responder. As additional secondary endpoints, DAS28 and other clinical outcomes (e.g. Health Assessment Questionnaire, or HAQ), ACR response, EULAR response, DAS remission, CDAI remission) at various time points also will be examined.

Allocation to specific biologic treatment is not randomized in CERTAIN. In order to overcome this potential source of confounding whereby patients with certain characteristics might be channeled to particular therapies, analytic adjustment will be performed to maximize the validity of treatment comparisons by reducing confounding, and improve precision. Propensity scores for receipt of anti-TNF vs. non anti-TNF therapy will be constructed based upon a priori and empirically-derived covariates that will include number of prior biologic used, concomitant MTX, concomitant glucocorticoid use/dose, duration of RA, and reason for previous biologic discontinuation (primary vs. secondary non-response vs. safety/tolerability vs. other). Treatment episodes for patients in the non-overlapping distributions of the propensity score will be trimmed (expected to be < 5% of observations removed for this reason, based upon preliminary examination), and multivariable adjustment will be used for the resulting main analysis population to control for relevant confounding. Numerous other potential confounders and effect modifiers including socio-demographic, anthropometric and disease specific characteristics will be controlled for as needed. As one example of potentially important covariates, it is possible that patients’ health insurance may affect the selection of biologic agents initiated in CERTAIN, and it may not be possible to fully characterize these payor influences on medication selection. Nevertheless, while this might raise concern for potential confounding, selection of specific biologics over another that are dictated solely by insurance type rather than patient characteristics may reduce confounding and bias due to channeling. Additionally, clustering by physician practice also will be accounted for in the analytic approach. Appropriate statistical techniques (e.g. mixed models, or generalized estimating equations) will be applied to account for patients who contribute multiple treatment episodes to the analysis. Based upon power calculations for the main hypothesis to demonstrate at least a 10% difference in the proportion of patients achieving LDA at 1 year between anti-TNF and non anti-TNF treated patients, CERTAIN plans to recruit approximately 2711 eligible patients over a three-year period.

Comparative safety in CERTAIN

The Institute of Medicine (IOM) has proposed a definition for comparative effectiveness that encompasses the domain of safety [23]. For that reason, beyond determining the comparative clinical effectiveness of various biologics for controlling disease activity, it is critical to better understand the risks of the biologics for serious adverse events (SAEs), if any such risks differ among agents, and if there are patient populations for which the risks associated with these agents are particularly high. Serious adverse events (SAEs) are of high interest and are a key part of comparative safety that will be evaluated within CERTAIN. Pre-specified SAEs of high interest include serious infections, myocardial infarction, stroke, malignancy, GI perforation, anaphylaxis, liver failure, bleeding, and demyelinating events. The FDA definition of serious adverse event also will apply ( Key criteria include death, hospitalization, life-threatening event and disability or permanent damage.

Initial case ascertainment for each of these events predominantly relies on reports from physicians and patients and is obtained from the CERTAIN case report forms. Following reporting by a physician, the CERTAIN data coordinating center requests the site to complete a short form to confirm the event and to obtain additional clinical details. These confirmation forms are outcome specific. Concurrent with the request to complete the confirmation form, medical records from the hospitalization or other pertinent sources of data (e.g. pathology reports for malignancies) are requested. Both the confirmation form and medical records are de-identified and faxed to the CERTAIN data coordinating center.

For each SAE, the confirmation form and associated medical records are sent to a group of physicians who centrally adjudicate all events according to pre-specified criteria. These physicians are blinded to drug exposure status to avoid bias. The classification criteria for SAE adjudication use standardized criteria whenever possible. For example for serious infections, the criteria system used has been described [21]. All reported events are classified according to their level of certainty (e.g. confirmed, probable, possible, unlikely).

Although medical record retrieval from the individual CERTAIN sites is high (historically, approximately 90%), CERTAIN has the ability to request medical records directly from healthcare facilities. This is facilitated by the CERTAIN investigators at University of Alabama (UAB) functioning as an ‘honest broker’ to maintain CERTAIN personal identifiers. Researchers at UAB therefore have the ability to request medical records directly from hospitals or physician offices. If necessary, UAB researchers also have the ability to contact CERTAIN participants directly to obtain updated or facility-specific medical record release forms, thus ensuring high rates of medical record retrieval. Through this mechanism, patients can also be contacted (if necessary) to obtain updated medical record release forms, or for other appropriate purposes (e.g. conducting optional patient-targeted surveys by email, Internet, phone, or mail). Patients consent to both data collection and these additional features. The study is governed by both a central institutional review board (IRB) [the New England IRB] as well as local and university-based IRBs if required at individual sites.

An independent mechanism to ensure completeness of SAE case ascertainment and mortality is also available. CERTAIN participants are consented and asked to provide identifying data that can be used to link to administrative claims databases (e.g. Medicare, commercial insurance) and other national data sources (e.g. the National Death Index). Approximately 40% of RA patients in CERTAIN are anticipated to be linkable to Medicare/Medicaid administrative claims data. Although there is some lag in the availability of the administrative data, the linkages between the CERTAIN clinical data and administrative claims databases allow confirmation of the completeness of the physician-reported SAEs. In this way, CERTAIN has a method to externally validate the absolute incidence rates for the various outcomes of interest and also evaluate the generalizability of CERTAIN participants and their characteristics (e.g. co-morbidities) compared to non-enrolled individuals (e.g. other RA patients treated in geographically similar physician practices with the same health insurance) [24]. The administrative data linkage will also allow for examination of a number of other important outcomes (e.g. medication adherence, costs and health economics).

Genomics, genetics and comparative effectiveness

Concerns have been expressed that comparative effectiveness research may not be applicable to individual patients with unique genetic backgrounds [25], and a need for bridging the “chasm” between CER and personalized medicine has been recognized [26]. It has been posited that both CER and genomic medicine will complement each other as long as genome-based perspectives are incorporated in the design of CER studies [26].

In this context, DNA is collected at the time of the baseline CERTAIN visit and will be used for candidate gene and genome-wide analyses to predict response to treatment or susceptibility to adverse events while on treatment with biologics. The DNA collected during this study is creating a rich genomic repository which will allow a multitude of hypotheses to be tested with adequate power and sample sizes.

Enrollment status and baseline data

CERTAIN is currently enrolling patients throughout the U.S. As of October 7th 2013, 2234 patients had been enrolled. Detailed enrollment data for these participants are available. Basic demographic, disease activity characteristics and distribution of comorbities are presented in Tables 2 and 3. Table 2 shows data for the treatment episodes of TNF-α inhibitor experienced patients that will be included in the primary analysis. As shown, RA disease characteristics were generally well balanced between the two treatment groups. Based upon comparison of the standardized absolute mean difference between anti-TNF and non anti-TNF users, the characteristics that were most different included RA disease duration (median 6 vs. 8 years), median DAS28CRP (4.7 vs. 5.0), and daily prednisone dose (5 vs. 7 mg). Most other differences were small. For example, mean disease activity by CDAI was comparable: 27 (anti-TNF treated) vs. 28 (non anti-TNF treated). Likewise, the prevalence of key comorbidities was similar between anti-TNF and non anti-TNF patients.

Table 2 CERTAIN patients who have been exposed to at least 1 TNF-α inhibitor (population used for primary comparative effectiveness analyses)
Table 3 CERTAIN patients not included in the primary analysis population because they had not previously received anti-TNF therapy at the time of initiation of a new biologic

Table 3 summarizes similar information for the rest of the enrolled population who were biologic naive. Most of these patients (762/913, or 84%) were initiated on anti-TNF therapy. Patients had much earlier RA disease duration (mean = 2 years for the overall group). As might be expected, given that most RA treatment paradigms have recommended initial biologic treatment to start with anti-TNF therapy, the patients receiving non anti-TNF medications as their first biologic were more dissimilar to the anti-TNF users than the population contributing to the main analysis (Table 2).


CERTAIN is a newly-launched RA comparative effectiveness study examining biologic agents currently approved in the U.S. among patients with moderate or high RA disease activity. The established infrastructure of CORRONA is used for patient enrollment, physician participation, collection and storage of data and mandates visits at regular intervals with centralized laboratory evaluations and a robust biospecimen repository for RA patients initiating or switching biologic agents. Safety data will be generated via a robust system of serious adverse event confirmation with adjudication using medical records and linkage with external databases. Enrollment data from the 2234 patients recruited to-date suggest that among those who have been treated with at least one anti-TNF therapy, characteristics of patients initiating their next biologic were relatively well-balanced between treatment groups. The innovative design features of the CERTAIN study will harness the experience of an existing network of dedicated U.S. physicians and sites to better evaluate the comparative effectiveness of biologic DMARDs.

Key messages

  1. 1.

    CERTAIN will inform effectiveness and safety questions to compare anti-TNF to non anti-TNF biologic agents for the treatment of rheumatoid arthritis.

  2. 2.

    Innovative design elements of CERTAIN will incorporate state of the art methods for comparative effectiveness research.


  1. 1.

    Department of Health and Human Services: comparative effectiveness funding. []

  2. 2.

    Mushlin AI, Ghomrawi H: Health care reform and the need for comparative-effectiveness research. N Engl J Med. 2010, 362: e6-

    Article  PubMed  Google Scholar 

  3. 3.

    Lipsky PE, van der Heijde DM, St Clair EW, Furst DE, Breedveld FC, Kalden JR, Smolen JS, Weisman M, Emery P, Feldmann M, Harriman GR, Maini RN, Anti-Tumor Necrosis Factor Trial in Rheumatoid Arthritis with Concomitant Therapy Study Group: Infliximab and methotrexate in the treatment of rheumatoid arthritis. Anti-Tumor Necrosis Factor Trial in Rheumatoid Arthritis with Concomitant Therapy Study Group. N Engl J Med. 2000, 343: 1594-1602.

    CAS  Article  PubMed  Google Scholar 

  4. 4.

    Klareskog L, van der Heijde D, de Jager JP, Gough A, Kalden J, Malaise M, Martin Mola E, Pavelka K, Sany J, Settas L, Wajdula J, Pedersen R, Fatenejad S, Sanda M, investigators Ts: Therapeutic effect of the combination of etanercept and methotrexate compared with each treatment alone in patients with rheumatoid arthritis: double-blind randomised controlled trial. Lancet. 2004, 363: 675-681.

    CAS  Article  PubMed  Google Scholar 

  5. 5.

    Breedveld FC, Weisman MH, Kavanaugh AF, Cohen SB, Pavelka K, van Vollenhoven R, Sharp J, Perez JL, Spencer-Green GT: The PREMIER study: a multicenter, randomized, double-blind clinical trial of combination therapy with adalimumab plus methotrexate versus methotrexate alone or adalimumab alone in patients with early, aggressive rheumatoid arthritis who had not had previous methotrexate treatment. Arthritis Rheum. 2006, 54: 26-37.

    CAS  Article  PubMed  Google Scholar 

  6. 6.

    Kievit W, Fransen J, Oerlemans AJ, Kuper HH, van der Laar MA, de Rooij DJ, De Gendt CM, Ronday KH, Jansen TL, van Oijen PC, Brus HL, Adang EM, van Riel PL: The efficacy of anti-TNF in rheumatoid arthritis, a comparison between randomised controlled trials and clinical practice. Ann Rheum Dis. 2007, 66: 1473-1478.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Greenberg JD, Kishimoto M, Strand V, Cohen SB, Olenginski TP, Harrington T, Kafka SP, Reed G, Kremer JM, Consortium of Rheumatology Researchers of North America I: Tumor necrosis factor antagonist responsiveness in a United States rheumatoid arthritis cohort. Am J Med. 2008, 121: 532-538.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  8. 8.

    Zink A, Strangfeld A, Schneider M, Herzer P, Hierse F, Stoyanova-Scholz M, Wassenberg S, Kapelle A, Listing J: Effectiveness of tumor necrosis factor inhibitors in rheumatoid arthritis in an observational cohort study: comparison of patients according to their eligibility for major randomized clinical trials. Arthritis Rheum. 2006, 54: 3399-3407.

    CAS  Article  PubMed  Google Scholar 

  9. 9.

    Sokka T, Pincus T: Eligibility of patients in routine care for major clinical trials of anti-tumor necrosis factor alpha agents in rheumatoid arthritis. Arthritis Rheum. 2003, 48: 313-318.

    CAS  Article  PubMed  Google Scholar 

  10. 10.

    Wailoo AJ, Bansback N, Brennan A, Michaud K, Nixon RM, Wolfe F: Biologic drugs for rheumatoid arthritis in the Medicare program: a cost-effectiveness analysis. Arthritis Rheum. 2008, 58: 939-946.

    Article  PubMed  Google Scholar 

  11. 11.

    Monroe CD, Potter L, Millares M, Barrueta A, Wagner R: Kaiser Permanente's evaluation and management of biotech drugs: assessing, measuring, and affecting use. Health Aff. 2006, 25: 1340-1346.

    Article  Google Scholar 

  12. 12.

    Officers A, Coordinators for the ACRGTA, Lipid-Lowering Treatment to Prevent Heart Attack T: Major outcomes in high-risk hypertensive patients randomized to angiotensin-converting enzyme inhibitor or calcium channel blocker vs diuretic: the Antihypertensive and Lipid-Lowering Treatment to Prevent Heart Attack Trial (ALLHAT). JAMA. 2002, 288: 2981-2997.

    Article  Google Scholar 

  13. 13.

    Kremer JM: The CORRONA database. Autoimmun Rev. 2006, 5: 46-54.

    Article  PubMed  Google Scholar 

  14. 14.

    Greenberg JD, Bingham CO, Abramson SB, Reed G, Kishimoto M, Hinkle K, Kremer J: Assessment of coxib utilization by rheumatologists for nonsteroidal antiinflammatory drug gastroprotection prior to the coxib market withdrawals. Arthritis Rheum. 2006, 55: 543-550.

    CAS  Article  PubMed  Google Scholar 

  15. 15.

    Greenberg JD, Bingham CO, Abramson SB, Reed G, Sebaldt RJ, Kremer J: Effect of cardiovascular comorbidities and concomitant aspirin use on selection of cyclooxygenase inhibitor among rheumatologists. Arthritis Rheum. 2005, 53: 12-17.

    CAS  Article  PubMed  Google Scholar 

  16. 16.

    Greenberg JD, Reed G, Kremer JM, Tindall E, Kavanaugh A, Zheng C, Bishai W, Hochberg MC, Investigators C: Association of methotrexate and tumour necrosis factor antagonists with risk of infectious outcomes including opportunistic infections in the CORRONA registry. Ann Rheum Dis. 2010, 69: 380-386.

    CAS  Article  PubMed  Google Scholar 

  17. 17.

    Greenberg JD, Fisher MC, Kremer J, Chang H, Rosenstein ED, Kishimoto M, Lee S, Yazici Y, Kavanaugh A, Abramson SB, Investigators C: The COX-2 inhibitor market withdrawals and prescribing patterns by rheumatologists in patients with gastrointestinal and cardiovascular risk. Clin Exp Rheumatol. 2009, 27: 395-401.

    CAS  PubMed  Google Scholar 

  18. 18.

    Greenberg JD, Harrold LR, Bentley MJ, Kremer J, Reed G, Strand V: Evaluation of composite measures of treatment response without acute-phase reactants in patients with rheumatoid arthritis. Rheumatology. 2009, 48: 686-690.

    CAS  Article  PubMed  PubMed Central  Google Scholar 

  19. 19.

    Furst DE, Chang H, Greenberg JD, Ranganath VK, Reed G, Ozturk ZE, Kremer JM: Prevalence of low hemoglobin levels and associations with other disease parameters in rheumatoid arthritis patients: evidence from the CORRONA registry. Clin Exp Rheumatol. 2009, 27: 560-566.

    CAS  PubMed  Google Scholar 

  20. 20.

    Curtis JR, Chen L, Harrold LR, Narongroeknawin P, Reed G, Solomon DH: Physician preference motivates the use of anti-tumor necrosis factor therapy independent of clinical disease activity. Arthritis Care Res . 2010, 62: 101-107.

    Article  Google Scholar 

  21. 21.

    Curtis JR, Patkar NM, Jain A, Greenberg J, Solomon DH: Validity of physician-reported hospitalized infections in a US arthritis registry. Rheumatology. 2009, 48: 1269-1272.

    Article  PubMed  PubMed Central  Google Scholar 

  22. 22.

    Aletaha D, Smolen J: The Simplified Disease Activity Index (SDAI) and the Clinical Disease Activity Index (CDAI): a review of their usefulness and validity in rheumatoid arthritis. Clin Exp Rheumatol. 2005, 23: S100-108.

    CAS  PubMed  Google Scholar 

  23. 23.

    Iglehart JK: Prioritizing comparative-effectiveness research–IOM recommendations. New Engl J Med. 2009, 361: 325-328.

    CAS  Article  PubMed  Google Scholar 

  24. 24.

    Curtis JR, Chen L, Yun H, Harrold LR, Greenberg J, Kremer J: Generalizability of a U.S. Rheumatoid Arthritis Registry: a Comparison Of Participants vs. Non-Participants' Characteristics. Book Generalizability of a U.S. Rheumatoid Arthritis Registry: A Comparison Of Participants vs. Non-Participants' Characteristics (Editor ed.^eds.), vol. 65. pp. S447. 2013, S447-

    Google Scholar 

  25. 25.

    Garber AM, Tunis SR: Does comparative-effectiveness research threaten personalized medicine?. New Engl J Med. 2009, 360: 1925-1927.

    CAS  Article  PubMed  Google Scholar 

  26. 26.

    Khoury MJ, Rich EC, Randhawa G, Teutsch SM, Niederhuber J: Comparative effectiveness research and genomic medicine: an evolving partnership for 21st century medicine. Gen Med. 2009, 11: 707-711.

    CAS  Google Scholar 

Pre-publication history

  1. The pre-publication history for this paper can be accessed here:

Download references


The CORRONA CERTAIN study is sponsored by CORRONA, Inc. with support from the Agency for Healthcare Research and Quality (R01HS018517). The majority of funding for the planning and implementation of CERTAIN was derived from Genentech, with additional support for sub-studies from Eli Lilly, and Momenta Pharmaceuticals. CERTAIN investigators also receive support from the National Institute of Health [JRC AR053351, JDG AR054 412]. We also would like to acknowledge the important contributions of key personnel involved in the implementation of CERTAIN: Tanya Sommers, MS, ANP-BC (project manager, responsible for overseeing study operations), and Aseem Bharat, MD, MPH and David Mackey (who conducted data monitoring visits).

Author information



Corresponding author

Correspondence to Jeffrey R Curtis.

Additional information

Competing interests

Dimitrios A Pappas MD, MPH: Employee of CORRONA, Inc; Honoraria: Novartis. Jeffrey Greenberg, MD, MPH: Grants/Research Support: BMS; Consultant: Novartis; Roche; UCB; Centocor; Genetech; Other: Remuneration as Chief Scientific Officer, CORRONA. George Reed, PhD: Employee of CORRONA, Inc. Joel M Kremer MD: President of CORRONA. Consulting/Honoraria: Amgen, Abbott, BMS, Genentech, Ortho-Biotech, Pfizer, Roche, UCB, Vertex. Grant support: Amgen, Abbott, BMS, Genentech, Ortho-Biotech, Pfizer, Roche, UCB, HGS. Jeffrey R Curtis MD, MS, MPH: Research Grants and/or Consulting: Roche/Genentech, UCB, Janssen, Abbvie, BMS, Amgen, CORRONA, Pfizer.

Authors’ contributions

All coauthors were responsible for the design and conduct of the study, data collection, analysis, and drafting and final approval of the manuscript. The development of the manuscript and its final submission was not subject to sponsor approval. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Pappas, D.A., Kremer, J.M., Reed, G. et al. Design characteristics of the CORRONA CERTAIN study: a comparative effectiveness study of biologic agents for rheumatoid arthritis patients. BMC Musculoskelet Disord 15, 113 (2014).

Download citation


  • Rheumatoid arthritis
  • Registry
  • Cohort
  • Epidemiology
  • Comparative effectiveness
  • Safety
  • Biologics