“Comparative effectiveness research” (CER) was an acrimonious issue in 2009 during the heated debate about “Obamacare”. Its promoters describe CER as: “dedicated to improving decision making about health care. Real-world interventions in real-world settings, and comparisons of new interventions to the most widely used or promising alternatives, have become the essential distinguishing characteristics of the research”
Public suspicion, at the time, was that government intrusion into the patient-physician relationship would threaten personalized medicine, and that government would ration healthcare based on CER findings through government reimbursement schedules, and would, therefore dictate treatment choices, limiting access and freedom to choose therapy.
A massive campaign by the healthcare industry and the Center for American Progress – Washington’s most influential “idea factory” during the Obama era –was created by John Podesta, the political consultant and Chief of Staff in the Clinton administration. CAP is opposed to single payer health care. The argument made, was that comparative effectiveness is a better method for evaluating the efficacy of different drugs, medical devices, and clinical procedures — “better health through better information”.
After public assurances that CER findings would not be used to determine cost-effectiveness, it was authorized under President Obama’s Patient Protection and Affordable Care Act (2010) with an allocation of $1 Billion. By 2017, the National Institutes of Health funded 600 (CER) trials at a cost of $1.4 billion. Most of these experiments were conducted on critically ill, incapacitated patients at intensive care hospital units. These patients’ survival depends on the physicians’ accurate assessment of their fluctuating clinical condition, often requiring numerous individualized adjustments to the level/dose of the interventions used according to the individual patient’s need.
who have, for years, raised safety concerns about specific CER trials. These scientists are acknowledged experts in the field of Critical Care, both in research and current best clinical practice. They have published hundreds of scientific reports about critical care and sepsis research; dozens of those reports addressed serious safety concerns about NIH-sponsored so-called “comparative effectiveness research” (CER) in which federally mandated ethical standards have been violated, thereby undermining the safety of the human subjects.
Peter eichacker, MDThey have documented how flawed, unethical protocol designs increased the risk of death for some of the critically ill patients who were enrolled in comparative effectiveness research trials.
- The first ethical violation in comparative effectiveness research is deceptive consent forms that misrepresent the tested intervention strategies as “usual current practice”, when in fact, the comparative strategies used in these trials are experimental; they pose increased risk.
- The other major ethical concern is that in these trials, some patients’ treatment in the trial is misaligned with their clinical condition; misaligned subgroups in clinical trials have worse outcomes than in usual care.
Dr. Natanson has often spoken out publicly against similarly designed, large, multi-site, NIH-funded clinical trials in which critically ill patients are randomly relegated to fixed treatment regimens that disregard their individual clinical condition. In 2010, Dr. Natanson wrote:
“Practice misalignments can occur in any clinical trial investigating a pre-existing therapy that is typically adjusted based on clinical characteristics outside of the trial setting. To eliminate the heterogeneity in clinical practice, recent trials investigating titrated therapies have randomized patients to fixed-dose regimens without including a routine care control group receiving titrated therapy. In these trials, the normal relationships between clinically important characteristics and therapy titration are disrupted.
Within each arm of the trial, randomization creates subgroups of patients receiving levels of therapy inconsistent with current practices outside of the trial. These practice misalignments may have outcomes worse than routine care and may compromise patient safety. In addition, comparisons of trial arms with practice misalignments have limited interpretability and generalizability.”
A paper co-authored by Ruth Macklin, PhD Distinguished University Professor Emerita, (Albert Einstein College of Medicine) and Dr. Natanson, addresses the bioethics community. It was just published in the American Journal of Bioethics (2019). The paper summarizes the scientific, clinical, and ethical deviations in three NIH-sponsored CER trials that had been approved by institutional review boards (IRB) at dozens of major academic medical centers. The authors note that:
“Flaws in clinical trial design not only produce faulty science; they can also increase risks to research participants and lead to practice guidelines that harm patients. Flaws in clinical trial design not only produce faulty science; they can also increase risks to research participants and lead to practice guidelines that harm patients. Moreover, in such cases, informed consent documents incorrectly describe novel interventions as usual care and mislead potential subjects into believing that the risks are known.”
- A comparative trial in 861 critically ill patients with Acute Respiratory Distress Syndrome (ARDS, 2000) sought to determine the impact of high vs. low tidal volume of oxygen intake (controlled by ventilator settings). The primary endpoint measures are lung damage and death. In standard care, only 10-15% of lung injured patients receive high tidal volume oxygen settings; whereas in the ARDS trial, 80% of the subjects had their machine-breath size settings changed to abnormally high volume without a compelling clinical justification.
As a result, the death rate for the patients who were tethered to a machine that delivered large volume breaths was 40% compared to 31% in a comparable patient group at those hospitals who were eligible for the ARMA trial but received standard care. The trial was conducted without legal informed consent.
The Alliance for Human Research Protection filed a letter of complaint to the federal Office of Human Research Protection (OHRP). The substance of our complaint – focused on gross violations of federally required informed consent disclosure. The OHRP investigation confirmed AHRP’s allegations. A companion to this trial was suspended by OHRP in 2003, then was allowed to resume.
- Transfusion Requirements in Critical Care (TRICC) Trial (1999) included 838 patients – some with known cardiovascular disease, others were young healthy patients with an acute critical illness. Physicians in clinical care regarded the risk/benefit for blood transfusion to differ substantially for the two sub-groups of patients, and they reported that the restrictive approach to transfusions is not appropriate for “most subjects”. In this trial, all the human subjects whom the researchers randomly assigned to fixed blood transfusions were put at serious risk of dying.
The analysis at the end of the trial confirmed that in subjects with severe heart disease, restrictive blood transfusions resulted in a higher death rate. What’s more, the young patients who were assigned to the aggressive/”liberal” blood transfusion schedule, also died at a higher rate than patients receiving standard care at a critical care unit.
- Surfactant, Positive Pressure and Pulse Oximetry Randomized Trial (SUPPORT, 2010) in which premature infants were subjected to one of two fixed saturation levels of oxygen. This, deceptively named SUPPORT experiment is a chilling example of placing a higher value on adhering to a poorly designed protocol, above the safety and survival of human babies.
The experiment garnered the greatest expressions of public outrage. The trial involved 1,316 premature infants who were subjected to two experiments conducted simultaneously: (a) the oxygen experiment measured the effect of two oxygen saturation target ranges—high vs. low. Death was a primary outcome measure in each of these experimental interventions.(b) the CPAP experiment measured the effect of using a continuous airway pressure mask (CPAP) vs. standard of care.
The infants were randomly assigned to one of two fixed oxygen saturation target levels – each at the extreme opposite of a range from which physicians in pediatric intensive care units select a target level based on the individual infant’s condition and need. Scientific analyses by several independent scientists confirmed that at the time of the SUPPORT experiment, no neonatal unit in the U.S. reported using oxygen saturation target ranges confined to the lowest level of the wide range recommended by the American Academy of Pediatrics. The experimental, fixed, low saturation level, to which infants in the SUPPORT experiment were assigned, deviated markedly from best practice.
- Every infant in the SUPPORT experiments was exposed to multiple protocol-driven, experimental procedures that deviated from “usual ”
- The babies in the combined low-oxygen-CPAP group were exposed to the most extreme combination of experimental interventions — in an effort to force them off ventilators.
- The babies were exposed to increased serious risks, and those risks were concealed from the parents.
- In the course of subsequent litigation documents confirmed that the pulse oximeters used in the trial to monitor infants’ oxygen intake, were deliberately calibrated to indicate a false reading of the infants’ oxygen intake.
- By knowingly misleading physicians about the amount of oxygen the infants were getting, increased the risk of death for the infants.
The SUPPORT experiment also generated an aggressive, coordinated, campaign led by Dr. Francis Collins, the Director of the NIH, and Dr. Jeffrey Drazen, Editor-in-Chief of the NEJM to express support for SUPPORT and to defend comparative effectiveness research in series of articles and editorials in the NEJM (publisher of the SUPPORT report in 2010.)  
Dr. Collins complained that the controversy “has alarmed some of the parents of infants who were in the study, confused the biomedical research community, and befuddled IRBs.” And he made the specious assertion that “research comparing interventions that are all considered to be the standard of care should not require informed consent.”
A cadre of 46 self-described “scholars and leaders in bioethics and pediatrics with extensive experience in ethical and regulatory issues in pediatrics and human subjects research” joined in to vigorously defend CER experiments. They expressed their outrage at the audacity of OHRP to criticize the conduct of the SUPPORT study.
What was learned from these “comparative effectiveness” experiments?
The experiments proved that assigning critically ill, human beings to a fixed, one-size-fits-all standard of medical care, without even the benefit of a control group, is akin to driving a car without brakes, blindfolded. Some people are bound to be killed. Those who designed the experimental protocols and those who conducted them caused preventable deaths. The flawed design of the experiments and the participation of premier medical institutions, including Stanford, Yale, and Duke – all of whose Institutional Review Boards (IRB) approved the experiments reveal the scope and magnitude of the problem. It reveals that the so-called system of human subject protection is a deceptive illusion.
One wonders why the authors limited their focus in the Journal of Bioethics to past trials that had been completed long ago. Why did they avoid including current controversial NIH-sponsored, unethical, comparative effectiveness trials?
Myocardial Ischemia and Transfusion (MINT) (2017) and Crystalloid Liberal or Vasopressors Early Resuscitation in Sepsis (CLOVERS) — currently ongoing.
Public Citizen has filed complaints about these unethical trial design of these two experimental trials, and requested the OHRP to suspend them immediately before patients are put at increased risk of death. 
MINT is an NIH trial involving 3500 heart attack patients throughout the U.S. and Canada, including veterans. Public Citizen called for an immediate suspension of the trial. In this trial, hospitalized patients suffering acute heart attacks and significant anemia will be randomly assigned to either one of two blood transfusion strategies — “liberal” vs. “restrictive”—based upon their red blood cell (RBC) levels.
“Researchers then will measure how many subjects die or have another heart attack within 30 days. Prior studies already strongly suggest that a restrictive transfusion strategy is more likely to lead to further heart attacks and death than a liberal strategy”.
- “One of the most troubling ethical lapses in the MINT trial is the failure of the consent form to fully disclose to potential subjects the possible risks of using a restrictive blood transfusion strategy”.
CLOVERS consent forms fail to comply with key federal requirements, and the protocol design exposes patient/subjects to unacceptable dangers, including the risk of organ failure and death.
[A subsequent post will address the unethical research exemptions that the NIH is currently pursuing.]
 The Role Of Costs In Comparative Effectiveness Research, Alan M. Garber and Harold C. Sox, Health Affairs, 2010
 . Alan Garber, MD, PhD, currently Provost and chief academic officer of Harvard University, addressed those fears in an article in The New England Journal of Medicine, titled, “Does Comparative Effectiveness Research Threaten Personalized Medicine?”
 The Relevance Of Practice Misalignments To Trials In Transfusion Medicine. Deans KJ1, Minneci PC, Klein HG, Natanson C. Vox Sanguinis, 2010
An Ethical Breakdown, The Editorial Board of The New York Times, April 15, 2013; Study of Babies Did Not Disclose Risks, U.S. Finds By Sabrina Tavernise, The New York Times, April 10, 2013; Legally Blind: The Therapeutic Illusion in the SUPPORT Study of Extremely Premature Infants, George Annas, PhD, Journal of Con temporary Health Law & Policy, Dec. 2013; Full Disclosure: Did Government’s Experiment on Preemies Hide Risks?, Sharyl Attkisson, The Daily Signal, June 2014; The SUPPORT Study Case: Not Vindication, Stephen Latham, JD, PhD, Hastings Center, 2015; Outrage of the Month: Editors of Prestigious Journal Sacrifice Standards to Defend an Unethical Clinical Trial, Michael Carome, MD, Huffpost, 2016; Controversial Trial Of Premature Infants Faces Fresh Scrutiny Following Release Of Documents, By Casey Ross, STATNews, June 14, 2017
 Public Citizen Letter to OHRP, 2017
 SUPPORT Study Group of the Eunice Kennedy Shriver NICHD Neonatal Research Network. Target ranges of oxygen saturation in extremely preterm infants. NEJM. 2010
 Informed consent and SUPPORT. Drazen JM, Solomon CG, Greene MF. NEJM 2013
 Risk, Consent, and SUPPORT. Magnus D, Caplan AL. NEJM. 2013
 In support of SUPPORT. A View from the NIH. Hudson KL, Guttmacher AE, Collins FS. NEJM, 2013
 The OHRP and Support, Wilfond BS, Magnus D, Antommaria AH, Appelbaum P, Aschner J, Barrington KJ, et al. NEJM. 2013
 Crystalloid Liberal or Vasopressors Early Resuscitation in Sepsis trial (CLOVERS), Public Citizen, August 2018; Letter to the OHRP Calling for a Halt to Unethical NIH-Funded Sepsis Clinical Trial Until NIH Stops Interfering in OHRP’s Evaluation of the Trial, May 2019
Aid Our Efforts: Donate!
Make a tax-deductible contribution today.