Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

It spills up, avoids backlash, AND emboldens rigorous experimentation necessary for effective regulations.

Colleen V. Chien 19, Justin D'Atri Visiting Professor of Business Law, Columbia Law School; Professor, Santa Clara University School of Law; 2013-2015 White House Senior Advisor, Innovation and Intellectual Property, “Rigorous Policy Pilots: Experimentation in the Administration of the Law,” 104 Iowa L. Rev. 2313, July 2019, Lexis

The range of open questions in law and policy that can be addressed by pilots are wide-ranging. They include, for example, the question of how giving a universal basic income ("UBI") to individuals impacts their well-being and employment. In 2017, the Finnish government began tracking the outcomes of 7,000 unemployed citizens, about a third to which it gave $ 600 a month, [*2317] to address this question; 14several U.S. jurisdictions are planning their own tests. 15Also unknown is how the administration of patent law and issuance of quality patents best advance the Constitutional goal of "promoting the progress of science and useful arts." 16Over the last decade, the United States Patent and Trademark Office ("USPTO") has run numerous pilots to address this question. 17As the D.C. Circuit has said, "there are some situations in which, "a month of experience will be worth a year of hearings.'" 18While experiments or pilots can address a variety of questions pertaining, e.g., to a policy's feasibility or stakeholder reactions, when the question concerns whether the policy has caused an observed outcome, a controlled trial that provides the treatment to one part of population, withholds it from another, and then compares the difference in outcomes provides the best insight. Such rigorous experiments can be designed, in turn, with or without randomization, and to vary the rules or laws that apply or to approximate such changes. A pilot that limits to whom a rule or policy applies constrains the risk but not the learning. As Justice Brandeis famously dissented, "a single courageous state may ... serve as a laboratory; and try novel social and economic experiments without risk to the rest of the country." 19

Within today's highly partisan political landscape, the need for quality evidence about the performance of law and policy presents a rare opportunity for agreement, on the methods if not the values or agendas advanced by evidence. Calls for "smarter use of data and evidence ... to orient decisions and accountability around service and results" 20and "an aggressive management agenda ... that delivers smarter, more innovative, and more accountable government for citizens ... . by applying ... evidence about what [*2318] works" 21 have appeared in President Trump's and President Obama's management agendas, respectively. The passage of the Foundations for Evidence-Based Policy Making Act of 2018 ("2018 Evidence Act"), besides showing that Democrats and Republicans actually can agree on something, will consolidate and coordinate statistical expertise for assessment among rank and file bureaucrats across the federal government. 22

But while "adequate and well controlled studies" have long been required in certain contexts, 23experiments with laws and rules have a history of being constitutionally and legally suspect. As the Supreme Court stated in Truax v. Corrigan, "the Constitution was intended - its very purpose was - to prevent experimentation with the fundamental rights of the individual." 24

Rigorous pilots that provide a benefit to some, but not other, members of a population would appear to offend basic notions of equal protection. 25Imposing a regulatory burden on a subset of regulated entities likewise sounds in unfairness and risks running afoul of the Constitution's due process guarantees. Applying a rule randomly to one set of entities but not another would appear to some to present just the kind of "arbitrary, capricious" agency action judicial review was designed to set aside. 26

How rigorous testing can support evolution of the law is also not widely understood. By operating within existing legal frameworks, experiments can obscure more salient questions, including whether or not the framework is the right one in the first place. Rigorous experimentation is less flexible and adaptable than "democratic experimentalism" with which it shares some features. 27While Congress may feel empowered to take bolder steps when laws are framed as reversible and temporary, requirements of rigor can constrain agencies, feeding anti-regulatory impulses. Experimental evidence can be weaponized and politicized in the same way non-experimental evidence can. 28

[*2319] And yet, when compared to doing nothing or engaging in unreflective action, the benefits of rigorous experimentation become clearer: Rigorous pilots can prime legislative and policy-making efforts by underscoring the importance of evidence and prompting a discussion about the metrics that matter. Rigorous pilots can be used to test legal theories, and point out legal infirmities, provided that is the motivation. Further, among information sources, rigorous pilots are distinct in their ability to generate experiential feedback on the operation of law and policy.

But while rigorous policy pilots can thus be powerful tools, so far, they have been underused tools for informing the development of law and policy. In part this is due to a perception that certain types of rigorous pilots are possibly illegal. Citing a litany of difficulties, a recent recommendation of the Administrative Conference of the United States 29concluded that, "legal, policy, and ethical challenges ... may mean that regulatory agencies should use randomized study methods only under limited circumstances." 30But rigorous pilots have also been underused because of practical obstacles to designing and carrying them out, and a lack of awareness of the value they can add.

Sign in to recut, update, or save this card.