Free beta access. 50 free AI tokens each week. Optional top-ups available. See what is included
Opening Word document…

Tests can be performed on already implemented policies.

Colleen V. Chien 19, Justin D'Atri Visiting Professor of Business Law, Columbia Law School; Professor, Santa Clara University School of Law; 2013-2015 White House Senior Advisor, Innovation and Intellectual Property, “Rigorous Policy Pilots: Experimentation in the Administration of the Law,” 104 Iowa L. Rev. 2313, July 2019, Lexis

While pilots can be used to evaluate already-implemented policies, prospectively proposing a policy pilot involves identifying an intervention for evaluation grounded in a theory of change. Evidence is likely to be most valuable and valued when it addresses deficits left by traditional information gathering processes. Tests can address competing stakeholder narratives and theories of change for example, or can be used to try out new ideas. Within the USPTO, participants in the Office’s “Edison Scholar” program have helped to develop pilot programs including the “Glossary pilot,” other pilots have come from or been supported by the Public Patent Advisory Committee (“PPAC”), a Federal Advisory Committee of the agency.

Regardless of source, it is critical to connect the identified treatment to the eventual intended outcome. By answering the question, “how is treatment X supposed to achieve outcome Y,” a law- or policy-maker describes a “theory of change.” A widely-accepted method of specifically testing the underlying theory of change is through “mechanism experiments,” a technique for determining whether the underlying theory of change is actually sound. Mechanism experiments support testing of the core underlying assumptions without requiring an extensive randomized controlled experiment; as described in Part II, to the extent they simulate rather than actually effect policy changes, they impose fewer administrative burdens.

Sign in to recut, update, or save this card.