Randomised Controlled Trial

The 2019 Nobel Prize in Economic Sciences was awarded to Abhijit Banerjee and Esther Duflo, who currently work at the Massachusetts Institute of Technology, and Michael Kremer of Harvard University. The Prize committee noted that these economists “introduced a new approach to obtaining reliable answers about the best ways to fight global poverty.” The new Nobel laureates are considered to be instrumental in using randomised controlled trials to test the effectiveness of various policy interventions to alleviate poverty.

So what is randomised control trial?

A randomised controlled trial is an experiment that is designed to isolate the influence that a certain intervention or variable has on an outcome or event. A social science researcher who wants to find the effect that employing more teachers in schools has on children’s learning outcomes, for instance, can conduct a randomised controlled trial to find the answer. The use of randomised controlled trials as a research tool was largely limited to fields such as biomedical sciences where the effectiveness of various drugs was gauged using this technique. Mr. Banerjee, Ms. Duflo and Mr. Kremer, however, applied RCT to the field of economics beginning in the 1990s. Mr. Kremer first used the technique to study the impact that free meals and books had on learning in Kenyan schools. Mr. Banerjee and Ms. Duflo later conducted similar experiments in India.

Why is randomised controlled trial so popular?

At any point in time, there are multiple factors that work in tandem to influence various social events. RCTs allow economists and other social science researchers to isolate the individual impact that a certain factor alone has on the overall event. For instance, to measure the impact that hiring more teachers can have on children’s learning, researchers must control for the effect that other factors such as intelligence, nutrition, climate, economic and social status etc., which may also influence learning outcomes to various degrees, have on the final event.Randomised controlled trials promise to overcome this problem through the use of randomly picked samples. Using these random samples researchers can then conduct experiments by carefully varying appropriate variables to find out the impact of these individual variables on the final event.

What are some criticisms of randomised controlled trials?

A popular critic of randomised controlled trials is economist Angus Deaton, who won the economics Nobel Prize in 2015. Mr. Deaton has contended in his works, including a paper titled “Understanding and misunderstanding randomised control trials” that simply choosing samples for an RCT experiment in a random manner does not really make these samples identical in their many characteristics.

While two randomly chosen samples might turn out to be similar in some cases, he argued, there are greater chances that most samples are not really similar to each other. Other economists have also contended that randomised controlled trials are more suited for research in the physical sciences where it may be easier to carry out controlled experiments. They argue that social science research, including research in the field of development economics, may be inherently unsuited for such controlled research since it may be humanly impossible to control for multiple factors that may influence social events.