Making words count

Measuring the quality of legislative debates

kaushiki-sanyal

Kaushiki Sanyal | July 20, 2017


#debates   #Parliament   #legislation  
GN Photo
GN Photo

In 2016, 38 bills were enacted in parliament. During that year, on average, the time spent on legislative debate (without interruptions) was 23 percent in the Lok Sabha and 16 percent in the Rajya Sabha (calculated from the PRS Legislative Research data). 

Time is, however, just one measure of the quality of legislative debate. Analysing the content of the debates would provide a glimpse of the nature of issues raised by parliamentarians and whether they adequately capture the gamut of issues that may be related to the legislation. 
 
Not many studies exist on legislative debates the world over, although the pace has picked up during the last two decades. Majority of the work focused on analysing positions of legislators or why legislators participated in debates. Attempts to measure discourse quality were scarce. In 2003, scholars from the University of North Carolina, Marco R Steenbergen et al, developed a ‘Discourse Quality Index’ to measure the quality of deliberations. They proposed that speeches be assessed under the following heads: (a) level of participation in debate; (b) level of justification; (c) content of justification; (d) level of respect towards the beneficiary group; and (e) level of constructive politics. 
 
In the Indian context, there is a perception that the quality of parliamentary debates has deteriorated, especially compared to the early 1950s, when stalwarts such as Nehru, Mavalankar and AK Gopalan were Lok Saha members. But there is no empirical analysis on the subject. Therefore, analysing the content of speeches through a Quality of Legislative Debates Index could elicit information on the nature of discourse on a legislation, the level of preparedness on the subject and the impact on the final outcome, that is, a legislation. The quality of the debate can seriously affect the efficacy of these laws themselves. 
 
At his first Bhairon Singh Shekhawat lecture recently, president Pranab Mukherjee stressed the need to improve the quality of India’s parliamentary debates. Here’s an example. While discussing the recently enacted Maternity Benefits (Amendment) Bill, 2016, almost all MPs wanted to include the unorganised sector but none suggested how this could be achieved. Hardly any MP touched upon its financial implication on the private sector, particularly SMEs or on solutions attempted elsewhere.  
 
Blame it on the anti-defection law of 1985 or to the general decline in parliament as an institution, parliamentary debates are no longer what they used to be. While checking indiscriminate defections, the anti-defection law has reduced MPs to a mere headcount following party lines.   
 
One way to encourage MPs to improve their quality of debate is to objectively measure and report the quality of debates, bringing public focus on this issue and incentivising better inputs from MPs. Developing an objective metric for assessing the quality of debates would force our parliamentarians to pay attention to their key role as lawmakers and be more informed on the subject. It is to be hoped that this would, in turn, stem the tide and restore parliament to its former glory.
 
I have developed an outline, a framework for an index to measure the quality of legislative debates for the purpose.    

Index of quality of legislative debates
 
An index essentially combines quantitative and qualitative indicators into a composite statistic. Carefully crafted indices are increasingly used worldwide to define and measure traditionally qualitative concepts in economics and public policy objectively and consistently. Ranking countries on such indices has become popular since the 1990s and is known to drive policy change in many developing countries. 
 
The proposed Quality-of-Legislative-Debates Index needs to weigh the legislators’ knowledge of the subject; the depth of their scrutiny of bills; and their inclination for evidence-based research. Clearly, there is no single, objective way to judge the quality of legislative debates with metrics depending, inter alia, on political or ideological priorities or perception of the role of an MP.
 
What should such a measure include? Below, I list related metrics and “must cover” points that ought to get into it. The quantitative metrics capture the priorities of the government and the level of engagement of MPs in the process. The qualitative ones reflect the content of the speeches for depth of understanding, level of knowledge and inclination towards evidence-based research. The index should combine these metrics and a legislative debate should be graded by the index on its quality. Done right, the index can help focus attention to debate quality. As they say in policy, “what gets measured, gets done.” 

Framework for measuring the quality of debates in parliament

Metric Observations
Metric Quantitative
   
Legislative journey of a bill
  • Type of bill
  • Date of introduction and reference to standing committee
  • Date of report submission
  • Date of debate, enactment, presidential assent
  • Number of days of debate
Provides a snapshot of the time taken for a bill to become an Act. Variations indicate government preferences, timelags between amendments and extent of scrutiny (reference to standing committee).
   
MP activities in parliament
  • Opposition during bill introduction
  • Time allotted for discussion
  • Number of MPs who spoke and their party affiliations
  • Disruptions during debate
  • Number of amendments introduced by government and/or MPs
  • Number of amendments accepted/rejected
  • Number of divisions called
  • Total time taken to pass bill
Documents the activities of MPs in parliament regarding the bill. The extent of their participation indicates their level of interest.
   
Qualitative

Objectives of the bill
  • Number of MPs who raised concerns about the SOR
  • C oncerns raised: (a) lack of clarity about purpose; (b) mismatch between contents of the bill and SOR; (c) other
  • Sources cited (if any) (a) news articles; (b) government reports; (c) independent expert reports; (d) journal; (e) anecdotes; (f) other
The statement of objects and reason (SOR) provides the background information and purpose of the bill.
   
Broad issues regarding the bill
  • Number of MPs who supported/opposed the bill
  • Concern about the constitutional validity of the bill
  • Concern raised about the implementability of the bill
  • Concern raised about state-capacity
  • Concern raised about excessive delegation to the executive
  • Sources cited (if any) (a) news articles; (b) government reports; (c) independent expert reports; (d) journal; (e) anecdotes; (f) other
Certain issues seem endemic to many laws such as implementation gaps, state capacity, and constitutional issues. Whether MPs highlight these crucial but basic issues is a measure of their scrutiny.
   
Specific issues regarding the bill
  • Issue that was most frequently highlighted by the MPs
  • Number of MPs who cited specific clauses
  • Number of MPs who cited data from any source
  • Sources cited (if any) (a) news articles; (b) government reports; (c) independent expert reports; (d) journal; (e) anecdotes; (f) other
  • No. of articles with expert commentary in the media
  • Availability of credible and comprehensive data
Each bill has its own strengths and weaknesses, which may be identified by experts and activists. Whether MPs are able to identify these specific problems is a measure of their scrutiny.
   


Sanyal is CEO and co-founder, Sunay Policy Advisory Pvt Ltd, a policy research startup.

(The article appears in the July 16-31, 2017 issue of Governance Now)
 
 

Comments

 

Other News

‘Oral cancer deaths in India cause productivity loss of 0.18% GDP’

A first-of-its-kind study on the economic loss due to premature death from oral cancer in India by the Tata Memorial Centre has found that this form of cancer has a premature mortality rate of 75.6% (34 premature events / 45 total events) resulting in productivity loss of approximately $5.6 billion in 2022

Days of Reading: Upendra Baxi recalls works that shaped his youth

Of Law and Life Upendra Baxi in Conversation with Arvind Narrain, Lawrence Liang, Sitharamam Kakarala, and Sruti Chaganti Orient BlackSwan, Rs 2,310

Voting by tribal communities blossoms as ECI’s efforts bear fruit

The efforts made by the Election Commission of India (ECI), over last two years, for inclusion of Particularly Vulnerable Tribal Groups (PVTG) communities and other tribal groups in the electoral process have borne fruit with scenes of tribal groups in various states/UTs participating enthusiastically in t

GST revenue for April 2024 at a new high

The gross Goods and Services Tax (GST) collections hit a record high in April 2024 at ₹2.10 lakh crore. This represents a significant 12.4% year-on-year growth, driven by a strong increase in domestic transactions (up 13.4%) and imports (up 8.3%). After accounting for refunds, the net GST

First Magahi novel presents a glimpse of Bihar bureaucracy a century ago

Fool Bahadur By Jayanath Pati (Translated by Abhay K.) Penguin Modern Classics, 112 pages, Rs 250 “Bab

Are EVs empowering India`s Green Transition?

Against the backdrop of the $3.5 billion Production-Linked Incentive (PLI) scheme launched by the Government of India, sales of Electric Vehicles (EVs) are expected to grow at a CAGR of 35% by 2032. It is crucial to take into account the fact that 86% of EV sales in India were under the price bracket of $2

Visionary Talk: Amitabh Gupta, Pune Police Commissioner with Kailashnath Adhikari, MD, Governance Now


Archives

Current Issue

Opinion

Facebook Twitter Google Plus Linkedin Subscribe Newsletter

Twitter