Evidence Checks UK

Evidence-based policymaking in the UK

MethodOnline brainstorming

Participatory TaskIdeas/Proposals

URLlaunch

Read Time

Brief View 1 MINS

Full Story 3 MINS

"Evidence Checks" are one-month exercises in which members of the public are invited to provide comments online regarding the validity of evidence on which policy is based. This process allows a large and diverse group of people with relevant experience and expertise to identify gaps in research that require further review. In the UK House of Commons, there is a Select Committee that conducts oversight for each government department that is charged with examining spending, policies and administration. In an Evidence Check, government departments supply information to thier respective Committee about an issue. Committee staff publish the information on a new page on their respective parliament.uk page that is dedicated to the evidence check, and then shares the task of scrutinizing that evidence with a wider pool of experts, stakeholders, and members of the general public. Typically, the Committee uploads the government statement as a publicly-viewable PDF and frames the request with specific questions and problems which they would like participants to address. A more detailed description of this process, which comprises three steps, is as follows:

  1. The Committee requests a submission from the government department responsible for a policy. The Department is asked to supply information about the policy in question and the evidence upon which the policy is based.
  1. The Committee publishes the departmental submission and adds a page to their website to collect comments over a period of 3-4 weeks, inviting academics, stakeholders, practitioners and members of the public affected by the policy, to comment on the departmental advice. Comments can address the strength of the evidence provided by the department, highlight contrasting evidence, and identify selection biases and gaps in the evidence. While the web forum is public, committee staff may choose to review comments before and after users post them to ensure that they are not defamatory, abusive, or otherwise inappropriate.
  1. The Committee assesses comments and uses them to guide further investigation of the policy and/or integrates the commentary into its final report which, in turn, is supplied to the relevant government Minister for response.

Within this broad approach, Commons Select Committees have implemented evidence checks in varying ways.

In 2014/15 the Education Select Committee used the process to help it develop its work program. Initially, the Committee requested a 2-page statement on 9 topics from the Department of Education, inviting public comment via web forums on each topic, as well as comment on the Department’s approach to the use of evidence, generally. Comments in the web forums then informed Committee decisions regarding what areas to focus on and what areas to hold oral evidence sessions for.

In 2016, the Science and Technology Select Committee published 7 government statements on policy areas including driverless cars, smart cities, digital government, smart meters and flexible working arrangements. It sought comments that aligned with a framework that the Institute for Government developed in partnership with the Alliance for Useful Evidence and Sense About Science, which covered diagnosis of the issue, evidence-based action by government, implementation method, value for money, and testing and evaluation.

Targeted outreach, including social media, guest blogs on civil society organization websites, and leveraging the networks of organizations with expertise in the related policy topic, has proven  crucial for obtaining high quality participation on an array of policy topics.

Evidence Checks help committees hold government to account  more efficiently and effectively by leveraging the collective intelligence of a broader expert audience.  In 2016, the evidence check conducted by the Women and Equalities Committee into sexual harassment in schools (dubbed a “Fact Check”) generated contributions from knowledgeable stakeholders, students with lived experience of harassment, and led to a revised (upwards) estimate of the incidence of harassment. Subsequently, information from contributions was incorporated into the Ministerial Briefing on the issue.

What does it cost? There are no documented costs with what is essentially expanding the hearing process to the Web and enabling a broader audience to scrutinize what has been presented to the Committee. Because the process runs via the Committee’s own webpage, the overhead is low.

  • The online collection of comments reduces temporal and geographic barriers to accessing relevant experts, increasing the level of expertise and experience that the Committee has access to.
  • Web forums where members of the public can submit their comments, to be reviewed by Parliament, can encourage more members of the public with compelling lived experiences to contribute through less formal (but still transparent) processes.
  • This method does not require sophisticated technology and is a low cost option compared to other methods of collecting large-scale public opinion.
  • Evidence Checks solicit specific responses to clearly identified and granular problems posed by the Committees, rather than vague responses to broad problems.
  • Evidence Checks could be improved with better technology that allows people to add references, rate one another's responses, add videos and additional briefing materials, and permits more sophisticated modernization
  • Without the right level of outreach to interested individuals and groups, participation will be low to non-existent.
  • Questions have to be clearly framed to ensure that participation actually addresses the relevant questions pertaining to the reliability of evidence.

“Select Committees.” www.parliament.uk, UK Parliament, www.parliament.uk/about/how/committees/select/.

Gold, Jen. “Making an Evidence Check Work.” Institute for Government, 5 Jan. 2016, www.instituteforgovernment.org.uk/blog/making-evidence-check-work.

“Evidence check web forum.” www.parliament.uk, UK Parliament, https://www.parliament.uk/business/committees/committees-a-z/commons-select/education-committee/dfe-evidence-check-forum/?id=94525.

“Evidence check web forum.” www.parliament.uk, UK Parliament, https://www.parliament.uk/business/committees/committees-a-z/commons-select/science-and-technology-committee/science-and-technology-evidence-check-forum/.

Simon, Julie, et al. Digital Democracy: The Tools Transforming Political Engagement. Nesta, 2017, pp. 38–39.