The Joint Research Centre (JRC) of the European Commission has developed the Social Multi-Criteria Evaluation (SMCE) methodology and accompanying SOCRATES software tool to help better integrate multidimensional outcomes, including well-being outcomes, into European Union policy decision-making in a more transparent and collaborative manner. It has explicitly been designed for ex ante impact assessments, where both quantitative and qualitative evidence and data can be included. The outcomes generated by SOCRATES provide an evidence base for policy makers, supporting decision-making in complex and multidimensional policy environments.
The European Commission’s Social Multi-Criteria Evaluation methodology and SOCRATES tool
Abstract
The Social Multi-Criteria Evaluation (SMCE) methodological framework was first conceptualised in research work in 2004, based on social choice and multi-criteria decision theories for designing and comparing public policy alternatives, allowing for the integration of a plurality of technical impact dimensions and social perspectives. The Decision Analysis Lab at the Joint Research Centre of the European Commission conducts methodological and applied research, producing scientific publications, technical reports, guidelines, and tools to advance Social Multi-Criteria Evaluation (SMCE). To help implement the SMCE methodology across the European Commission, the Decision Analysis Lab developed the SOCRATES software tool in 2017.
Social Multi-Criteria Evaluation (SMCE) is a methodological framework for developing and comparing policy alternatives in a consistent and transparent way, allowing for the integration of different technical impact dimensions and social perspectives. The SMCE process aims to clarify the needs of and impacts on different stakeholders through inputs including institutional analysis; stakeholder consultation through focus groups, in-depth interviews and questionnaires; evidence and experts assessments; and different analytical tools to compare and contrast the views of different social actors.
The SOCRATES software tool has been developed to support the implementation of SMCE in a consistent and comprehensive manner. Based on a mathematical model, and comprising three core components – multi-criteria analysis, equity analysis, and sensitivity analysis – SOCRATES allows for the incorporation of both quantitative and qualitative evidence as evaluation criteria for policy alternatives, which leads to a ranking of different options. The final ranking represents not an ideal solution, but the best policy compromise based on the inputs provided, including parameters, weights, and assumptions.
SOCRATES is designed as a user-friendly software tool that assists in formulating alternatives, building matrices, and conducting the necessary analyses to rank options. Developed as an interactive, website-style platform, it requires minimal prior knowledge and offers flexibility in defining policy alternatives, assessment criteria, assumptions, and the selection and weighting of social actors. The tool aims to help policymakers perform complex mathematical analyses with an easy-to-use tool.
The SMCE methodology and SOCRATES tool aim to support more consistent and transparent analysis of policy alternatives in complex situations involving multiple stakeholders. The tool can be used for a variety of policy domains and is designed to include a multidisciplinary range of indicators to assess the quality, feasibility and robustness of policy options. Including such a broad scope of criteria, can help improve decision-making in complex policy contexts.
Since its launch, the SOCRATES software has been employed in several impact assessments, including for the EU regulation on standards of quality and safety for substances of human origin intended for human application, the UN International Atomic Energy Agency’s activities in decommissioning and environmental remediation, and EU regulations on eco-design requirements for local space heaters.
European Commission (2024), SOCRATES, https://web.jrc.ec.europa.eu/socrates/screen/home
European Commission Joint Research Centre (2022), Socrates Manual: Software Manual for Social Multi-Criteria Evaluation, https://publications.jrc.ec.europa.eu/repository/handle/JRC131755
European Commission Joint Research Centre (2024), SOCRATES – Social multi-criteria assessment of European policies, https://knowledge4policy.ec.europa.eu/projects-activities/socrates-social-multi-criteria-assessment-european-policies_en
Munda G. (2021), Qualitative reasoning or quantitative aggregation rules for impact assessment of policy options? A multiple criteria framework. Quality & Quantity, https://doi.org/10.1007/s11135-021-01267-8
European Commission Directorate General for Health and Food Safety (2022), Impact assessment accompanying the Proposal for a Regulation of the European Parliament and of the Council on standards of quality and safety for substances of human origin intended for human application, https://web.jrc.ec.europa.eu/policy-model-inventory/explore/ias/ia-f286073a09d954981216013292657773/
European Commission Directorate General for Energy (2024), Impact Assessment as regards ecodesign requirements for local space heaters and separate related controls, https://web.jrc.ec.europa.eu/policy-model-inventory/explore/ias/ia-f8d44e765ac855df80821c90cbb9cf1a/
