Evaluating the SQE

The SQE was introduced in September 2021 as a single, rigorous assessment that all aspiring solicitors must take to qualify in England and Wales. It replaced the old system of qualification where a range of SRA approved training providers assessed who passed. The SQE aims to ensure that all solicitors are held to the same standards when admitted, regardless of their background or path to qualification. 

A key feature of the new qualification system is QWE, which replaces the two-year period of recognised training previously required (often known as a training contract). Unlike this, QWE offers greater flexibility by allowing candidates to gain legal work experience across various roles and organisations (up to four). Candidates must complete two years' experience providing legal service that offers them the chance to develop some or all of the competencies needed to be a solicitor.

We introduced the SQE to:

• provide greater assurance of consistent high standards at the point of qualification as a solicitor
• create new and diverse pathways to qualification that:
  • respond to the changing legal services market
  • promote a more diverse profession by removing artificial and unjustifiable barriers.

Our evaluation programme is designed to assess how well the SQE is delivering on these objectives. It includes research into candidate and employer experiences, the training market, costs of qualification and the role of QWE.

The programme will run over several years across five phases to capture the long-term impacts of the qualification reforms. It will include analysis of the following: 

• the fairness, validity and reliability of the SQE
• the impact of the reforms on solicitor education and training, and on the legal market, including any impacts on equality and diversity
• the perceptions and experiences of candidates, legal employers, and training providers with the SQE and QWE
• any unintended consequences that may emerge over time.

Below are details of each of the five phases of the evaluation.

Phase one (2021)

In phase one, we commissioned independent consultancy Pye Tait to develop an evaluation framework for the SQE and QWE (PDF 40 pages, 754KB). This framework sets out how we will assess the impact of the reforms over time.

It includes a logic model and Theory of Change, which outline the intended outcomes of the SQE and how these are expected to be achieved. The framework also identifies key indicators to track progress and provides a structure for future evaluation phases.

This work forms the foundation of our evaluation programme and ensures that our approach is robust, transparent and evidence-based.

Phase two (2022-2023)

In the second phase, we conducted a survey in November 2022 to gather information about initial perceptions and experiences of the SQE and QWE among candidates, legal employers, training providers and other organisations. We published a report on the survey findings in March 2023.

In November 2023, we conducted another online survey on experiences of QWE, asking the same QWE questions as the initial survey conducted in 202. We published a report on this survey in April 2024.

Phase three evaluation (2024-2025)

We commissioned independent research agency IFF to carry out the third phase of the SQE evaluation. This is the first full assessment of stakeholder perceptions of the qualification reforms and SQE’s introduction. It builds on earlier perception studies and captures views from a candidate population that has largely qualified through the SQE route. And offers a representative picture of how the reforms are being experienced in practice.

IFF used a mixed-methods approach, combining large-scale surveys with qualitative interviews and focus groups. The research included responses from more than 1,800 SQE candidates, 447 legal employers and 28 training providers. It explored perceptions of the SQE training market, the role of QWE, the cost of qualifying and overall confidence in the qualification reforms.

The study focused on the experiences and perceptions of key stakeholders, rather than technical aspects of the assessment. It provides a baseline for future evaluation phases and helps us understand how the reforms are being received across the profession.

You can find out more by reading the full report.

Phase four evaluation

We are currently conducting the fourth phase of the evaluation, which will consist of:

• an independent, technical review of the SQE to determine the extent to which it is valid, reliable and fair – the first since the introduction of the SQE
• a further study of the impact of the reforms on the legal services market and the training market. This will include another survey of candidates, legal employers, and training providers to track perceptions and experiences of the SQE
• a review of the Statement of Solicitor Competence and SQE1 Assessment Specification.

We will update this page once the fourth phase of the evaluation is complete.

Phase five evaluation

The final stage of our evaluation programme will build on the findings from earlier phases. It will revisit key areas of focus to assess the longer-term impact of the SQE reforms.

Introduction

The new Solicitors Qualifying Examination (SQE) is key to achieving our corporate objective of setting and maintaining high standards for the profession. It is also an important step towards the development of new and diverse pathways to qualification and the promotion of a diverse profession.

The SQE is a single, rigorous assessment for all aspiring solicitors. The first of the two part assessment is SQE1, which tests the application of legal knowledge through two 180 question exams looking at 13 areas of law. The second is SQE2 which tests 16 legal skills assessments across different practice areas. Ethics and professional conduct are tested throughout and SQE1 must be passed before a candidate can take SQE2.

Our assessment provider for the SQE is Kaplan. This means they are also the approved registered provider for the end point assessment for solicitor apprentices. We have been appointed as the quality assurer by the Institute for Apprentices and Technical Education. Find out more about the solicitor apprentice standard and assessment plan.

Our quality assurance (QA) framework sets out how we will safeguard the standard and assure the quality of the SQE.

Quality assurance outcomes

This framework aims to achieve these outcomes (or alert us to risks) by creating a bank of evidence showing that:

• the assessments are valid (including realistic) and reliable
• the Threshold Standard is being consistently applied
• assessments are fair and free from bias
• decisions about candidate performance are fair and consistent
• the assessment questions are aligned to the assessment specifications and the assessment blueprint
• ethics and professional conduct pervade the SQE and candidate performance in ethics and professional conduct is to a standard appropriate to professional practice
• the assessment is secure
• the quality of the assessment, including delivery is to a good standard
• the information provided to candidates and training providers is clear, accessible, accurate and timely

Principles

The framework is built on a set of principles to make sure:

• the assessment is relevant to professional competence
• it has consistent and evidence-based decision making
• there are reliable results
• there is confidence in the assessment
• there is continuous improvement
• equality, diversity and inclusion has been appropriately considered throughout

These principles are:

• a culture of transparency and openness is fostered and maintained
• all assessments are valid, reliable and fair
• policies and processes are effective, efficient and applied in a consistent way
• effective mechanisms and procedures for identifying and managing risk are used
• best practice and continuous improvement are achieved

Our quality assurance model

We are using the three lines of defence model of quality assurance and risk management, to which we have added a fourth:

• First line – Kaplan’s documented policies, processes and controls, manage risk to the standard and quality of the SQE on a day to day-to-day basis
• Second line – Kaplan monitors and reviews the application of its policies and processes for compliance, consistency and risk in the development and delivery of the SQE
• Third line – we check that Kaplan has a robust framework in place to:
• quality assure key activities associated with the development and delivery of the SQE
• monitors and obtain evidence of compliance
• provides effective controls and management of risk
• Fourth line - an SQE Independent Reviewer monitors and reviews the development and delivery of the assessment by Kaplan and our own monitoring and quality assurance activity

The framework

Our QA framework reflects the steps we have taken in the SQE’s development and what is in place for its ongoing quality assurance:

• developed the assessment specifications (and assessment plan for solicitor apprentices), through extensive stakeholder engagement and piloting to make sure that the SQE is fit for purpose
• appointed Kaplan to develop and deliver the assessment following a rigorous tendering process
• contractual obligations which set out requirements and service levels in the development and delivery of the SQE, and agreed mechanisms for monitoring these
• working closely with Kaplan to review and agree all processes and policies to make sure they are ready to deliver the SQE
• a cycle of monitoring activity reflected in the third line of defence
• independent oversight by an external reviewer and psychometrician reflected in the fourth line of defence
• regular reporting on the quality of the SQE

Monitoring

Our quality assurance activities are focussed in the third line of defence and provide for a continuous cycle of monitoring including:

• checking processes and policies are consistently applied by Kaplan
• checking the assessments are valid, reliable and fair, and align to the assessment specifications and assessment blueprint
• assessment sampling and observations of live assessments by subject matter experts
• making sure the Threshold Standard is consistently applied
• checking decisions made relating to candidates are fair and consistent and according to agreed policies and practices
• data collection, analysis and evaluation of candidate performance
• checks for barriers to equality, diversity and inclusion
• reviewing policies and processes
• obtaining stakeholder feedback
• monthly meetings with Kaplan to check against service levels

Our quality assurance activities will take place before, during and after each assessment. This allows us to manage risk and to take action where needed.

External oversight

In addition to the checks and monitoring that we will carry out (including those made by our subject matter experts), we have a further level of assurance from two independent sources:

• the SQE Independent Reviewer who will provide oversight of the quality assurance of the SQE by Kaplan and us
• the independent psychometrician who will provide oversight and quality assurance of Kaplan’s SQE psychometric and assessment analysis

They will make sure Kaplan’s internal controls and quality assurance are effective, and risk management mechanisms put in place are robust and working effectively.

Reporting 

A report on candidate performance is published after each Assessment Board.

From 2023, we have published annual reports reviewing the SQE and candidate performance over several delivery points.

Continuous improvement and review

Our ongoing monitoring, and that built into Kaplan’s quality assurance framework, is designed to aid continuous improvement as follows:

• a regular cycle of policy and process review, including a review of this framework
• meetings following each assessment to capture issues arising from delivery and agree solutions for future assessment runs
• feedback from meetings with the SQE Oversight Group
• feedback from the Trailblazer Steering Group
• feedback from the SQE reference group to include membership from key stakeholder groups including:
• special interest and diversity groups
• universities and training providers
• Junior Lawyers Division
• The Law Society