Jacqui Molkenthin, JEML Consulting

An insight into external quality assurance of end-point assessment

This article is the first in a series of articles on the External Quality Assurance of End-point Assessment of apprenticeship standards.

The series will aim to enable the reader to understand the background and context of EQA, and then, through a series of interviews with EQA providers, understand the approaches and perspectives of EQA providers.

Firstly, let’s start with a little background

The April 2017 DfE Strategic Guidance to the Institute for Apprenticeships (referred to as “the Institute”) stated that one of the core functions of the Institute was to ensure all end-point assessments are quality assured, including quality assuring some itself (known as External Quality Assurance).

The document then set out the options for quality assurance that sat alongside the Institute quality assuring some themselves. The chosen quality assurance option sits with the employer group designing the apprenticeship standard and is named in the assessment plans.

These options were, and remain, as follows:

  • an employer led model,
  • a professional body,
  • Ofqual, or
  • the Institute

This means that the Institute has both an overarching role on EQA, as well as in the delivery of EQA itself for some standards. Where the institute provides EQA, the strategic guidance was clear that there must be separation between their overarching role and that of delivery of its own EQA. That separation has been made through the contracting of its EQA delivery to Open Awards.

The 2017 strategic guidance stated that it was up to the Institute to decide what form its EQA took, but that they should ensure that effective and high-quality EQA processes are available and are applied to all end-point assessments so as to ensure consistent, valid assessment and require a high standard from all apprentices.

In the March 2019 DfE Strategic Guidance to the Institute for Apprenticeships and Technical Education, the Institute, was asked to “review and strengthen its framework for EQA of apprenticeship assessment, setting out requirements for all bodies delivering EQA.”

Furthermore, the House of Commons Committee of Public Accounts in May 2019 recommended that the Institute write to them within 6 months to “set out what they will do to streamline and strengthen quality assurance arrangements in order to give greater confidence that end-point assessments are robust, fair and consistent.”

I understand that the EQA framework from the Institute is due out soon.

What is the role of the EQA Provider?

The Institute website summarises the 3 areas that should be explored by EQA providers:

  1. Standards and assessment plans (for example, checking they are fit-for-purpose, that the assessment methods are valid and align to KSBs, and independence)
  2. End-point Assessment (for example, assessment operating effectively, grading is accurate and consistent, fair access, assessor competency and sufficiency, gateway)
  3. End-point Assessment Organisations (for example, robust IQA and data collection, storage/sharing processes; effective resits, retakes, appeals, complaints handling; timeliness)

The latest quality statement from the Institute confirms that EQA is there to ensure that end-point assessment is valid, reliable, manageable and independent, providing a high-quality experience that allows apprentices to showcase their competence and gives confidence that they have achieved the right standard.

What can an EQA provider charge?

The Institute is clear that EQA should be a not-for-profit service. The charging structures vary considerably across EQA providers, and it depends on what the EQA provider quoted within their original proposal (EQA methodology). Part of this calculation will have been based around anticipated apprentice volumes. I will be looking into this in greater detail in my follow up articles/interviews with EQA providers.

A review of the published letters of recognition to EQA providers shows that the majority charge a per apprentice fee, ranging from £40 to £179 per apprentice (average of £70 per apprentice for those that charge a ‘per apprentice’ fee). There are some that do not make any charges and others that apply an annual fee to the End-point assessment organisation, instead of, or in addition to, a per apprentice fee.

EQA providers are be required to submit an annual financial report to the Institute for EQA activities evidencing income and expenditure.

Reporting and Action – Ofqual

Ofqual is the only statutory regulator for non-degree apprenticeships. Ofqual treat End-point assessments as qualifications and all EpAOs regulated by them must be recognised by them. Ofqual have the power to

intervene where there are issues with the quality of assessments, and in extreme cases issue fines or withdraw recognition.

Reporting and Action, all other EQA providers

All recognised EQA providers, in accordance with their recognition letters, are required to produce an annual report for each end-point assessment organisation on the register for the standard they are responsible for externally quality assuring. 

This report must provide an overall judgment on compliance, data, strengths, recommendations, assessment validity, reliability, comparability and independence, internal quality assurance and costs. This report will be shared with the end-point assessment organisation and the Institute.

In addition, the EQA provider must produce a report (at least once a year) on the quality of delivery and fitness-for purpose of the Standard and Assessment Plan including a summary across all relevant End-point Assessment Organisations. Templates for these reports can be found on the Institute website. If an EQA provider identifies a serious issue, such as fraud or malpractice, it must be reported to the Institute immediately.

The reports allow the Institute’s Quality Assurance Committee to take decisions on what improvements might be required either by individual End-point Assessment Organisations, or across the standard as a whole. The Institute may make reports or elements of them publicly available.  If the EQA provider notified the Institute of a serious issue or concern, the Institute Board or Quality Assurance Committee may decide that a review is needed.

I will be looking in more detail about how each EQA operates in my follow up articles and interviews with EQA providers.

The current picture

Based on the 20th May 2019 spreadsheet of apprenticeship standards published on the Institute for Apprenticeships and Technical Education website, there are 35 named EQA providers, across the 4 options listed previously. Of these, 17 are providers are marked as “TBC” (to be confirmed).

Using this same spreadsheet there are 449 standards approved for delivery, of which 353 (79%) have a named EQA provider. The remaining 96 of the standards have the EQA provider marked as “TBC”.

Of those with a named EQA provider, 202 (57%) are the Institute for Apprenticeships and Technical Education, 64 (18%) are Ofqual, and 87 (25%) are either an employer led or a professional body EQA provider.

The proportion may seem high for the Institute given the statement in the April 2017 DfE Strategic Guidance paragraph 29 “We would expect the Institute to be named as the EQA organisation only in instances where alternatives are not viable”. However, this may be explained by the preceding paragraphs in the same guidance which stated that “an EQA option must be included in each assessment plan, selected by the employer group, before it can be approved”, and that “the Institute was added as an option to all to avoid assessment plans, and therefore starts, being held up”.

The percentage with the Institute named as their EQA provider is falling, from a high of high of 56% of standards approved in 2015, to 40% of standards approved in 2019.

Of those marked as “TBC”, 55% have an EQA provider name written next to the “TBC”. The largest proportion of those is QAA (31 of the 96 standards). This probably explains why 52% of the standards with the EQA provider marked as “TBC” are at level 6 and 7. However, please note that, as at the time of writing, I understand that an announcement with regard to the quality assurance of level 6 and 7 is due out soon. The sectors with the highest volume of standards with the EQA provider marked as TBC are the Engineering and Manufacturing, Construction and Health and Science sectors.

Jacqui Molkenthin, JEML Consulting

I hope you have found this background article useful. Over the next few weeks I will be writing articles and adding videos and podcasts on EQA following interviews with a range of EQA providers. If you are an EQA provider, who is not already booked in for an interview, and you are interested in being interviewed, please do This email address is being protected from spambots. You need JavaScript enabled to view it..

You may also be interested in these articles:

Register, Login or Login with your Social Media account:


Advertisers

Advertiser Skyscrapers

Video Advert

Newsroom Activity

FE News: The Future of Education News Channel had a status update on Twitter 27 minutes ago

RT @TomBewick: DJing, house music and skills policy - How I combined my passions to create a community radio show for #FE - tune into ⁦@Ski…
View Original Tweet

Latest Education News

Further Education News

The FE News Channel gives you the latest education news and updates on emerging education strategies and the #FutureofEducation and the #FutureofWork.

Providing trustworthy and positive Further Education news and views since 2003, we are a digital news channel with a mixture of written word articles, podcasts and videos. Our specialisation is providing you with a mixture of the latest education news, our stance is always positive, sector building and sharing different perspectives and views from thought leaders, to provide you with a think tank of new ideas and solutions to bring the education sector together and come up with new innovative solutions and ideas.

FE News publish exclusive peer to peer thought leadership articles from our feature writers, as well as user generated content across our network of over 3000 Newsrooms, offering multiple sources of the latest education news across the Education and Employability sectors.

FE News also broadcast live events, podcasts with leading experts and thought leaders, webinars, video interviews and Further Education news bulletins so you receive the latest developments in Skills News and across the Apprenticeship, Further Education and Employability sectors.

Every week FE News has over 200 articles and new pieces of content per week. We are a news channel providing the latest Further Education News, giving insight from multiple sources on the latest education policy developments, latest strategies, through to our thought leaders who provide blue sky thinking strategy, best practice and innovation to help look into the future developments for education and the future of work.

In May 2020, FE News had over 120,000 unique visitors according to Google Analytics and over 200 new pieces of news content every week, from thought leadership articles, to the latest education news via written word, podcasts, video to press releases from across the sector.

We thought it would be helpful to explain how we tier our latest education news content and how you can get involved and understand how you can read the latest daily Further Education news and how we structure our FE Week of content:

Main Features

Our main features are exclusive and are thought leadership articles and blue sky thinking with experts writing peer to peer news articles about the future of education and the future of work. The focus is solution led thought leadership, sharing best practice, innovation and emerging strategy. These are often articles about the future of education and the future of work, they often then create future education news articles. We limit our main features to a maximum of 20 per week, as they are often about new concepts and new thought processes. Our main features are also exclusive articles responding to the latest education news, maybe an insight from an expert into a policy announcement or response to an education think tank report or a white paper.

FE Voices

FE Voices was originally set up as a section on FE News to give a voice back to the sector. As we now have over 3,000 newsrooms and contributors, FE Voices are usually thought leadership articles, they don’t necessarily have to be exclusive, but usually are, they are slightly shorter than Main Features. FE Voices can include more mixed media with the Further Education News articles, such as embedded podcasts and videos. Our sector response articles asking for different comments and opinions to education policy announcements or responding to a report of white paper are usually held in the FE Voices section. If we have a live podcast in an evening or a radio show such as SkillsWorldLive radio show, the next morning we place the FE podcast recording in the FE Voices section.

Sector News

In sector news we have a blend of content from Press Releases, education resources, reports, education research, white papers from a range of contributors. We have a lot of positive education news articles from colleges, awarding organisations and Apprenticeship Training Providers, press releases from DfE to Think Tanks giving the overview of a report, through to helpful resources to help you with delivering education strategies to your learners and students.

Podcasts

We have a range of education podcasts on FE News, from hour long full production FE podcasts such as SkillsWorldLive in conjunction with the Federation of Awarding Bodies, to weekly podcasts from experts and thought leaders, providing advice and guidance to leaders. FE News also record podcasts at conferences and events, giving you one on one podcasts with education and skills experts on the latest strategies and developments.

We have over 150 education podcasts on FE News, ranging from EdTech podcasts with experts discussing Education 4.0 and how technology is complimenting and transforming education, to podcasts with experts discussing education research, the future of work, how to develop skills systems for jobs of the future to interviews with the Apprenticeship and Skills Minister.

We record our own exclusive FE News podcasts, work in conjunction with sector partners such as FAB to create weekly podcasts and daily education podcasts, through to working with sector leaders creating exclusive education news podcasts.

Education Video Interviews

FE News have over 700 FE Video interviews and have been recording education video interviews with experts for over 12 years. These are usually vox pop video interviews with experts across education and work, discussing blue sky thinking ideas and views about the future of education and work.

Events

FE News has a free events calendar to check out the latest conferences, webinars and events to keep up to date with the latest education news and strategies.

FE Newsrooms

The FE Newsroom is home to your content if you are a FE News contributor. It also help the audience develop relationship with either you as an individual or your organisation as they can click through and ‘box set’ consume all of your previous thought leadership articles, latest education news press releases, videos and education podcasts.

Do you want to contribute, share your ideas or vision or share a press release?

If you want to write a thought leadership article, share your ideas and vision for the future of education or the future of work, write a press release sharing the latest education news or contribute to a podcast, first of all you need to set up a FE Newsroom login (which is free): once the team have approved your newsroom (all content, newsrooms are all approved by a member of the FE News team- no robots are used in this process!), you can then start adding content (again all articles, videos and podcasts are all approved by the FE News editorial team before they go live on FE News). As all newsrooms and content are approved by the FE News team, there will be a slight delay on the team being able to review and approve content.

 RSS IconRSS Feed Selection Page