Tim Chewter, Head of Research and Communications, Strategic Development Network (SDN)

If you are looking to deliver (or prepare your apprentices) for end-point assessments in the future, you will need to get to grips with the assessment methods specified in the new assessment plans.

Some of these assessment methods are new to apprenticeships; others will need to be delivered differently.

Over the coming weeks - following our introduction to the new world of “high-stakes” end-point assessment - we are going to publish a series of insights into the different assessment methods used in assessment plans and how they work in practice.

So to kick things off, let’s take a look at the Professional Discussion. Welcome to Article #2

The basics

Professional Discussions are featured in 40% of all new assessment plans across a wide variety of industry sectors.

In essence, the Professional Discussion is a structured interaction with an apprentice as part of the formal end-point assessment process. The two-way dialogue will be recorded (text, video or audio) and graded by the end-point assessor.

Let’s break that down a bit…

When is it used?

Normally, the Professional Discussion is used as part of an observed or project assessment. It is particularly useful where other forms of assessment are difficult to administer, or where evidence for assessment is more difficult to quantify. The Professional Discussion allows you to probe and explore the depth of the apprentice’s knowledge.

How does it work?

The end-point assessor and apprentice undertake a structured discussion with key questions asked and responses recorded (and graded).

What does it assess?

Qualitative interview data primarily assesses applied knowledge and behaviours. A Professional Discussion allows the assessor to test knowledge (“I see you do it – do you know why you do it?”), it allows the assessor to fill in gaps and talk through the apprentice’s breadth of understanding (perhaps where the assessor has only been able to observe the apprentice in narrow settings), and also allows the assessor to validate/authenticate pieces and work / evidence that have been submitted.

If the Professional Discussion is conducted alongside a practical assessment, it can also generate additional evidence to assess the skills of the apprentice.

Validity, reliability and robustness

End-point assessors will need to be skilled in the kind of questions they ask. They will also need to be able to disarm the apprentice’s nerves/anxiety, and be able to conduct the discussion in a way that is consistent across all apprentice’s they assess for that standard.

For example, how many ‘bites of the cherry’ will you give the apprentice to answer the questions adequately? What prompts will you use to draw out higher-level answers to allow apprentices to demonstrate higher-level grade responses?

Advertisement

Assessors will also need to avoid bias. Each apprentice will need to be assessed fairly and consistently, irrespective (for example) of whether the apprentice is confident or nervous, or whether an apprentice is eloquent or where English is their second language.

Your evidence base and recording procedures also need to be robust. It’s high stakes, so there will be times where an apprentice or employer challenges their pass/fail grade and often qualitative methods like a professional discussion can be the first area that is challenged. Your grading decisions will need to stand up to scrutiny, with a clear evidence base.

Advantages of this assessment method

The Professional Discussion is a highly flexible form of assessment that allows the assessor to cover gaps in evidence from project work, practical assessment or written assignments.

If conduced well, the Professional Discussion can evidence behaviour developments and is particularly good at generating evidence for problem solving.

Where conducted with other forms of assessment, such as a practical observation, excellent cross-referenced evidence can be collected to help validate the apprentice’s overall grade (by the assessor themselves and by moderating / external quality testing regimes)

Risks of this assessment method

If questions are poorly designed or closed (eliciting a yes/no response), or where repetition occurs and scope is less well defined, the assessment is likely to produce limited evidence. It’s important to avoid the discussion being a mechanical lists of questions, rather than an opportunity to discuss and explore the area of interest.

The “high-stakes” nature of end-point assessment can compound this issue. With frameworks, the trainer-assessor had built a relationship with the apprentice over a period of year or more. Now the assessor is a stranger (independent of the training), with no prior relationship with the apprentice. The assessor will need to be able to put the apprentice at ease and ask the right questions, allowing the apprentice sufficient space to demonstrate their understanding.

The Professional Discussion can generate a large quantity of qualitative evidence that might be difficult to grade, validate and compare across peer groups. The skill of the assessor is central to the recording of data. The risk is reduced when combined with audio or video assessment tools.

What it means in practice…

  • The discussion should not be contrived (just noting responses to a list of questions). Question structures must permit open responses, but relatively straightforward to administer. Answers should be encouraged beyond one-line responses, to explore the depth of applied knowledge and understanding held by the apprentice
  • Discussions should be semi-structured, but there should be a clearly defined set of outputs for the session. A range of extension questions to allow a range of grading outcomes should also be developed

Tim Chewter, Head of Research and Communications, Strategic Development Network (SDN)

Article #1 High-Stakes - Under the bonnet of end-point assessment

To get to grips with end-point assessment in more depth, places are now available on our Level 3 Award course in Undertaking End-Point Assessment. SDN are also producing a set of recorded presentations covering the main end-point assessment methods and critical areas of practice.

These will be available at the beginning of March. Find out more here: www.strategicdevelopmentnetwork.co.uk/sdnevent

More updates and practice can be accessed on our new End-Point Assessment LinkedIn Group and through our mailing list – feel free to join!

Let us know if you have any comments at the bottom of this page.

Leave a comment:

Please leave a comment below:

Log in to your FE News account to continue the debate and help share best practice and innovation in the FE sector.

You may also be interested in these articles:

Register, Login or Login with your Social Media account:


Advertisers

Latest Education News

Further Education News

The FE News Channel gives you the latest education news and updates on emerging education strategies and the #FutureofEducation and the #FutureofWork.

Providing trustworthy and positive Further Education news and views since 2003, we are a digital news channel with a mixture of written word articles, podcasts and videos. Our specialisation is providing you with a mixture of the latest education news, our stance is always positive, sector building and sharing different perspectives and views from thought leaders, to provide you with a think tank of new ideas and solutions to bring the education sector together and come up with new innovative solutions and ideas.

FE News publish exclusive peer to peer thought leadership articles from our feature writers, as well as user generated content across our network of over 3000 Newsrooms, offering multiple sources of the latest education news across the Education and Employability sectors.

FE News also broadcast live events, podcasts with leading experts and thought leaders, webinars, video interviews and Further Education news bulletins so you receive the latest developments in Skills News and across the Apprenticeship, Further Education and Employability sectors.

Every week FE News has over 200 articles and new pieces of content per week. We are a news channel providing the latest Further Education News, giving insight from multiple sources on the latest education policy developments, latest strategies, through to our thought leaders who provide blue sky thinking strategy, best practice and innovation to help look into the future developments for education and the future of work.

In May 2020, FE News had over 120,000 unique visitors according to Google Analytics and over 200 new pieces of news content every week, from thought leadership articles, to the latest education news via written word, podcasts, video to press releases from across the sector.

We thought it would be helpful to explain how we tier our latest education news content and how you can get involved and understand how you can read the latest daily Further Education news and how we structure our FE Week of content:

Main Features

Our main features are exclusive and are thought leadership articles and blue sky thinking with experts writing peer to peer news articles about the future of education and the future of work. The focus is solution led thought leadership, sharing best practice, innovation and emerging strategy. These are often articles about the future of education and the future of work, they often then create future education news articles. We limit our main features to a maximum of 20 per week, as they are often about new concepts and new thought processes. Our main features are also exclusive articles responding to the latest education news, maybe an insight from an expert into a policy announcement or response to an education think tank report or a white paper.

FE Voices

FE Voices was originally set up as a section on FE News to give a voice back to the sector. As we now have over 3,000 newsrooms and contributors, FE Voices are usually thought leadership articles, they don’t necessarily have to be exclusive, but usually are, they are slightly shorter than Main Features. FE Voices can include more mixed media with the Further Education News articles, such as embedded podcasts and videos. Our sector response articles asking for different comments and opinions to education policy announcements or responding to a report of white paper are usually held in the FE Voices section. If we have a live podcast in an evening or a radio show such as SkillsWorldLive radio show, the next morning we place the FE podcast recording in the FE Voices section.

Sector News

In sector news we have a blend of content from Press Releases, education resources, reports, education research, white papers from a range of contributors. We have a lot of positive education news articles from colleges, awarding organisations and Apprenticeship Training Providers, press releases from DfE to Think Tanks giving the overview of a report, through to helpful resources to help you with delivering education strategies to your learners and students.

Podcasts

We have a range of education podcasts on FE News, from hour long full production FE podcasts such as SkillsWorldLive in conjunction with the Federation of Awarding Bodies, to weekly podcasts from experts and thought leaders, providing advice and guidance to leaders. FE News also record podcasts at conferences and events, giving you one on one podcasts with education and skills experts on the latest strategies and developments.

We have over 150 education podcasts on FE News, ranging from EdTech podcasts with experts discussing Education 4.0 and how technology is complimenting and transforming education, to podcasts with experts discussing education research, the future of work, how to develop skills systems for jobs of the future to interviews with the Apprenticeship and Skills Minister.

We record our own exclusive FE News podcasts, work in conjunction with sector partners such as FAB to create weekly podcasts and daily education podcasts, through to working with sector leaders creating exclusive education news podcasts.

Education Video Interviews

FE News have over 700 FE Video interviews and have been recording education video interviews with experts for over 12 years. These are usually vox pop video interviews with experts across education and work, discussing blue sky thinking ideas and views about the future of education and work.

Events

FE News has a free events calendar to check out the latest conferences, webinars and events to keep up to date with the latest education news and strategies.

FE Newsrooms

The FE Newsroom is home to your content if you are a FE News contributor. It also help the audience develop relationship with either you as an individual or your organisation as they can click through and ‘box set’ consume all of your previous thought leadership articles, latest education news press releases, videos and education podcasts.

Do you want to contribute, share your ideas or vision or share a press release?

If you want to write a thought leadership article, share your ideas and vision for the future of education or the future of work, write a press release sharing the latest education news or contribute to a podcast, first of all you need to set up a FE Newsroom login (which is free): once the team have approved your newsroom (all content, newsrooms are all approved by a member of the FE News team- no robots are used in this process!), you can then start adding content (again all articles, videos and podcasts are all approved by the FE News editorial team before they go live on FE News). As all newsrooms and content are approved by the FE News team, there will be a slight delay on the team being able to review and approve content.

 RSS IconRSS Feed Selection Page