The future of assessments in Social Care

We’re excited to share insights from our internal testing on how Generative AI can support and enhance the assessment process for social care qualifications, from grading to providing tailored feedback. This example, based on a single question taken from a ‘live’ accredited qualification highlights AI’s potential impact on quality assurance and efficiency.

Let’s take a quick look at the results

Human Feedback (Assessment marked as Not Passed)

Hi XXXX,

You have made a good start to this answer and highlighted some valid points.

Please can you add more detail to show how sensory issues can impact a person’s ability to process information. This could include the environment that they are in for example, how light it is, how dark it is, the external sounds or their attention span.

Please include two different types of dementia and explain how the condition would impact the way the person would process and understand information.

AI Feedback (Assessment marked as Not Passed)

To pass this assessment, you need to expand your answer to include the following:

• Explain the normal information processing pattern, including sensory input (e.g., sight and sound), attention, and memory.
• Describe how at least two different types of dementia affect the information processing pattern.
• Provide more specific examples of how dementia impacts an individual’s abilities and limitations in processing information.
• Include more detail on the neurological aspects of information processing in relation to dementia.

Remember to use the command verb “explain” effectively, which means you should give details that make what you are trying to say clear to the reader, including reasons showing how or why.

Additionally, please review your spelling and grammar. For example, “aggression” is misspelled as “agression”, and there are some punctuation errors. Proofreading your work before submission will help improve the overall quality of your answer.

Observations

Personalisation

The human assessor shines here, adding that essential personalised touch. But we can personalise AI over time.

Quality and depth of feedback

It’s close, but AI takes a slight lead with nuanced observations.

Additional Insight

AI easily identifies spelling and grammar issues, enhancing clarity.

Subject knowledge

Human assessors require several years to build expertise. Once configured, AI will instantly and consistently assess against the qualification specification, learning resources, marking scheme, etc.

Assessment time

• Human: 10-15 mins per answer
• AI: 5-10 seconds per answer

We are excited about the potential for AI to enhance the assessment process to help drive productivity and quality and we will continue to share more as we develop our AI Assessor service further.