The Ethical Considerations of Artificial Intelligence (AI) in Higher Education

The ethical considerations of AI in higher education

Artificial intelligence (AI) is rapidly transforming higher education. From personalised learning experiences to assessment tools, in addition to building unique curricula and supporting students with diverse needs, AI has the potential to revolutionise the way students learn and interact with universities. However, alongside the exciting possibilities lie a number of ethical considerations that UK universities must carefully navigate to protect their integrity and their students and staff.

In this article, we explore four of the key ethical considerations that the higher education sector must take into account when grappling with the growth of AI and developing university strategy around it. These are:

1. Bias and Discrimination

2. Privacy and Data Security

3. Transparency and Explainability

4. The Human Element

Bias and Discrimination

A major concern surrounding AI in education is the potential for bias. AI systems are trained on data sets, and if those sets are skewed towards certain demographics or learning styles, the AI itself will be biased. This can lead to unfair outcomes for students from underrepresented groups, impacting admissions decisions, grading assessments, and course recommendations.

To mitigate this risk, universities need to take a proactive approach. Firstly, they must conduct thorough audits of the data sets used to train AI tools, ensuring diversity and inclusivity. Secondly, they should implement algorithmic fairness testing to identify and address potential biases before deployment. The Information Commissioner’s Office (ICO) has written a guide for organisations which outlines the risks around fairness, bias and discrimination when it comes to using AI and suggests ways we might address these.

Privacy and Data Security

The use of AI often requires the collection of vast amounts of student data, encompassing learning styles, engagement patterns, and personal information. UK universities have a legal responsibility to comply with data protection regulations such as GDPR. This means being transparent about how student data is collected, used, and stored.

Students should have clear control over their data and be informed about how it is being used to shape their educational experience. Robust data security protocols are essential to prevent breaches and misuse of sensitive information. This applies to both academic and professional departments who are handling all kinds of personal data.

The University of Reading has published a clear and concise guide on data protection and AI. This guide outlines the risks of AI when it comes to personal data and a set of questions that can address these risks, such as identifying a clear purpose of the use of AI, developing awareness of its restrictions and setting out a plan to alert users to unexpected outcomes.

Transparency and Explainability

Many AI algorithms function as "black boxes," making it difficult to understand how they arrive at their decisions. This lack of transparency can be problematic, particularly when it comes to assessment tools or admissions processes, for example. Because of this, a student could receive a low grade on an essay marked by AI, with no clear explanation for the decision, which can be demoralising and hinder their learning progress, in addition to bring into question an institution’s integrity.

However, it’s not just in the realm of assessment where transparency over the use of AI is paramount. Students should also be aware of how their data is being used in relation to AI, as per the section above, and how they themselves are permitted to use AI in their work. The University of Portsmouth, for example, has published a guide for students on how they can use these technologies responsibly and transparently.

Universities should strive for explainable AI, and by this we mean that institutions must ensure that students and faculty understand the rationale behind AI-driven decisions. This could involve providing students with detailed feedback alongside their grades, or developing interfaces that allow educators to audit the decision-making process of AI tools.

The Human Element

While AI can support assessment or provide targeted practice exercises for students, it should never replace the irreplaceable role of human teachers and support staff. Universities must ensure that AI complements and enhances human interaction, fostering critical thinking, creativity, and social skills that are central to a well-rounded education. AI can be a valuable tool for freeing up the time and resources of those working to support student experience and outcomes, allowing them to focus on facilitating discussions, providing personalised guidance, and nurturing the intellectual and social development of students.

Likewise, universities must ensure that AI does not trigger job displacement. Instead of using AI to replace existing staff by taking on their responsibilities, institutions should focus on upskilling staff and ensuring a smooth transition alongside AI implementation. Making sure this is covered in a university-wide strategy and approach to AI is crucial to protect the jobs and expertise of all staff.

There is plenty of ongoing dialogue across the sector on this topic, both at home and abroad. In 2023, the University of Melbourne published a report encouraging the sector to ensure the student is placed at the centre of the use of new AI tools.

Resources

As AI remains a prevalent topic for universities and those working within them, HE Professional offers a range of content and events to support professionals. Our members have access to a range of premium resources on the site, including:

The Future of AI in Higher Education

By proactively addressing these ethical considerations, UK universities can harness the power of AI to create a more personalised, equitable, and effective learning environment for all students. Open discussions, collaboration between educators and AI developers, and a commitment to ethical principles will be crucial in ensuring that AI serves as a powerful tool for progress in UK higher education.

To find out more about how AI is transforming the higher education sector, explore our upcoming events and premium content.