Artificial intelligence is making its way into classrooms nationwide, promising to revolutionize education. Advocates highlight its potential to assist educators with lesson planning, attendance tracking, and even detecting academic dishonesty. However, while AI offers many advantages, its rapid integration into middle and high school education could disproportionately disadvantage Black students.

The Equity Concerns of AI in Education

Experts warn that the increasing reliance on AI in schools may exacerbate existing racial disparities. These concerns include racial bias in grading and curriculum design, the over-disciplining of Black boys, underfunded schools in majority-minority communities, and the ongoing “digital divide” that leaves many Black students without reliable access to technology.

Despite these challenges, many school administrators and policymakers are unprepared to implement AI in ways that promote equity and protect Black students.

“We already know about the bias issues with AI,” says Victor Lee, an associate professor at Stanford University Graduate School of Education. “The risk for technologically induced bias is quite high for schools that adopt AI too quickly.”

Still, AI adoption in education is growing. Surveys show that one in four educators plan to increase AI usage in their classrooms, raising concerns that the technology is advancing faster than schools can properly regulate it.

AI in the Classroom: A Double-Edged Sword

Technology has long played a role in education—from pocket calculators in the 1970s to today’s take-home laptops. AI is already present in classrooms through tools like math-solving apps and Google smart boards that recognize shapes and colors. However, generative AI is considered a major shift in how teachers and students interact with technology.

Education experts like Matthew Lynch emphasize AI’s potential to reduce teachers’ workloads by automating grading, lesson planning, and even identifying struggling students who need personalized tutoring. Some schools are also using facial recognition technology for student discipline.

But AI’s effectiveness depends on how it is designed and implemented. Research shows that AI-driven educational tools often reflect the biases of their creators. The tech industry remains predominantly white, with Black workers making up only 7.4% of digital employees, according to a 2023 McKinsey & Co. report.

“Tech companies often don’t understand the experiences of Black and Brown students in the classroom,” says Nidhi Hebbar, co-founder of the EdTech Equity Project, an organization that helps schools choose inclusive ed-tech products. Many developers partner with well-funded, predominantly white schools or base their designs on personal experiences that don’t account for the realities of under-resourced schools.

As a result, AI-powered learning tools may present an incomplete or biased view of Black history, misinterpret cultural references in student essays, or fail to accurately identify students who need additional support. Furthermore, AI-powered test proctoring and facial recognition systems have been found to struggle with recognizing Black and Brown faces accurately, leading to potential misidentifications and unfair disciplinary actions.

Another major issue is access. AI-driven homework and assignments assume that all students have reliable computers and internet connections at home, which is often not the case for students in underfunded districts. Additionally, some schools may turn to AI as a cost-cutting measure in response to teacher shortages, potentially reducing the quality of instruction.

Critical Questions for AI in Schools

The widespread adoption of AI in education requires careful consideration.

“Bias exists in any creation,” says Lee. “Even something as simple as a notebook or a pair of scissors can be difficult for certain users, like left-handed people. AI is no different.”

Before fully embracing AI in schools, educators and policymakers must ask tough questions: Are we thinking critically about its implementation? Are we ensuring that Black students and other marginalized groups are not left behind? How can we make AI in education more inclusive and equitable?

The potential for AI in education is immense, but its benefits must be accessible to all students. Without thoughtful policies and oversight, AI risks deepening existing inequalities rather than solving them.