AI Safety and Privacy in K–12 Schools: 2026 Teacher Guide

AI Safety and Privacy in K–12 Schools: 2026 Teacher Guide

October 21, 2026

AI Safety and Privacy in K–12 Schools: 2026 Teacher Guide

ai safety and privacy

TLDR

AI safety and privacy means using artificial intelligence so it does not harm people or misuse their data. In schools, AI safety focuses on producing accurate, age-appropriate, human-reviewed outputs. AI privacy focuses on how student information is collected, entered, stored, shared, retained, deleted, and protected. The safest everyday approach for teachers is creating instructional materials without entering student-identifying information into AI tools. This guide explains the difference between safety, privacy, security, and compliance, then gives teachers a practical checklist.


AI is already in classrooms. According to the Center for Democracy & Technology, 85% of teachers reported using AI during the 2024-25 school year, and 86% of students said they had used AI for school or personal purposes. But formal guidance has not kept pace. Gallup found that only 18% of public K-12 teachers received formal guidance from administrators on how AI tools should be used at work.

That gap between adoption and guidance is exactly where AI safety and privacy problems emerge. Teachers want to save time on lesson plans, worksheets, and assessments. They do not want to accidentally expose student data or rely on an AI tool that gives harmful outputs. This guide is meant to close that gap.

Explore AI tools built for teachers

What Is AI Safety and Privacy?

AI safety is the practice of reducing the chance that AI systems cause harm through inaccurate outputs, unsafe advice, bias, inappropriate content, overreliance, or poor supervision.

AI privacy is the practice of controlling how data is collected, entered into, processed by, stored in, shared through, retained by, and deleted from AI systems.

These two ideas overlap but are not the same. A tool can be privacy-protective and still unsafe if it produces biased or inaccurate content. A tool can generate perfectly appropriate content and still be a privacy problem if it stores or shares student data improperly.

In schools, AI safety and privacy together answer one core question: can teachers and students use AI without exposing student data, creating unsafe outputs, or violating school privacy rules?

The National Institute of Standards and Technology (NIST) outlines characteristics of trustworthy AI: valid and reliable, safe, secure and resilient, accountable and transparent, explainable and interpretable, privacy-enhanced, and fair with harmful bias managed. That framework applies directly to school AI decisions, because a tool that fails on any of those dimensions creates risk for students.

Why AI Safety and Privacy Matter for Teachers

The numbers tell a clear story. Adoption is high and growing, while support structures lag behind.

Cengage Group’s 2025 survey found that 63% of K-12 teachers said they or their district had incorporated generative AI into the teaching process. At the same time, 87% of teachers and 88% of administrators believed there was moderate to severe risk in using generative AI. Teachers know something is off. They are using AI, but they are not confident they are using it safely.

Parents feel this even more strongly. CDT found that 69% of parents were concerned or worried about the privacy and security of student data collected and stored by schools, compared to 35% of teachers. That concern gap matters. If a parent asks what data was shared with an AI tool and the school cannot answer, trust erodes fast.

Meanwhile, 58% of teachers report receiving no guidance at all on using AI for grading and providing student feedback, according to Gallup’s research. Grading is one of the highest-risk AI use cases because it involves student work, scores, names, and evaluative decisions. The lack of guidance on exactly that task is a problem.

AI Safety vs. AI Privacy

Teachers sometimes treat these terms as interchangeable. They are not. Here is how they differ in practice:

AI Safety AI Privacy
Core question Will the AI’s behavior or output harm students? What happens to the data entered into or created by the AI?
Classroom example A chatbot gives unsafe mental-health advice or a biased recommendation A teacher pastes a student essay with a name and disability details into an unapproved chatbot
Common mistake Assuming content filters alone make AI “safe” Thinking “no model training” means “no privacy risk”

AI safety in K-12 includes keeping outputs age-appropriate, preventing harmful content, avoiding overreliance on AI for grading or IEPs, keeping humans in charge of decisions that affect students, and monitoring student-facing AI interactions.

AI privacy in K-12 includes not entering student PII into unapproved tools, knowing whether prompts and files are retained, knowing whether data is used for model training, requiring a data privacy agreement (DPA) for tools that process student data, and giving families required rights and notices under laws like FERPA and COPPA.

The position worth taking is that privacy is only one layer of safety. A tool can protect data perfectly and still be unsafe if it produces hallucinated feedback, biased recommendations, or age-inappropriate content. Both layers matter.

AI Safety, Privacy, Security, and Compliance: How They Fit Together

Four distinct concepts get blurred in most school conversations about AI. Here is a clear breakdown:

Term Plain-English Meaning Classroom Example Common Mistake
AI Safety Will the AI’s behavior or output harm students? A chatbot gives unsafe mental-health advice Assuming content filters alone make AI “safe”
AI Privacy What happens to data entered into or created by the AI? A teacher uploads a student score spreadsheet to an unapproved tool Thinking “no training” means “approved for FERPA data”
AI Security Is the data and system protected from unauthorized access? Weak admin controls let staff view records they should not Equating encryption with full compliance
AI Compliance Are laws, contracts, district policies, and consent rules followed? A district signs a DPA and limits use to educational purposes Saying a tool is “FERPA compliant” without checking school control and purpose limits

NIST separates these characteristics intentionally. A system can be encrypted (secure) but still collect more data than necessary (poor privacy). A system can follow FERPA (compliant) but still produce biased outputs (unsafe). All four matter.

For a closer look at how security practices work in education AI tools, you can review TeachTools security practices.

What Student Data Should Not Go Into Unapproved AI Tools?

This is the most practical question teachers ask. The answer is straightforward.

Do not enter any of the following into an AI tool that your school or district has not approved for that purpose:

That last point is important and often missed. The U.S. Department of Education’s vendor FAQ clarifies that FERPA PII includes both direct and indirect identifiers, and even metadata or aggregate information can be considered PII if a reasonable person in the school community could identify the student.

Practitioners on Reddit have flagged some surprising blind spots. In one r/Teachers thread, staff discussed uploading student photos into ChatGPT to make athletic banners, with commenters raising concerns about FERPA and the legal risk of casually encouraging AI photo uploads. The FTC’s COPPA FAQ confirms that personal information includes photographs, video, and audio files containing a child’s image or voice.

A simple rule from K-12 IT communities captures it well: if you would not email it to an unknown outside vendor, do not paste it into an unapproved AI tool.

For more on keeping student PII out of AI workflows, read this FAQ about AI tools and student PII.

Safer Ways Teachers Can Use AI

AI safety and privacy concerns do not mean teachers should avoid AI entirely. They mean teachers should choose the right tasks and the right tools.

The safest everyday use of AI for teachers is creating general instructional materials without entering student-identifying information. These are low-risk because they require only instructional context, not student data:

In each case, the teacher provides topic, grade level, subject, format, and difficulty. No student names. No scores. No IEP details. No photos.

AI privacy starts before you press submit: the safest prompt is one that never includes student-identifying information in the first place.

For tasks like these, teachers can use purpose-built tools designed around that exact workflow. TeachTools, for example, offers 23 tools for worksheets, quizzes, lesson plans, rubrics, and communications, where teachers choose the topic, grade, and format without needing to write complex prompts or enter student PII.

Higher-Risk AI Uses in Schools

Explore 26 free AI tools for teachers

Browse All Tools →

Not all AI use cases carry the same risk. The Future of Privacy Forum’s guide on vetting generative AI tools for schools identifies use cases that are more likely to include student PII: grading papers, analyzing student-score spreadsheets, generating letters of recommendation, and producing IEPs.

Here is a practical risk matrix:

Use Case Risk Level Safer Practice
Generate a generic worksheet by topic and grade Low Use topic, grade, and standard only
Draft a generic lesson plan Low Do not include student names or records
Rewrite a parent email template with no names Low to Medium Replace names and specifics before pasting
Paste student essays for feedback High Use approved tools only; remove identifiers
Analyze a spreadsheet of scores High Use district-approved tools with a DPA
Generate report card comments using names, grades, and behavior High Use approved systems; minimize data; human review
Draft IEP or 504 goals Very High Use only district-approved tools; expert human review
Student-facing chatbot Variable to Very High Require school-approved platform with monitoring and guardrails
Upload student photos, video, or audio High Avoid unless approved, consented, and contract-covered

CDT’s 2025 report found that more than half of licensed special education teachers reported using AI for IEP and 504 plan work, with 39% using AI to write an IEP in full. That is a very high-risk use case involving disability data, legal rights, and consequential decisions. It demands district-approved tools, human expert review, and strict data controls.

In r/Teachers, one thread described educators being told to grade student work with AI, with commenters calling it a “huge privacy concern” and flagging that feeding student data into AI can create FERPA issues unless the tool is approved and safeguarded.

What “No Training on Your Data” Really Means

This is one of the biggest sources of confusion in AI safety and privacy discussions. Many AI vendors now promise they do not train models on customer data. That promise is helpful, but it does not answer every privacy question.

“No training” is a statement about model improvement. It does not automatically tell you:

OpenAI’s platform documentation, for example, states that API data is not used to train or improve models unless the customer explicitly opts in, and default abuse-monitoring logs are retained for up to 30 days. That is useful information. But it still does not replace a school’s FERPA review, DPA, approved use case, and data-minimization rules.

A LinkedIn practitioner made this point directly: “We don’t train on your data” is a promise about model training, not permission to hand over student records. FERPA concerns the disclosure itself, not only whether training occurs.

K-12 system administrators on Reddit reinforce this. In r/k12sysadmin, one commenter summarized the baseline: if teachers use AI tools on individual licenses that the school does not control and may not be able to opt out of training, policy should prohibit uploading student PII. The practical rule: no contract, no student data.

For a deeper look at how one platform handles these questions, you can read the TeachTools privacy policy.

FERPA, COPPA, and AI Privacy

Two federal laws come up most often in school AI safety and privacy conversations.

FERPA (Family Educational Rights and Privacy Act) protects education records and personally identifiable information from those records. It applies to educational agencies and institutions receiving U.S. Department of Education funds. The Department of Education’s FAQ says teachers should check whether an application is approved before classroom use. Services collecting PII under FERPA’s school official exception must be under direct school control, used consistently with annual FERPA notice, and must not redisclose or use education data for unauthorized purposes.

The important thing to understand: FERPA obligations rest on the school, not on the vendor. A vendor can support FERPA compliance, but the school still needs to approve the use case, define control, and ensure data is not misused. “FERPA-compliant AI” is not a certification a vendor can stamp on a product.

COPPA (Children’s Online Privacy Protection Act) covers online collection of personal information from children under 13. The FTC says schools may consent on behalf of parents only when an operator collects personal information for the school’s use and benefit and for no other commercial purpose. If the operator uses children’s information for its own commercial purposes, it needs direct parental consent.

State laws, district policies, PPRA, and IDEA add additional requirements depending on the use case. For more context on COPPA requirements for classroom AI tools, read this COPPA compliance guide. For FERPA-specific guidance, see how to use AI in the classroom without violating FERPA.

One key takeaway: individual teachers should not be the ones making privacy determinations about AI tools. That is the school or district’s responsibility, not a classroom-level decision. If you are wondering whether you can use a tool your school has not approved, the answer is almost always to ask first. This article on whether teachers can use AI without school approval covers that question in detail.

Teacher Checklist for AI Safety and Privacy

Before using any AI tool for school-related work, run through these ten questions:

  1. Is this AI tool approved by my school or district?
  2. Does it have a DPA or written agreement if student data is involved?
  3. Am I entering any student PII, student work, photos, grades, behavior notes, IEP/504 information, or parent contact info?
  4. Can I complete the task with generic details instead?
  5. Does the tool use prompts, files, outputs, metadata, or feedback for model training?
  6. How long does the tool retain data?
  7. Who can access the data (support staff, subprocessors, model providers)?
  8. Are outputs reviewed by a human before students or parents see them?
  9. Could the AI output affect a grade, placement, accommodation, discipline decision, or student record?
  10. If a parent asked what data was shared, could the school answer clearly?

If you answer “no” or “I don’t know” to questions 1, 2, or 10, stop and check with your administration or IT department before proceeding.

Practitioners on LinkedIn have argued that schools need AI-specific compliance audits, not just generic edtech reviews. The audit should inventory AI tools, map data touchpoints, identify users, and determine what data is entered, tracked, stored, encrypted, or shared with third parties.

Common Mistakes That Undermine AI Safety and Privacy

Even well-intentioned teachers make these errors:

1. Using a personal AI account for student data. A district-managed account with approved terms is not the same as a personal free account. In r/k12sysadmin, practitioners describe schools blocking AI tools after staff put FERPA-protected data into personal AI accounts. The account type matters.

2. Assuming “no training” means “approved for FERPA data.” As covered above, “no training” is one piece of the privacy picture, not the whole thing.

3. Removing names but leaving indirect identifiers. Deleting a student’s name may not be enough if the prompt includes date of birth, unusual disability details, a rare incident, school, grade, teacher name, or a combination of facts that could identify the student.

4. Uploading photos or audio without recognizing them as personal information. Many privacy checklists focus on names and grades but miss media files entirely.

5. Using AI to grade or recommend accommodations without human review. CDT found that only 14% of teachers said their AI training covered what to do when a tool outputs incorrect or biased results. AI can hallucinate feedback, misinterpret student work, or recommend inappropriate interventions.

6. Forgetting that AI-generated outputs can become student records. If an AI tool generates a score, recommendation, IEP narrative, or behavioral inference that is maintained by the school, it may become part of the student’s education record and raise record-access and correction issues.

7. Treating a privacy policy as a DPA. A privacy policy describes what a vendor does. A DPA is a binding agreement about what a vendor will and will not do with specific data. They are not interchangeable.

8. Letting students use general-purpose AI chatbots without age, content, and privacy review. Adult consumer AI tools may have different age restrictions, safeguards, terms, and data practices than tools built for K-12.

FAQs

What is AI safety and privacy?

AI safety and privacy means designing and using artificial intelligence so it does not harm people, expose sensitive data, or make important decisions without proper oversight. In schools, AI safety focuses on age-appropriate, accurate, bias-aware, and human-reviewed outputs. AI privacy focuses on how student data is collected, used, stored, shared, deleted, and protected.

What is the difference between AI safety and AI privacy?

AI safety addresses whether the AI’s behavior or output could harm students, through inaccurate content, biased recommendations, inappropriate material, or overreliance. AI privacy addresses what happens to data entered into or created by the AI, including whether it is stored, shared, retained, or used for purposes the school did not authorize.

Can teachers use AI without violating FERPA?

Yes, but it depends on the use case and the tool. Using AI to generate a generic lesson plan on a topic requires no student data and carries minimal FERPA risk. Using AI to grade student work, analyze score spreadsheets, or draft IEP language involves education records and requires a district-approved tool with a DPA and proper oversight.

Does “no training on your data” mean an AI tool is safe for student information?

Not automatically. “No training” means the vendor will not use your inputs to improve its models. It does not answer who stores your data, for how long, which subprocessors receive it, or whether the school has approved the disclosure. Schools still need a DPA, an approved use case, and data-minimization rules.

Are student photos considered protected data?

Yes. Under COPPA, personal information includes photographs, video, and audio files containing a child’s image or voice. Under FERPA, photos linked to student records are protected. Teachers should not upload student images to unapproved AI tools.

What is a DPA for AI tools?

A data privacy agreement (DPA) is a binding contract between a school or district and a vendor that specifies what data the vendor can access, how it will be used, how long it is retained, who can see it, how it is deleted, and what happens in a breach. It is more specific and enforceable than a general privacy policy.

Is AI grading safe?

AI grading carries significant safety and privacy risks. It typically requires student work (which may be an education record), involves evaluative decisions that affect students, and depends on AI accuracy. Only 14% of teachers have received training on what to do when AI outputs incorrect or biased results. If a school uses AI for grading, it should be through an approved tool with human review of every result.

What is the safest way for teachers to use AI?

The safest approach is creating general instructional materials (worksheets, quizzes, lesson plans, rubrics, parent communications) using only instructional context like topic, grade level, and format. No student names, scores, or identifying details. Use only tools your school has approved for the intended purpose.


AI safety and privacy in schools is not about avoiding AI. It is about using it in ways that protect students from both harmful outputs and harmful data practices. The safest starting point is the simplest one: give AI only the instructional context it needs, keep student-identifying information out of unapproved tools, and make sure a human is always responsible for the decisions that matter.

Create worksheets, quizzes, lesson plans, rubrics, and classroom communications without entering student data. Explore TeachTools plans to get started.

Free Tool

Explore 26 free AI tools for teachers

Worksheets, quizzes, lesson plans, rubrics — all free, all private, all built for educators.

Browse All Tools →

Try TeachTools Free

Create worksheets, quizzes, and lesson plans in seconds with AI.

Explore All Tools →

Tools Mentioned in This Article

📝
AI Worksheet Generator
Create differentiated worksheets for any subject and grade level in seconds.
Try it free →
✅
AI Quiz Generator
Build formative assessments with multiple question types — auto-graded and printable.
Try it free →
🧰
All 26 Free AI Tools
Explore every generator — worksheets, quizzes, lesson plans, rubrics, and more.
Try it free →

More from the TeachTools Blog

View all articles →

✨
Try TeachTools Free
Browse Tools →