content/chapters/06_implication.md

# 6. Implication — what comes after the first effect

This chapter is about what happens *later* with this system, after the first round of effects. It is the part that is easy to forget when you first read the case.

When you first think about this system, the easy thing to picture is the immediate effects. Some students get flagged, some get contacted, some find it helpful, some find it intrusive. The natural move is to judge the system from that first picture, in the first weeks after deployment.

But the most important effects of a system like this often start later, after students learn the system exists and start adjusting to it.

Once students know that login times, submission timing, and forum activity are being watched as signs of mental state, behaviour drifts. Students who want to look fine learn to look fine. They log in regularly, submit on time, post upbeat updates. Students who are genuinely struggling but do not want to be flagged learn to hide better, to keep their patterns inside the "normal" range even while their actual situation gets worse. Now look at what has happened to the system. The data it sees is no longer behaviour produced naturally. It is behaviour shaped by the knowledge that the system exists. After a few cycles, the system is not detecting students in trouble. It is detecting students who failed to learn the new presentation rules.

There is a second later effect that is even easier to miss. Deploying this system establishes that "using AI to look at students' digital activity to act on them for their own good" is the kind of thing universities do. In five or ten years, when someone proposes using AI to detect academic dishonesty or identify students at risk of dropping out, the new proposal will not start from scratch. It will start from "we already do this for mental health, how is this different?" Today's deployment quietly spends the political ground for opposing future systems. A stronger argument follows the system past its first month.