1. Compilatio Magister+ analysis: several indicators make up the percentage of suspicious texts
Thanks to Compilatio Magister+ teachers can detect suspicious texts in student documents. Compilatio Magister+ highlights various percentages following the analysis of a document:
- an overall percentage of suspicious texts
-
the composition of suspicious texts according to the type of detection :
- a score of similarities
- a score of unrecognized languages
- a score of texts potentially generated by AI
2. Focus on the percentage of texts potentially generated by AI
In this article, we look at the score of potentially AI-generated content.
The score of texts potentially generated by AI is a percentage between 0 and 100%, indicating the probability that a text has been generated by a generative AI tool such as ChatGPT, Gemini, YouChat, etc. This percentage corresponds to the proportion of text in the document whose style is similar to a text generated by a AI tool.
For example, for a document of 1000 words and a percentage of texts potentially generated by AI of 10%, this means that 100 words have a style similar to those present in a text that would be generated by an AI. It is then up to the user-teacher to distinguish whether these passages belong to plagiarism or not. Compilatio Magister+ software is a decision-making tool: it does not replace the grader's ability to assess students' skills, nor does it judge the quality of an assignment or whether it meets the school's expectations, for example...
👉 Discover now Compilatio AI Checker.
3. How does the Compilatio AI detector work?
Our detector of potentially AI-generated content is itself based on artificial intelligence, having been trained to recognize the writing styles of text-generating AI tools. Using a Large Language Model (LLM), it is able to capture the context, tone and cultural aspects of language, and then spot subtleties in texts.
This technology and the training of the Compilatio AI content detection module enable us to highlight texts with a style similar to that which a robot might generate in the document analyzed by Compilatio Magister+ .
4. Why does Compilatio indicate "texts potentially generated by AI"?
In the Compilatio Magister+ interface and results reports, the indicator mentioned is a percentage of "texts potentially AI-generated" and not percentages of "AI-generated text". This precaution in the analysis is essential for the following reasons.
- Compilatio Magister+'s analyses do not provide an objective proof of the use of text generative AI in a document. If for similarity detection the Compiatio Magister+ emphasizes the proof of resemblance thanks to the face-to-face view, the software cannot provide such visual evidence for the detection of AI-generated passages.
To find out more, read the article "Does the Compilatio AI detector provide objective proof of the use of text generative AI in a document?" - No AI text detection software can claim 100% reliability.
To find out more, read the article "How reliable is the Compilatio AI detector?"
5. What to do when the percentage of potentially AI-generated texts is high
When the analysis highlights a high score for potentially AI-generated content, it is important to :
- do not punish / formulate accusation before confrontation with the student ;
- see more details about the passages concerned. You'll find all the information you need on the "Points of interest" page;
-
question and position oneself on what is acceptable or not, with regard to the rules of the establishment, the instructions given, your expectations... ;
Source :ChatGPT, Chatbots and Artificial Intelligence in Education, Ditch that textbook
- keep in mind the instructions given to students in advance of the assignment (perhaps the use of AI was authorized/requested for this assignment);
- see if the student has mentioned use of generative AI and understand why;
- confront the student, push the evaluation of its real knowledge for example. The presence of AI-generated texts in a student's work does not mean that the student does not have the targeted skills and is not capable of developing his or her subject/field of study;
- raise awareness on an ongoing basis to the proper use of generative AI to help students with their essays, teach them good practices to guarantee academic integrity.
To find out more :
- Compilatio's technical know-how for identifying artificial text. Compilatio AI Detector: what is it?How does it work? Is it reliable? Which results? Why choose Compilatio? Who's Compilatio for?
- Compilatio Magister+ offer presentation which can detect texts potentially generated by AI.
- The Compilatio GPT "Educator's inquiry assistant". When a student's work contains passages identified by Compilatio Magister+ as "copied" or "potentially generated by AI", doubts arise as to the student's mastery of these notions. In this case, Compilatio provides a GPT that automatically generates a verification protocol: an AI trained to propose a list of questions to ask the student to confirm his or her mastery of the subject relative to the suspicious text areas. ChatGPTPLUS required for access: https://compilatio.link/gpt-inquiry-assistant
📌 Questions about Magister, Magister+, plagiarism or AI?
Get answers live during our "Q&A Webinar".
👉 Register for the next session
This article has been automatically translated. If you notice a translation error, please contact us.