← All work View live feature ↗

Mentafy · Advanced Reporting System

Advanced Authorship Report

Designing a paragraph-level writing-pattern analysis experience for academic institutions.

The Advanced Authorship Report, also called the In-Document View, gives educators a forensic-level breakdown of how a document was written, revised, and sourced. It was designed as the investigative layer behind Mentafy's standard Authorship Report.

View live feature ↗
Research Essay · Draft
Human Written Copy & Paste AI Generated AI Revised Paraphrasing

The proliferation of artificial intelligence in academic settings has prompted considerable debate among educators and policy makers.

Large language models have transformed the landscape of written communication, enabling rapid generation of coherent, contextually relevant text across disciplines.

Our analysis focuses on keystroke-level behavioural signatures that distinguish human-authored content from AI-generated passages.

Findings · sorted by severity

Copy & Paste DetectedPara 2, Line 1Unclassified
AI RevisedPara 2, Line 2Flagged
ParaphrasingPara 3, Line 2Review
Company
Mentafy GmbH
Early-stage startup
Role
Product Designer
Feature Design · Data Viz
Timeline
Feb 2024 – Jun 2025
Within the 16-month engagement
Team
CEO, CTO, Engineers
No product manager

Challenge

Beyond the summary report

The standard Authorship Report gave educators a high-level authenticity score, but when that score raised concerns, there was nowhere to go. The investigation had to happen outside the platform, manually, with no structured context.

The challenge was not adding more data, but building a forensic experience that educators could trust and that students couldn't easily dispute.

standard authorship report
Standard Mentafy authorship report showing a high-level summary with word count, sources classification, and writing timeline

Designing for complexity

Five writing categories, one readable view

The In-Document View needed to surface five distinct writing-behaviour classifications at the paragraph and sentence level, without overwhelming the reviewer. The visual language had to be immediately readable even without a legend, and the colour system unambiguous across different user contexts.

Immediate review requiredConsider a closer lookNo action needed
High Risk
Medium Risk
Low Risk

A three-tier risk scale sits above the five behaviour categories, so a reviewer reads urgency before detail, and never needs the legend to know where to look first.

Process & exploration

How the design developed

01

Information Mapping

Audited all writing-behaviour signals and grouped them by meaning, separating what was algorithmically detected from what needed human interpretation.

02

Hierarchy Definition

Established three reading layers: document-level score, ranked findings panel, and inline paragraph-level annotation. Each layer answers a different question.

03

Layout Exploration

Prototyped how the findings panel and document view could coexist (side panel vs. overlay vs. inline), testing legibility across document lengths.

04

Report Structuring

Finalised the severity-first reading flow, session-grouping logic, and the contextual explanation pattern when a reviewer clicks a highlighted passage.

Final design experience

The delivered In-Document View

Feature 01

Unusual text & classification metrics

Two numbers orient the reviewer before they read a single paragraph. Unusual % shows how much of the document does not appear naturally human-written; Unclassified % shows what portion of that lacks any documentation or citation.

Together they guide whether deeper investigation is warranted. For 80–90% of students, it isn't.

Document Name
12/12/2024 – 02/04/2025
48%
Unusual
20%
Unclassified
Content Distribution
Human WrittenUnusualUnclassified
RecommendationFurther Review Required

Feature 02

Severity-ranked findings panel

The Findings Panel lists every flagged section ranked by severity, so reviewers see the most critical cases first. Each finding shows its writing-behaviour type, document location, and source-classification status.

Clicking a finding takes the reviewer directly to the highlighted passage in context, with a detailed explanation of when and how it was written.

Findings: 7 totalSeverity ▾
226 Words · Copy & Paste DetectedPara 2, Line 1Approve
82 Words · Paraphrasing DetectedPara 4, Line 3Approve
140 Words · AI RevisedPara 6, Line 1Approve

Feature 03

Writing session analysis

Writing data is grouped into sessions, starting when the author opens their document and ending when they close it or take a long break. Each session records word count and duration.

Sudden large text insertions in a single session are a strong signal of misconduct; gradually developed sessions suggest a natural writing process. This view makes document evolution legible.

482 Words · Copy & Paste DetectedPara 10, Line 1
Mar 7 · 1 minAuthor: Demo UserNo citation found

This finding is a high-signal data point: 482 words in a single minute of session duration.

Feature 04

Layered plagiarism check

When the writing-process analysis flags suspicious patterns, a second layer cross-checks the flagged content against web and publisher databases. The source is identified and linked directly inside the report, so the reviewer has both the behavioural evidence and the origin in one view.

This distinction matters: writing-pattern analysis comes first; database matching follows only when needed.

182 Words · Copy & Paste DetectedPara 10, Line 1
Mar 2 · 1 minAuthor: Demo UserNo citation found
Source Identified
Stanford HAI, 2023 AI Index Report, Chapter 4
Copy & Paste Confirmed

Design principles

What guided the work

01

Severity before chronology

02

Behaviour first, database second

03

Forensic clarity for non-technical users

04

Progressive disclosure at entry level

05

Evidence students can't easily update

Outcome

Impact of the redesign

The Advanced Authorship Report established the investigative layer that the standard report had always implied but never delivered: a structured, evidence-based tool for handling integrity cases that respects both the reviewer's time and the student's right to context.

Investigative coverage

Paragraph-level

Reviewers can now pinpoint exactly which sentences triggered a finding, and why.

False-positive protection

Behaviour + source

Two independent layers reduce unfair flags: writing patterns and database matching.

Reviewer efficiency

Severity-first flow

Critical findings surface immediately, without a full document read-through.

Scope

~10–20% of cases

Intentionally selective: most students never require this depth of investigation.

Reflection

The challenge was not visual styling. It was helping users trust the data.

Every decision, from the severity ranking to the session view to the two-layer analysis, had to serve a specific kind of user judgment. A feature used to investigate potential misconduct has to be both powerful and precise. Designing for that stakes level requires a different kind of restraint.