Clinical Records De-Identification: Performances and Limits of Rule-based and Machine-Learning based Approaches

This work focuses on the automatic de-identification of clinical records. The de-identification consists in concealing personal information within documents while preserving clinical data. This task is mandatory so as to use clinical records outside of the patient care process, for case study publications or in scientific research (producing automatic system to process the documents, similar cases search, etc.). We defined 12 categories of information to de-identify: nominative data (last names, first names, etc.) and numerical data (ages, dates, zip codes, etc.). Two approaches have been used to de-identify the documents, an expert knowledge based method using regular expressions and lexical mapping, and a machine-learning process based upon CRF. Several experiments have been performed including the use of each approach separately or in combination. We achieved our best results (overall F-measure=0.922) while combining both approaches and merging last names and first names categories into a single one (recall=0.953 and F-measure=0.931 on this category). This work is combined with the production of several resources: a guidelines, a gold standard corpus composed of 562 documents among them 100 double annotated with adjudication and interannotator agreement computation (K=0.807 before merging) and a de-identified corpus of 17,000 clinical records.

Data and Resources

Additional Info

Field Value
Source https://theses.hal.science/tel-00848672
Author Grouin, Cyril
Maintainer CCSD
Last Updated May 10, 2026, 05:13 (UTC)
Created May 10, 2026, 05:13 (UTC)
Identifier tel-00848672
Language fr
Rights https://about.hal.science/hal-authorisation-v1/
contributor Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur (LIMSI) ; Université Paris-Sud - Paris 11 (UP11)-Sorbonne Université - UFR d'Ingénierie (UFR 919) ; Sorbonne Université (SU)-Sorbonne Université (SU)-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-Université Paris Saclay (COmUE)
creator Grouin, Cyril
date 2013-06-26T00:00:00
harvest_object_id 97973998-61a1-4a10-abc9-7c16387acfcc
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2025-08-12T00:00:00
set_spec type:THESE