Clinical Records De-Identification: Performances and Limits of Rule-based and Machine-Learning based Approaches
type: Dataset
description: This work focuses on the automatic de-identification of clinical records. The de-identification consists in concealing personal information within documents while preserving clinical data. This task is mandatory so as to use clinical records outside of the patient care process, for case study publications or in scientific research (producing automatic system to process the documents, similar cases search, etc.). We defined 12 categories of information to de-identify: nominative data (last names, first names, etc.) and numerical data (ages, dates, zip codes, etc.). Two approaches have been used to de-identify the documents, an expert knowledge based method using regular expressions and lexical mapping, and a machine-learning process based upon CRF. Several experiments have been performed including the use of each approach separately or in combination. We achieved our best results (overall F-measure=0.922) while combining both approaches and merging last names and first names categories into a single one (recall=0.953 and F-measure=0.931 on this category). This work is combined with the production of several resources: a guidelines, a gold standard corpus composed of 562 documents among them 100 double annotated with adjudication and interannotator agreement computation (K=0.807 before merging) and a de-identified corpus of 17,000 clinical records.
landing page: https://theses.hal.science/tel-00848672
keyword: anonymisation
keyword: apprentissage-statistique
keyword: clinical-records
keyword: comptes-rendus-medicaux
keyword: de-identification
keyword: guide-dannotation
keyword: guidelines
keyword: infoeu-reposemanticsdoctoralthesis
keyword: infoinfo-bicomputer-science-csbioinformatics-q-bioqm
keyword: machine-learning-based-approach
keyword: methodes-symboliques
keyword: natural-language-processing
keyword: rule-based-methods
keyword: sdvbibslife-sciences-q-bioquantitative-methods-q-bioqm
keyword: theses
keyword: traitement-automatique-des-langues
issued: 2026-05-10T05:13:07.303860
modified: 2026-05-10T05:13:07.303866
language: fr
contact point: Organization
  fn: CCSD

test_moissonnage_selune
type: Agent

Clinical Records De-Identification: Performances and Limits of Rule-based and Machine-Learning based Approaches
type: Distribution
format: HTML
access URL: https://theses.hal.science/tel-00848672
issued: 2026-05-10T05:13:07.312094
modified: 2026-05-10T05:13:07.283096