Nearest neighbor classification in infinite dimension
type: Dataset
description: Let $X$ be a random element in a metric space $(\calF,d)$, and let $Y$ be a random variable with value $0$ or $1$. $Y$ is called the class, or the label, of $X$. Assume $n$ i.i.d. copies $(X_i,Y_i)_1\leqi\leqn$. The problem of classification is to predict the label of a new random element $X$. The $k$-nearest neighbor classifier consists in the simple following rule : look at the $k$ nearest neighbors of $X$ and choose $0$ or $1$ for its label according to the majority vote. If $(\calF,d)=(R^d,||.||)$, Stone has proved in 1977 the universal consistency of this classifier : its probability of error converges to the Bayes error, whatever the distribution of $(X,Y)$. We show in this paper that this result is no more valid in general metric spaces. However, if $(\calF,d)$ is separable and if a regularity condition is assumed, then the $k$-nearest neighbor classifier is weakly consistent.
landing page: https://inria.hal.science/inria-00070470
identifier: Report N°: RR-5536
keyword: classification
keyword: consistency
keyword: infoeu-reposemanticsreport
keyword: infoinfo-ohcomputer-science-csother-csoh
keyword: non-parametric-statistics
keyword: reports
issued: 2026-05-16T01:34:52.625688
modified: 2026-05-16T01:34:52.625699
language: en
contact point: Organization
  fn: CCSD

test_moissonnage_selune
type: Agent

Nearest neighbor classification in infinite dimension
type: Distribution
format: HTML
access URL: https://inria.hal.science/inria-00070470
issued: 2026-05-16T01:34:52.653597
modified: 2026-05-16T01:34:52.556374