Fast rates in learning with dependent observations

In this paper we tackle the problem of fast rates in time series forecasting from a statistical learning perspective. In a serie of papers (e.g. Meir 2000, Modha and Masry 1998, Alquier and Wintenberger 2012) it is shown that the main tools used in learning theory with iid observations can be extended to the prediction of time series. The main message of these papers is that, given a family of predictors, we are able to build a new predictor that predicts the series as well as the best predictor in the family, up to a remainder of order $1/\sqrt{n}$. It is known that this rate cannot be improved in general. In this paper, we show that in the particular case of the least square loss, and under a strong assumption on the time series (phi-mixing) the remainder is actually of order $1/n$. Thus, the optimal rate for iid variables, see e.g. Tsybakov 2003, and individual sequences, see \cite{lugosi} is, for the first time, achieved for uniformly mixing processes. We also show that our method is optimal for aggregating sparse linear combinations of predictors.

Data and Resources

Additional Info

Field Value
Source https://hal.science/hal-00671979
Author Alquier, Pierre, Wintenberger, Olivier
Maintainer CCSD
Last Updated May 27, 2026, 21:39 (UTC)
Created May 27, 2026, 21:39 (UTC)
Identifier hal-00671979
Language en
Rights https://about.hal.science/hal-authorisation-v1/
contributor Laboratoire de Probabilités et Modèles Aléatoires (LPMA) ; Université Pierre et Marie Curie - Paris 6 (UPMC)-Université Paris Diderot - Paris 7 (UPD7)-Centre National de la Recherche Scientifique (CNRS)
creator Alquier, Pierre
date 2012-02-12T00:00:00
harvest_object_id 307c919a-e404-46e2-831f-75e0ea33bcc2
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2026-01-21T00:00:00
relation info:eu-repo/semantics/altIdentifier/arxiv/1202.4283
set_spec type:UNDEFINED