A Second-order Bound with Excess Losses

We study online aggregation of the predictions of experts, and first show new second-order regret bounds in the standard setting, which are obtained via a version of the Prod algorithm (and also a version of the polynomially weighted average algorithm) with multiple learning rates. These bounds are in terms of excess losses, the differences between the instantaneous losses suffered by the algorithm and the ones of a given expert. We then demonstrate the interest of these bounds in the context of experts that report their confidences as a number in the interval [0,1] using a generic reduction to the standard setting. We conclude by two other applications in the standard setting, which improve the known bounds in case of small excess losses and show a bounded regret against i.i.d. sequences of losses.

Data and Resources

Additional Info

Field Value
Source https://hal.science/hal-00943665
Author Gaillard, Pierre, Stoltz, Gilles, van Erven, Tim
Maintainer CCSD
Last Updated May 7, 2026, 01:55 (UTC)
Created May 7, 2026, 01:55 (UTC)
Identifier hal-00943665
Language en
Rights https://about.hal.science/hal-authorisation-v1/
contributor Groupement de Recherche et d'Etudes en Gestion à HEC (GREGH) ; Ecole des Hautes Etudes Commerciales (HEC Paris)-Centre National de la Recherche Scientifique (CNRS)
creator Gaillard, Pierre
date 2014-02-08T00:00:00
harvest_object_id a2738241-2039-4afd-868a-11922eb0986a
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2025-12-18T00:00:00
relation info:eu-repo/semantics/altIdentifier/arxiv/1402.2044
set_spec type:UNDEFINED