Weizmann Logo
Electronic Colloquium on Computational Complexity

Under the auspices of the Computational Complexity Foundation (CCF)

Login | Register | Classic Style



TR00-071 | 14th July 2000 00:00

On-line Learning with Malicious Noise and the Closure Algorithm


Authors: Peter Auer, Nicolo Cesa-Bianchi
Publication: 12th September 2000 20:20
Downloads: 1226


We investigate a variant of the on-line learning model for classes
of {0,1}-valued functions (concepts) in which the labels of a certain
amount of the input instances are corrupted by adversarial noise.
We propose an extension of a general learning strategy, known as
"Closure Algorithm", to this noise model, and show a worst-case
mistake bound for learning an arbitrary intersection-closed concept
class. For several concept classes our extended Closure Algorithm is
efficient and can tolerate a noise rate up to the information-theoretic
upper bound. Finally, we show how to efficiently turn any algorithm
for the on-line noise model into a learning algorithm for the PAC model
with malicious noise.

ISSN 1433-8092 | Imprint