Top-level heading

A smoothed-Bayesian approach to frequency recovery from sketched data

Data e ora inizio evento
Data e ora fine evento
Sede

Dipartimento di Matematica, Tor Vergata

Aula esterna
Aula Dal Passo
Speaker ed affiliazione
Stefano Favaro
We introduce a novel statistical perspective on a classical problem at the intersection of computer science and information theory: recovering the empirical frequency of a symbol in a large discrete dataset using only a compressed representation, or sketch, obtained via random hashing. Departing from traditional algorithmic approaches, recent works have proposed Bayesian nonparametric (BNP) methods that can provide more informative frequency estimates by leveraging modeling assumptions on the distribution of the sketched data. In this paper, we propose a smoothed-Bayesian method, inspired by existing BNP approaches but designed in a frequentist framework to overcome the computational limitations of the BNP approaches when dealing with large-scale data from realistic distributions, including those with power-law tail behaviors. For sketches obtained with a single hash function, our approach is supported by frequentist guarantees, including unbiasedness and optimality under a squared error loss function within a class of linear estimators. For sketches with multiple hash functions, we introduce an approach based on multi-view learning to construct computationally efficient frequency estimators. We validate our method on synthetic and real data, comparing its performance to that of existing alternatives. Joint work with Mario Beraha (Politecnico di Milano) and Matteo Sesia (University of Southern California)
Contatti/Organizzatori
salvi@mat.uniroma2.it