Publications

Online Experimentation under Privacy Induced Identity Fragmentation

Privacy Regulation and Protection in Machine Learning Workshop at ICLR (PML)

Publication date: May 11, 2024

Shiv Shankar, Ritwik Sinha, Madalina Fiterau

Randomized online experimentation is a key cornerstone for evaluating decisions for online businesses. The methodology used for estimating policy effects in online experimentation is critically dependent on user identifiers. However, nowadays consumers routinely interact with online businesses across multiple devices which are recorded with different identifiers to maintain privacy. The inability to match different device identities across consumers leads to an incorrect estimation of various causal effects. Moreover, without strong assumptions about the device-user graph, the causal effects are not identifiable. In this paper, we consider the task of estimating global treatment effects (GATE) from a fragmented view of exposures and outcomes. Experiments show that estimators obtained through our procedure are superior to standard estimators, with a lower bias and increased robustness.

Learn More