Avatar

Aldo Pacchiano

Postdoctoral Researcher

Microsoft Research

I am a Postdoctoral Researcher at Microsoft Research NYC. I obtained my PhD at UC Berkeley where I was advised by Peter Bartlett and Michael Jordan. My research lies in the areas of Reinforcement Learning, Online Learning, Bandits and Fairness. I am parituclarly interested in porting theoretical insights and techniques to design useful algorithms in (among other things) Deep RL, and experimental design.

Interests

  • Online Learning
  • Reinforcement Learning
  • Deep Reinforcement Learning
  • Fairness

Education

  • PhD in Computer Science, 2021

    University of California Berkeley

  • MEng in Computer Science, 2014

    Massachusetts Institute of Technology

  • Masters of Advance Study in Pure Mathematics, 2013

    Cambridge University

  • Bachelors of Science in Computer Science and Theoretical Mathematics, 2012

    Massachusetts Institute of Technology

Recent Posts

Beyond the Standard Assumptions in Reinforcement Learning

In Reinforcement Learning it is standard to assume the reward to be an additive function of per state feedback. In this work we …

Model Selection for Contextual Bandits and Reinforcement Learning

In the problem of model selection the objective is to design ways to select in online fashion the best suitable algorithm to solve a …

Publications

Meta Learning MDPs with Linear Transition Models

AISTATS 2022; also presented in the Workshop on Reinforcement Learning Theory, ICML 2021.

On the Theory of Reinforcement Learning with Once-per-Episode Feedback

NeurIPS 2021; also presented as an oral talk in the Workshop on Reinforcement Learning Theory, ICML 2021.