JPH :)

Jack Parker-Holder jack.parker-holder@spc.ox.ac.uk | |


About
I am a second year DPhil student at St Peter's College, Oxford, where I am part of the Machine Learning Research Group, advised by Stephen Roberts.

I am interested in ways to make RL algorithms work "out of the box" by adapting their behavior on-the-fly. This can be through learning hyperparameters, exploration strategies, or even update rules. I am also focusing on ways to train agents which can generalize beyond a single simulated environment, which is crucial if they will ever be useful in real-world settings such as robotics or electronic trading.

Before coming to Oxford I was a VP in the Quantitative Research team at JPM in New York. While in America I studied for a Master's part-time at Columbia where I discovered the joys of machine learning research! I am originally from the UK, and studied Maths at Exeter.

I am immensely privileged to have worked with some fantastic people, in alphabetical order: Philip Ball, Krzysztof Choromanski, Aldo Pacchiano and Yunhao Tang.

News
  • [9/2020] Three papers accepted to NeurIPS 2020. Thank you to my amazing collaborators!!

  • [6/2020] Population-Based Bandit Optimization will be presented as a Contributed Talk at the ICML AutoML workshop.

  • [6/2020] Three papers accepted to the main conference at ICML 2020.

  • [2/2020] New work on model-based RL, Ready Policy One, was covered by VentureBeat (here).

Conference Papers
Effective Diversity in Population-Based Reinforcement Learning
Jack Parker-Holder*, Aldo Pacchiano*, Krzysztof Choromanski, Stephen Roberts
Advances in Neural Information Processing Systems (NeurIPS), 2020 (Spotlight)
The Fourth Lifelong Machine Learning Workshop at ICML, 2020
(ArXiv)


Provably Efficient Online Hyperparameter Optimization with Population-Based Bandits
Jack Parker-Holder, Vu Nguyen, Stephen Roberts
Advances in Neural Information Processing Systems (NeurIPS), 2020
The 7th ICML Workshop on Automated Machine Learning (AutoML), 2020 (Contributed Talk)
(Paper) (Code)


Ridge Riding: Finding diverse solutions by following eigenvectors of the Hessian
Jack Parker-Holder*, Cinjon Resnick, Luke Metz, Hengyuan Hu, Adam Lerer, Alistair HP Letcher, Alex Peysakhovich, Aldo Pacchiano, Jakob Foerster*
Advances in Neural Information Processing Systems (NeurIPS), 2020
Beyond First Order Methods in ML Systems, ICML, 2020 (Spotlight)


Ready Policy One: World Building Through Active Learning
Philip Ball*, Jack Parker-Holder*, Aldo Pacchiano, Krzysztof Choromanski, Stephen Roberts
to appear in The International Conference on Machine Learning (ICML), 2020
(ArXiv) (Media) (Code)


Learning to Score Behaviors for Guided Policy Optimization
Aldo Pacchiano*, Jack Parker-Holder*, Yunhao Tang*, Anna Choromanska, Krzysztof Choromanski, Michael I. Jordan
to appear in The International Conference on Machine Learning (ICML), 2020
(ArXiv) (Code)


Stochastic Flows and Geometric Optimization on the Orthogonal Group
Krzysztof Choromanski*, David Cheikhi*, Jared Davis*, Valerii Likhosherstov*, Achille Nazaret*, Achraf Bahamou*, Xingyou Song*, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamas Sarlos, Adrian Weller, Vikas Sindhwani
to appear in The International Conference on Machine Learning (ICML), 2020
(ArXiv)



Practical Nonisotropic Monte Carlo Sampling in High Dimensions via Determinantal Point Processes

Krzysztof Choromanski*, Aldo Pacchiano*, Jack Parker-Holder*, Yunhao Tang*
to appear in Artificial Intelligence and Statistics (AISTATS), 2020
(ArXiv)


From Complexity to Simplicity: Adaptive ES-Active Subspaces for Blackbox Optimization
Krzysztof Choromanski*, Aldo Pacchiano*, Jack Parker-Holder*, Yunhao Tang*, Vikas Sindhwani
Advances in Neural Information Processing Systems (NeurIPS), 2019
(ArXiv) (Code)


Provably Robust Blackbox Optimization for Reinforcement Learning
Krzysztof Choromanski*, Aldo Pacchiano*, Jack Parker-Holder*, Yunhao Tang, Deepali Jain, Yuxiang Yang, Atil Iscen, Jasmine Hsu, Vikas Sindhwani
The Conference on Robot Learning (CoRL), 2019, Spotlight
(ArXiv)



Workshop Papers
UNCLEAR: A Straightforward Method for Continual Reinforcement Learning
Samuel Kessler, Jack Parker-Holder, Philip Ball, Stefan Zohren, Stephen Roberts
Workshop on Continual Learning, ICML, 2020
(Paper)


Taming the Herd: Multi-Modal Meta-Learning with a Population of Agents
Robert Müller, Jack Parker-Holder, Aldo Pacchiano
The Fourth Lifelong Machine Learning Workshop at ICML, 2020
(Paper)


Reinforcement Learning with Chromatic Networks for Compact Architecture Search
Xingyou Song, Krzysztof Choromanski, Jack Parker-Holder, Yunhao Tang, Wenbo Gao, Aldo Pacchiano, Tamas Sarlos, Deepali Jain, Yuxiang Yang
The ICLR Workshop on Neural Architecture Search, 2020
(ArXiv)



Preprints
On Optimism in Model-Based Reinforcement Learning
Aldo Pacchiano*, Philip Ball*, Jack Parker-Holder*, Krzysztof Choromanski, Stephen Roberts
(ArXiv)



Employment
Aspect Capital - Intern, Machine Learning Research - (2020)


JPMorgan Chase - Vice President, Quantitative Research - (2012-2019)



Education
University of Oxford - DPhil Machine Learning - (2019-)


Columbia University - MA QMSS - (2016-2018)


University of Exeter - BSc Mathematics - (2009-2012)