State-of-Art-Reviewing: A Radical Proposal to Improve Scientific Publication

Channel:
Switzerland Yannic Kilcher
Subscribers:
287,000
Published on ● Video Link: https://www.youtube.com/watch?v=lqtlua-Ylts


Category:
Review
Duration: 12:41
3,037 views
86

Peer Review is outdated and ineffective. SOAR is a new and revolutionary way to distribute scientific reviewing and scale to the new age of faster, better and more significant research.

https://arxiv.org/abs/2003.14415

Abstract:
Peer review forms the backbone of modern scientific manuscript evaluation. But after two hundred and eighty-nine years of egalitarian service to the scientific community, does this protocol remain fit for purpose in 2020? In this work, we answer this question in the negative (strong reject, high confidence) and propose instead State-Of-the-Art Review (SOAR), a neoteric reviewing pipeline that serves as a 'plug-and-play' replacement for peer review. At the heart of our approach is an interpretation of the review process as a multi-objective, massively distributed and extremely-high-latency optimisation, which we scalarise and solve efficiently for PAC and CMT-optimal solutions. We make the following contributions: (1) We propose a highly scalable, fully automatic methodology for review, drawing inspiration from best-practices from premier computer vision and machine learning conferences; (2) We explore several instantiations of our approach and demonstrate that SOAR can be used to both review prints and pre-review pre-prints; (3) We wander listlessly in vain search of catharsis from our latest rounds of savage CVPR rejections.

Authors: Samuel Albanie, Jaime Thewmore, Robert McCraith, Joao F. Henriques

Links:
YouTube: https://www.youtube.com/c/yannickilcher
Twitter: https://twitter.com/ykilcher
BitChute: https://www.bitchute.com/channel/yannic-kilcher
Minds: https://www.minds.com/ykilcher



Other Videos By Yannic Kilcher


2020-04-13The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
2020-04-12Dynamical Distance Learning for Semi-Supervised and Unsupervised Skill Discovery
2020-04-11CURL: Contrastive Unsupervised Representations for Reinforcement Learning
2020-04-10Enhanced POET: Open-Ended RL through Unbounded Invention of Learning Challenges and their Solutions
2020-04-09Evolving Normalization-Activation Layers
2020-04-08[Drama] Who invented Contrast Sets?
2020-04-07Evaluating NLP Models via Contrast Sets
2020-04-06POET: Endlessly Generating Increasingly Complex and Diverse Learning Environments and Solutions
2020-04-03Dream to Control: Learning Behaviors by Latent Imagination
2020-04-02Can we Contain Covid-19 without Locking-down the Economy?
2020-04-01State-of-Art-Reviewing: A Radical Proposal to Improve Scientific Publication
2020-03-31Agent57: Outperforming the Atari Human Benchmark
2020-03-30Axial Attention & MetNet: A Neural Weather Model for Precipitation Forecasting
2020-03-25[Rant] coronavirus
2020-03-23Online Education - How I Make My Videos
2020-02-24Deep Learning for Symbolic Mathematics
2020-02-21NeurIPS 2020 Changes to Paper Submission Process
2020-02-12Growing Neural Cellular Automata
2020-02-11Turing-NLG, DeepSpeed and the ZeRO optimizer
2020-01-27[Interview] Mark Ledwich - Algorithmic Extremism: Examining YouTube's Rabbit Hole of Radicalization
2020-01-22Reformer: The Efficient Transformer


Tags:
deep learning
machine learning
nlp
natural language processing
arxiv
attention
peer review
automate
distributed
scalable
neurips
score
objective