When is Scale Enough?
Ethan Dyer (Google Research, Blueshift Team)
https://simons.berkeley.edu/talks/tut...
Deep Learning Theory Workshop and Summer School
Abstract: Deep learning continues its march of performance progress as models and datasets are scaled up. This talk will discuss work investigating performance predictability with model, dataset, and compute scale for deep learning in general and large language models in particular. I will review scaling in linear models -- a simple analytic system exhibiting many of the phenomena characteristic of realistic networks. I will also discuss empirical work attempting to investigate what types of problems can practically be solved by scale alone and what types cannot.
Watch video When is Scale Enough? online without registration, duration hours minute second in high quality. This video was added by user Simons Institute 01 January 1970, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,548 once and liked it 41 people.