This tutorial will walkthrough Determined AI's CIFAR-10 example. This will show you the basics of how to define a hyperparameter search configuration and how to integrate that with different data loaders, model definitions, loss functions, callbacks, and so on. From this tutorial you should have a sense of the Determined API and the Experiment Tracking visualization and Hyperparameter search features!
Determined AI Examples: https://github.com/determined-ai/dete...
How to setup EC2 Runtime for Determined: • Distributed Training and Hyperparamet...
***minor errata on the video*** the type annotations in Determined's function definitions are just that; annotations. They let you statically test your code with the mypy linting tool, and mypy will tell you "hey you're passing invalid arguments to this type-annotated function". But at runtime, it's just normal python semantics with no automatic behaviors
Chapters
0:00 Beginning
0:48 CIFAR-10
1:51 Determined Examples
3:26 Configuration Files
8:01 Data Loader
12:23 Model Definition
18:42 Sending Experiment
20:48 PyTorch Comparison
22:09 Experiment Tracking
23:41 HP Search
26:04 Summary
Watch video Determined AI Example - CIFAR-10 Hyperparameter Search! online without registration, duration hours minute second in high quality. This video was added by user Connor Shorten 24 February 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 2,026 once and liked it 42 people.