Making Python Fast With Numba & Dask (Quick Example)

Published: 04 October 2021
on channel: Gus Cavanaugh
1,240
22

Let's make Python go fast.

1. Start with a (fake) signals processing workload using numpy on my laptop that takes ~10 seconds
2. 20X the data but run it in 5 seconds by changing one line of code with numba
3. 10X the data while still running in ~10 seconds with a dask cluster using just a few lines of code
4. Go really big. Simulate a real-time sensor and run it a whole bunch of times just by asking Coiled for a 100 node Dask cluster

No too shabby, right? Faster. More data. And very little additional code (which would confuse me, because I'm just copying this stuff, not writing it myself). And my 100 node cluster costs only $6.50/hour

This is based on Matthew Rocklin's High Performance Python screencast. I'll be copying more of his stuff filtered through the lens of someone who struggles to computer.


Watch video Making Python Fast With Numba & Dask (Quick Example) online without registration, duration hours minute second in high quality. This video was added by user Gus Cavanaugh 04 October 2021, don't forget to share it with your friends and acquaintances, it has been viewed on our site 1,240 once and liked it 22 people.