High Performance Data Processing in Python || Donald Whyte

Channel:
United States Coding Tech
Subscribers:
725,000
Published on ● Video Link: https://www.youtube.com/watch?v=nmYyISMdOqY


Duration: 39:37
19,259 views
645

numpy and numba are popular Python libraries for processing large quantities of data. This talk explains how numpy/numba work under the hood and how they use vectorisation to process large amounts of data extremely quickly. We use these tools to reduce the processing time of a large, real 600GB dataset from one month to 40 minutes, even when the code is run on a single Macbook Pro.

EVENT:

PyData Warsaw 2018

SPEAKER:

Donald Whyte

PERMISSIONS:

PyData provided Coding Tech with the permission to republish this video.

CREDITS:

PyData YouTube channel: https://www.youtube.com/channel/UCOjD18EJYcsBog4IozkF_7w



Other Videos By Coding Tech


2019-03-01Single Page Applications At Scale
2019-02-23Move Over GUI, Lets Build a VUI With JavaScript!
2019-02-22The React Cookbook: Advanced Recipes to Level Up Your Next App
2019-02-17The Clean Architecture
2019-02-16Moving Beyond Virtual DOM and State Management
2019-02-13TypeScript - State of the Union
2019-02-06Lean vs Agile vs Design Thinking
2019-02-04Using Python in Weather Forecasting || Stephan Siemen
2019-02-03console.log(brain)
2019-01-28Speed, Speed, Speed: JavaScript vs C++ vs WebAssembly
2019-01-27High Performance Data Processing in Python || Donald Whyte
2019-01-26Raiders of the Javascript based Malware
2019-01-21How Linters, Compilers & Other Cool Things Work
2019-01-20React and TypeScript
2019-01-19Your CSS Layout Toolkit for 2019
2019-01-18Building Progressive Web Apps With React
2019-01-12Headers for Hackers: Wrangling HTTP Like a Pro
2019-01-08Hitchhikers Guide to Web Standards
2019-01-06Debugging, a Step Away From the Console
2019-01-05Observing NodeJS
2019-01-04MicroPython – Python for Microcontrollers


Tags:
python
high performance
numpy
pandas
algorithmic trading