Pipelined functions can be very powerful for memory efficient and readable code. These are functions where the output of the one feeds into the input of the next. Some example applications would be:
asyncio library for concurrent operations is fast and resource efficient, especially for IO-bound tasks.
This article will show you how to build your own pipelines that can run very efficiently, especially if you do a lot of…
BigQuery is Google’s analytical database that is insanely fast to query large datasets and lets you get started for free. At the time of writing, the first 1TB of data processed is free, and first 10GB of data stored is free. In this article I’ll show you some tips on how to get the most out of this amazing system.
BigQuery is a distributed system that combines distributed storage with a compute cluster that throws (often) 2000 or more slots (vCPUs) at your query in parallel. Use these tips to put this power to good use.
You’ll see this in…
Exploring the limits of software, data, and ML.