Medium

Scott Haines

he/him

Featured Book

See all (2)

Delta Lake: the Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes

Delta Lake: the Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes

Ready to simplify the process of building data lakehouses and data pipelines at scale? In this practical guide, learn how…

2024

Denny Lee, et al.

Denny Lee, Prashanth Babu, et al.

Stories

Pinned

Scott Haines

·

Jul 17, 2025

Beyond the Data Abyss

How We Learned to Fall in Love with our Streaming Data Again.

A colorful rendering of what Space could look like abound with reds and yellows, blues and blacks. Not the classic void of space but something more happy and inviting.

Pinned

Scott Haines

·

Jun 30, 2025

Escaping the Void of the Data Abyss

A monster in the clouds appears to be chasing a classic car against a background of storm clouds in red and gray

Pinned

In

TDS Archive

by

Scott Haines

·

Aug 15, 2023

A Modest Introduction to Analytical Stream Processing

Architectural Foundations for Building Reliable Distributed Systems.

A Modest Introduction to Analytical Stream Processing

Pinned

In

TDS Archive

by

Scott Haines

·

Jul 31, 2020

From Data Lakes to Data Reservoirs

Create Clean, Beautiful, Protected Data Resources with Apache Spark and Delta Lake

Water crashing together. 3 states of water, from peaceful to disorderly. Intersecting to create beauty in chaos.

In

TDS Archive

by

Scott Haines

·

Mar 31, 2023

A Gentle Introduction to Analytical Stream Processing

Building a Mental Model for Engineers and Anyone in Between

The image captures streams naturally coalescing into a waterfall. It is gentle before things begin to move faster, this is similar to data networks and streaming environments.

Scott Haines

·

Mar 7, 2023

Working with Spark SQL Time Functions

A Hands-On Guide to Time with Apache Spark

Working with Spark SQL Time Functions

Scott Haines

·

Jun 29, 2022

Data+AI 2022: Spark Inception:

Harnessing the Spark REPL to power Streaming Notebook Environments. For Fun. For Profit?

Data+AI 2022: Spark Inception:

In

Level Up Coding

by

Scott Haines

·

Feb 25, 2022

Towards Analytics with Redis

Using Hashes and Binary Data Structures

Scott Haines

·

May 26, 2021

Problems All Writers Face

Learning to break mental blocks and unstuck yourself

Problems All Writers Face

In

TDS Archive

by

Scott Haines

·

Mar 11, 2021

Analytical Hashing Techniques

Spark SQL Functions to Simplify your Life

Analytical Hashing Techniques

Scott Haines

Scott Haines

he/him

Book Author

Developer Relations Engineer @ Buf. Ex-Distinguished Software Engineer @ Nike. I write about all things data, my views are my own.

Following

Help

Status

About

Careers

Press

Blog

Store

Privacy

Rules

Terms

Text to speech