Scott Haines – Medium

Scott Haines

he/him

Featured Book

See all (2)

Delta Lake: the Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes

Delta Lake: the Definitive Guide: Modern Data Lakehouse Architectures with Data Lakes

Ready to simplify the process of building data lakehouses and data pipelines at scale? In this practical guide, learn how…

2024

Denny Lee, et al.

Denny Lee, Prashanth Babu, et al.

Stories

Pinned

Beyond the Data Abyss

How We Learned to Fall in Love with our Streaming Data Again.

Jul 17, 2025

A colorful rendering of what Space could look like abound with reds and yellows, blues and blacks. Not the classic void of space but something more happy and inviting.

Jul 17, 2025

Pinned

Escaping the Void of the Data Abyss

Jun 30, 2025

A monster in the clouds appears to be chasing a classic car against a background of storm clouds in red and gray

Jun 30, 2025

Pinned

Published in

A Modest Introduction to Analytical Stream Processing

Architectural Foundations for Building Reliable Distributed Systems.

Aug 15, 2023

A Modest Introduction to Analytical Stream Processing

Aug 15, 2023

Pinned

Published in

From Data Lakes to Data Reservoirs

Create Clean, Beautiful, Protected Data Resources with Apache Spark and Delta Lake

Jul 31, 2020

Water crashing together. 3 states of water, from peaceful to disorderly. Intersecting to create beauty in chaos.

Jul 31, 2020

Published in

A Gentle Introduction to Analytical Stream Processing

Building a Mental Model for Engineers and Anyone in Between

Mar 31, 2023

The image captures streams naturally coalescing into a waterfall. It is gentle before things begin to move faster, this is similar to data networks and streaming environments.

Mar 31, 2023

Working with Spark SQL Time Functions

A Hands-On Guide to Time with Apache Spark

Mar 7, 2023

Working with Spark SQL Time Functions

Mar 7, 2023

Published in

Data+AI 2022: Spark Inception:

Harnessing the Spark REPL to power Streaming Notebook Environments. For Fun. For Profit?

Jun 29, 2022

Data+AI 2022: Spark Inception:

Jun 29, 2022

Published in

Towards Analytics with Redis

Using Hashes and Binary Data Structures

Feb 25, 2022

Feb 25, 2022

Problems All Writers Face

Learning to break mental blocks and unstuck yourself

May 26, 2021

Problems All Writers Face

May 26, 2021

Published in

Analytical Hashing Techniques

Spark SQL Functions to Simplify your Life

Mar 11, 2021

Analytical Hashing Techniques

Mar 11, 2021

Scott Haines

Scott Haines

he/him

Book Author

Developer Relations Engineer @ Buf. Ex-Distinguished Software Engineer @ Nike. I write about all things data, my views are my own.

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech