Skip to content
  • Posts
  • Join the Spatial Lab
  • Learn Modern GIS
  • Sponsor
  • Coaching
  • Podcast

Get the newsletter

Join 71,000+ geospatial experts growing their skills and careers. Get updates on the most cutting edge updates in modern GIS and geospatial every week.

  • LinkedIn
  • YouTube
Article

How to Build a Cloud-Native Spatial Data Lakehouse

July 3, 2025 Matt Forrest Comments Off on How to Build a Cloud-Native Spatial Data Lakehouse

Most spatial workflows today are still running on a foundation of folders, flat files, and fragile scripts. You’ve probably worked with shapefiles stored in six different places, Python notebooks that quietly break when a column changes, and a dozen versions of the same dataset ending in _final_v2_edit.shp. I’ve been there.

But spatial data has changed. It’s bigger, more dynamic, and needs to be accessible across teams and tools. What hasn’t changed fast enough is how we manage it.

That’s where the spatial data lakehouse comes in.

At its core, a lakehouse architecture combines the flexibility of cloud object storage with the performance and structure of a warehouse. It lets you work with data like an engineer and an analyst—at scale, with full versioning, and without being locked into one platform.

Here’s what you need to build one:

  • Cloud-native storage like Amazon S3 or Google Cloud Storage
  • Open formats like GeoParquet for vector and COG for raster
  • Apache Iceberg as your table format to manage schema, partitioning, and time travel
  • Engines like Apache Sedona, Spark, or Wherobots to query your data with SQL
  • Airflow to automate ingestion, processing, and updates

This stack doesn’t care what software you use. It’s open, flexible, and built for interoperability. You can load data with Python, query it with SQL, join it across years or sources, and share it across teams without duplicating files or losing control of your schema.

I recently walked through this in a LinkedIn carousel, including how this setup lets you do things like:

  • Automatically update a building footprint dataset every month
  • Run spatial joins against flood zones without copying files
  • Version your tables so you can roll back mistakes
  • Build pipelines that scale from your laptop to the cloud

If you’re building anything with geospatial data and you’re tired of managing brittle scripts and bloated folders, this is the architecture you’ve been waiting for.

This isn’t the future of GIS it’s already happening. And it’s time more spatial teams got to work this way.

  • Apache Airflow
  • Apache Iceberg
  • Apache Sedona
  • Cloud Optimized GeoTIFF
  • Cloud-Native Geospatial
  • geoparquet
  • Wherobots
Matt Forrest

Post navigation

Previous
Next

Search

Categories

  • Article (29)
  • Essay (1)
  • Podcast (5)
  • Tutorial (7)

Recent posts

  • Convert a Shapefile to GeoParquet (Python, DuckDB, Sedona)
    Convert a Shapefile to GeoParquet (Python, DuckDB, Sedona)
  • I Gave Claude AI Full Control of QGIS: What Happened
    I Gave Claude AI Full Control of QGIS: What Happened
  • AI for GIS: 5 Prompts That Replace Hours of Work
    AI for GIS: 5 Prompts That Replace Hours of Work

Tags

aggregations Apache Airflow Apache Iceberg Apache Sedona ArcGIS bigquery Cloud-Native Geospatial Cloud GIS Cloud Optimized GeoTIFF duckdb Esri geoparquet geospatial gis GISP Modern GIS postgis Python snowflake Spatial SQL sql Wherobots zip codes

Related posts

Convert a Shapefile to GeoParquet (Python, DuckDB, Sedona)
Tutorial

Convert a Shapefile to GeoParquet (Python, DuckDB, Sedona)

October 28, 2026 Matt Forrest No comments yet

I took a real Shapefile with almost 1.1 million polygons and converted it to GeoParquet three different ways. The file went from over 1.4 GB of source data down to 246 MB, opened cleanly in QGIS, and ran spatial queries in seconds instead of minutes. The dataset was the New York City building footprints. Every […]

Podcast

Breaking the GIS Silo: Why GeoParquet and Iceberg are the key to Spatial Analytics at Scale

July 3, 2025 Matt Forrest Comments Off on Breaking the GIS Silo: Why GeoParquet and Iceberg are the key to Spatial Analytics at Scale

For decades, GIS has lived in a world of its own. Specialized software. Obscure formats. A profession that, despite being critical to everything from climate modeling to logistics, has remained siloed from the rest of the data world. But that’s finally starting to change. In the latest episode of the Spatial Stack podcast, I sat […]

Article

Scaling GIS Workflows with COGs, Airflow, and Apache Iceberg

April 25, 2025 Matt Forrest Comments Off on Scaling GIS Workflows with COGs, Airflow, and Apache Iceberg

TOP OF THE STACK What we need to do with COGs COGs (Cloud-Optimized GeoTIFFs) are one of the most promising tools we have for making raster data truly cloud-native. They let you stream just the pieces you need, work remotely, and plug into modern geospatial systems without downloading giant files. But after working closely with […]

Spatial Lab
  • Join the Spatial Lab community
Policies
  • Privacy Policy
  • Terms & Conditions
  • Refund Policy
  • Cookie Policy
Spatial SQL
  • Get the Spatial SQL book today
Join Us

© Matt Forrest 2024. All Rights Reserved.

Manage Consent
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes. The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.
  • Manage options
  • Manage services
  • Manage {vendor_count} vendors
  • Read more about these purposes
View preferences
  • {title}
  • {title}
  • {title}