Lakesail

LakeSail is a data and AI platform built around Sail, an open-source compute engine written in Rust that is compatible with Apache Spark. It aims to let teams run their existing Spark workloads on a faster, cheaper engine without rewriting code. It offers the same interface, avoids the overhead of the Java Virtual Machine, and adds a runtime designed to be driven by AI agents. Sail is available as free open source, and LakeSail also offers a fully managed version.

Compatibility

Sail implements the Spark Connect protocol, so existing PySpark, Spark SQL, Delta Lake and Iceberg code can run unchanged. Switching usually means pointing the Spark remote at Sail, and the open-source package installs with a single pip command. LakeSail also provides a free Spark-to-Sail scanner that runs in the browser or from the command line. It checks your Spark SQL and DataFrame code against Sail before migration and reports which calls are supported and whether anything would block the move.

Performance claims

LakeSail says Sail runs around ten times faster than Spark and can lower infrastructure costs substantially, based on its own benchmarks derived from TPC-H. The site links to a detailed performance comparison and reports more than 700,000 downloads of the engine. Because Python and AI workloads run natively without JVM overhead, the company also positions Sail for mixed analytics and machine learning pipelines. The managed platform includes notebooks, jobs, sessions, compute, catalogs and query views.

Pricing

The open-source Community edition is free under the Apache 2.0 licence. It includes the full engine for self-hosting, and you pay only your own cloud costs, with community support on Slack and GitHub. The Managed plan runs LakeSail inside your own AWS VPC, a bring-your-own-cloud model, and costs $0.01 per vCPU-hour plus $0.002 per GiB-hour of memory, on top of your cloud compute bill. There is no minimum spend or contract. The site includes a savings calculator for estimating costs against current Spark spending.

Things to consider

Benchmark figures come from LakeSail itself, so teams should test their own pipelines, ideally after running the compatibility scanner. Workloads that depend on Spark features outside the Spark Connect API may need extra checks. The managed offering currently targets AWS, so organisations on other clouds should confirm availability or use the self-hosted engine.