Zilliz launches Loon, a Lake-Native storage engine that Lets One Copy of Vector Data Serve Every AI Workload

Loon, the new storage engine behind Milvus 3.0 and Zilliz Vector Lakebase, serves real-time search, large-scale discovery, and analytics from a single copy of vector data on low-cost object storage — even as teams continuously re-embed, re-label, and re-index that data.
Zilliz, a leading AI data infrastructure company and the creator of Milvus, recently announced Loon, the new storage engine that powers Zilliz Vector Lakebase and ships in Milvus 3.0. Loon is the lake-native foundation that lets a single copy of vector data serve real-time search, large-scale discovery, and batch analytics at once — the storage layer behind Zilliz Cloud’s evolution from a vector database into a unified data platform for AI.
Vector Lakebase is built on a demanding premise: one logical copy of vector data should serve every AI workload — production search, discovery, and batch analytics — without copying or moving data between systems. The hardest part is the storage layer, because the same dataset has to behave like two systems at once: fast, record-level lookups for serving and wide scans for analytics, all on inexpensive object storage. It also has to handle data that never stops changing, as teams re-embed, re-label, and re-index the same records while their models improve.
“Vector retrieval is no longer the whole problem; Vector Lakebase is our answer to what happens after vector databases succeed,” said James Luan, Cofounder and CTO of Zilliz. “The systems that win will make continuous serving and continuous discovery feel like part of the same machine — and that only works when the storage layer can serve a single copy of data to every workload. Loon is that storage layer.”
Storage Built for AI Data That Evolves
To make that possible, Loon treats a vector dataset as what it actually is — physically heterogeneous — and is built on three ideas:
- Hybrid file formats: Each kind of column is stored in the format that fits it. Scalar and filter fields use Parquet for efficient scans; dense and sparse vectors use the open Vortex format for fast, byte-precise row-level reads on object storage; and raw videos, PDFs, and images stay in object storage, referenced rather than copied into the database.
- Row ID alignment: Columns split across different formats still behave as one logical table, so a new embedding model can be added as its own column without rewriting the captions, metadata, or vectors already stored.
- A versioned Manifest: A single source of truth defines the dataset’s current version — its files, indexes, delete logs, and statistics — so serving clusters, on-demand compute, and external engines such as Spark and Ray can all read and safely update the same dataset instead of maintaining separate copies.
Together, these let one copy of data on object storage feed many engines at once. In Zilliz’s internal testing of object storage, Loon’s Vortex-based layout reduced the data pulled per record read by about 135x compared to Parquet — the difference between practical and impractical low-latency serving on inexpensive object storage. And because the same data evolves in place, adding a new embedding model becomes a lightweight version update rather than a multi-hundred-gigabyte rewrite.
That is the architecture behind Vector Lakebase: real-time serving clusters stay fast and stable; elastic, on-demand compute runs discovery and batch analytics without touching production; and External Collections index data that stays in a customer’s own S3 or GCS bucket — all on one semantic foundation, with no duplicate pipelines and no ETL. It is the same Milvus and Zilliz Cloud foundation that more than 10,000 enterprises and AI-native teams — including MiniMax, OpenEvidence, Filevine, Exa, and Salesforce — already build on.
Availability
Loon now powers Milvus 3.0 and serves as the storage layer for Zilliz Vector Lakebase on Zilliz Cloud, which is available across more than 30 regions on AWS, Google Cloud, and Microsoft Azure — with Serverless, Dedicated, and BYOC deployment options. Teams whose stack splits online serving, offline analysis, backfills, and external lake workflows across separate systems can create a free account — new work-email signups receive $100 in free credits — or connect with the Zilliz team to discuss a specific use case.
Source: BUSINESS WIRE
Related News.
November 18, 2026
1 Day left for the 5th CSN Greece ICT Conference, Athens 19th November 2026 “Intelligent Skies, Secure Seas: The AI Impact on ICT” – Register Now
“Intelligent Skies, Secure Seas: The AI Impact on ICT” Register here Date: 19 November 2026 Time: 09:00-15:00 Venue: PLOES Floating Venue The…
November 18, 2026
Carriers may secure only part of their November rate increases as Suez returns and North European ports brace for bunching, Sogese report says
Sogese's reading of the European container market, and what importers, exporters, forwarders and container owners should focus on from now to spring…
November 18, 2026
Shipping sector backs an International Maritime Organization IMO climate deal, but not all of the details
The shipping and oil and gas industries have repeatedly publicly backed the IMO Net Zero Framework, in contrast to opposing governments’ claims…
November 18, 2026
OceanScore advances port emissions intelligence ambitions through agreement with RightShip on MEP customer portfolio
Agreement provides a transition pathway for selected MEP customers to OceanScore's PortView platform, supporting its ambition to establish a global…
November 18, 2026
Port of Piraeus at the 9th China International Import Expo CIIE
Piraeus Port Authority S.A. participated in the 9th China International Import Expo , held in Shanghai from 5 to 10 November 2026. This year’s…
November 18, 2026
NGOs urge UN Shipping Body to adopt Crucial Climate Agreement before year end
Ahead of an upcoming meeting of the International Maritime Organization’s (IMO) Marine Environment Protection Committee (MEPC 85, November…
November 18, 2026
Getting to Zero Coalition members what is needed from shipping’s regulatory enforcement mechanism
While International Maritime Organization member states have been meeting in informal groups in the lead-up to MEPC 85, the Global Maritime Forum has…
November 18, 2026
India’s first overseas chemical warehouse opens in Jafza to support exports to Gulf and Africa
India’s first overseas chemical warehouse has opened in Jebel Ali Free Zone, DP World’s flagship free zone, giving Indian chemical exporters a base…
November 18, 2026
MEPC85 researcher on how first global climate deal could pave the way for fossil-free shipping
From November 30 to December 4, the International Maritime Organization's (IMO) Marine environment protection committee will resume its second…
November 18, 2026
DORIC WEEKLY INSIGHT 13 NOVEMBER 2026
Pls find below the DORIC WEEKLY INSIGHT 13 NOVEMBER 2026 Weekly_Report_13.11.2026
Subscribe to our newsletter!
if you dont want to swim alone in the ocean of news, sign up for the newsletter, and you will receive daily all the important news of world shipping!
Design & Development by P.KAN.DESIGNER
© 2026 Cyprus Shipping News. All rights reserved
Design & Development by P.KAN.DESIGNER
© 2026 Cyprus Shipping News. All rights reserved























