Vol. I · No. 2
An Analysis of Federation & the Semantic Layer
May 15, 2026
A Field Report on Enterprise Data Infrastructure

Querying is easy.
Meaning is hard.

For ten years, enterprise data architecture has been organized around the technical project of making data accessible. Storage and compute decoupled. Open table formats matured. Federated query engines learned to read across warehouses, lakehouses, and operational systems through a single SELECT. Much of the architecture imagined in 2018 has now been built. And yet the average enterprise still loses millions a year to duplicated definitions and metrics that mean different things in different rooms — because the hard problem was never merely getting to the data. Access is not the same as meaning.

A note on the numbers →
Benchmark figures are drawn from public benchmark papers and leaderboards (Spider 2.0, BIRD). Semantic-layer adoption figures are drawn from vendor and community surveys (Reliable Data Engineering n=500+, dbt Labs 2025) and should be treated as directional rather than market-representative. Cost-of-poor-data-quality figures cite Gartner research (2020, widely cited). Author consults to Starburst Data via Kubrick Group; see colophon.
86%17%
Text-to-SQL accuracy collapse
Spider 1.0 → Spider 2.0 (main)
Source · Spider 2.0 paper (Lei et al., 2024)
$12.9M
Cost of poor data quality
per organization, annual
Source · Gartner 2020, widely cited
35%
Of data teams have no
dedicated semantic layer
Source · Reliable Data Eng. survey n=500+ · directional
33%
Of enterprise apps will include
agentic AI by 2028
Source · Gartner projection

The next data-platform fight is not over who can reach the most data. It is over who gets to define what that data means.

§ 01The Cliff

A seventy-point drop when SQL meets the enterprise.

Querying is not easy in the trivial sense. Distributed execution, predicate pushdown, identity propagation, and cross-source joins remain serious engineering problems. But they are problems with machinery. Meaning is a problem with institutions. The chart below makes that distinction visible: two text-to-SQL benchmarks, both translating natural language into SQL, with one running on clean academic schemas and the other on real enterprise complexity (3,000+ column schemas, multiple SQL dialects, multi-step workflows, project-level codebase navigation).

Academic schemas
Enterprise-flavored
Real enterprise workflows
Hover any bar · source & methodology

These are not apples-to-apples benchmark scores. Different evaluation harnesses, model classes, and prompting regimes produce different results. The chart is a directional illustration of what happens when text-to-SQL moves from clean schemas to enterprise-like workflows — not a controlled comparison.

§ 02What Got Built

The federation decade worked.

The dominant architecture has converged on five layers: object storage, table format, catalog, query engine, consumer. More engines can now query more tables through shared formats and catalogs than at any previous point in the data stack. The technical achievement is real, widespread, and worth naming before pointing to what it didn't solve. Hover any tool for context.

L5
Consumers
BI · Notebooks · LLMs
Tableau Power BI Looker Hex · Jupyter LLM Assistants ↑
L4
Query Engines
Compute · Federation
Trino Spark Snowflake Databricks SQL BigQuery DuckDB
L3
Catalog
Metadata · Governance
Polaris Unity Catalog AWS Glue Gravitino Nessie Hive Metastore
L2
Table Format
Schema · Transactions
Iceberg · 78% Delta Lake Apache Hudi DuckLake Apache Paimon
L1
Object Storage
Bytes · Durability
S3 ADLS GCS MinIO On-prem
↑ Read · Write · Any engine to any table through the catalog ↑

Hover a tool

The achievement
94% · 92% · 38%
94% of enterprises run on cloud data services. 92% are multi-cloud. 38% use multiple warehouses concurrently — Snowflake plus Databricks plus a third platform is normal. The "one warehouse" model may still be desirable in theory; in practice, most enterprises are already plural. Federation is the architectural answer to that fact.
§ 03The Visible Problem

Every definition lives in six places at once.

Consider "monthly recurring revenue" in any enterprise that has done at least one reorg. MRR exists in all six layers simultaneously, each version a legitimate engineering decision, none authoritative over the others. Below: the six layers, then where teams are actually putting their semantic enforcement.

Source · Reliable Data Engineering survey (n=500+) · Dec 2024–Jan 2026 · community/industry analysis · multi-select, totals exceed 100%. Treat as directional rather than market-representative.

The semantic layer was a nice-to-have when humans wrote queries. It is load-bearing infrastructure when agents do.
§ 04 · The Five Bets · May 2026
§ 04The Battleground

Five bets on where to put the truth.

If business definitions are the substance of institutional truth, the layer where they are enforced is one of the most consequential pieces of infrastructure an enterprise owns. The contest is currently split across five architectural schools. Each card shows the bet, the canonical implementation, and the limit.

Bet 01 · Transformation-layer

Definitions live with the SQL that builds them

dbt MetricFlow · GA October 2024 · 18% adoption

Metrics defined in YAML alongside dbt models, version-controlled in Git, exposed via APIs to downstream tools. The bet: definitions belong with the transformations that compute them. The limit: dbt cannot enforce what BI tools do downstream — and the LLM never reads the manifest unless you integrate it.

# metrics.yml
metrics:
  - name: monthly_recurring_revenue
    label: "MRR"
    type: simple
    type_params:
      measure: mrr_cents
    filter: |
      {{ Dimension('contract__status') }}
        = 'active'
Bet 02 · Warehouse-native

The warehouse is the gravitational center

Snowflake Semantic Views · Databricks metric views · maturing 2025–2026

Put the definitions inside the warehouse and let every engine that queries it honor them. Snowflake Semantic Views moved into GA-era productization in 2025; Databricks Unity Catalog metric views entered public preview in 2025 and continued maturing through 2026. The bet: the warehouse is already where the data is. The limit: 38% of organizations run multiple warehouses — semantics in any single one are still siloed across the federation.

CREATE SEMANTIC VIEW analytics.mrr_view
  TABLES (contracts, invoices)
  RELATIONSHIPS (contract_id)
  FACTS (
    mrr AS SUM(invoices.amount_cents)/100
  )
  DIMENSIONS (status, segment, region);
Bet 03 · Query-engine-level

The federation layer sees everything

Trino views · Starburst Enterprise Context Layer

In a federated architecture, the only layer that natively reads across all warehouses, lakes, and operational systems is the query engine itself. The bet: cross-source consistency requires a cross-source enforcement point. The risk: this is powerful, but it also makes the federation layer politically dangerous — it becomes a governance surface, not just a query surface. Platform engineering inherits business-definition governance whether it wants that role or not, and most platform teams are neither staffed nor mandated to make calls about whether a contract counts as active.

CREATE VIEW federation.mrr AS
SELECT date_trunc('month', i.date) month,
       SUM(i.amount_cents)/100 AS mrr
FROM postgres.billing.invoices i
JOIN iceberg.crm.contracts c
  ON i.contract_id = c.id
WHERE c.status = 'active';
Bet 04 · Dedicated / OLAP

Semantic layer as standalone runtime

Cube · AtScale (3%) · LookML (28%)

A separate runtime with caching and pre-aggregation. The bet: warehouse-native gives up performance optimizations; a dedicated layer can serve any downstream tool uniformly. The limit: yet another runtime to deploy, scale, and govern. Per-tool semantics if each BI vendor maintains its own.

cube('MRR', {
  sql: `SELECT * FROM analytics.contracts`,
  measures: {
    mrr: {
      type: 'sum',
      sql: 'amount_cents/100'
    }
  }
});
Bet 05 · Consumer-embedded

Definitions live where they're consumed

LLM prompt context · BI saved views · Spreadsheets

Each consuming product builds its own semantic store — quietly, often unacknowledged. The bet: definitions are most relevant at the point of use. The risk: re-fragmentation, this time per-agent or per-vendor. The fastest-growing category and the worst architectural outcome — it re-creates the problem the federation layer was built to avoid.

# LLM Assistant · system prompt
You are an analytics assistant. When users
ask about revenue, query the 'invoices'
table and sum the 'amount' column.
Exclude refunds.
  ↑ drifted from canonical MRR in 3 ways
+ The attempted treaty

Open standards as a sixth path

OSI (2025) · Model Context Protocol · GigaOm Radar 2025

The Open Semantic Interchange (dbt + Snowflake + Salesforce, 2025) is the direct semantic-interchange bet: a shared format for metric definitions across vendor boundaries. MCP (Anthropic, ecosystem-wide) is the adjacent interface bet — if agents consume tools and resources through standardized protocols, semantic definitions need to become addressable through those protocols. The two are complementary, not equivalent. Whether either holds, or each major vendor consolidates ownership inside its own platform, is the structural question of the next three years.

# MCP semantic layer interface
{ "server": "metrics.acme.com",
  "capabilities": ["resources", "tools"],
  "metrics": [{
    "name": "mrr",
    "definition": "canonical",
    "source": "dbt_semantic_layer"
  }] }
The operating-model question

The hardest semantic-layer decision is not where definitions are stored, but who is allowed to change them. A metric definition without an owner is documentation. A metric definition with an owner, review process, lineage, tests, and release cadence is infrastructure. The architectural layer matters because it determines the enforcement point; the operating model matters because it determines whether enforcement survives contact with the business.

§ 05Implications

If you're choosing a semantic-layer strategy in May 2026.

Three things data architects, platform leads, and consultants should internalize from the current state of the contest.

№ 01

Pick the layer first. The tool follows.

The decision is not dbt vs Snowflake vs Trino vs Cube. It is: which team owns the definition of revenue, and at which layer of the stack is that definition enforced? S3 (transformation) optimizes for upstream truth. S4 (engine) optimizes for cross-source consistency. S5 (BI) optimizes for end-user fidelity. Each has a tradeoff. The wrong answer — held by 35% of teams — is all of the above, by accident.

№ 02

Distance from source predicts drift.

A definition stored at S3 and consumed at S6 crosses three potential rewriting points. Each hop is a place where local context overwrites the upstream definition for good local reasons. The architectural work is not to document each layer's exceptions — it is to shorten the path. Trino's value as a federation layer is that it can expose cross-source definitions through one enforceable access point. That value is only realized if downstream BI tools and consumers honor the engine-level view rather than silently recomputing.

№ 03

The next consumer does not triangulate.

A human analyst asking "what's our revenue" can detect a wrong answer because they have surrounding context. A language model has only what was injected. By the time Gartner's 33% agentic AI projection hits in 2028 — a 36-month timeline — every semantic ambiguity in the stack becomes a confidence-weighted production bug. The migration is not from BI tools to LLMs. It is from triangulating consumers to non-triangulating ones. Design for the latter.