What Database Does Palantir Use?

Palantir does not run on one database. Its platforms store data in layers, and each layer uses a different technology. Foundry, the data platform, keeps datasets as Parquet files in cloud object storage such as Amazon S3 or Azure Blob Storage. The Ontology is the layer that turns those datasets into objects such as customers, aircraft, or orders. It is served from Palantir's own object store, with search indexes built on Lucene and Elasticsearch. Gotham, the government platform, was built on AtlasDB, Palantir's open source transactional layer on top of Cassandra. Palantir also connects to whatever databases its customers already run, and it does not sell a database of its own.

Palantir Storage Layer by Layer

LayerWhat it holdsTechnologyPublic source
DatasetsRaw and transformed tables and filesParquet, CSV, and Avro files in object storage; Apache Iceberg tablesFoundry documentation
ProcessingThe pipelines that build datasetsSpark, Polars, and Flink on KubernetesFoundry documentation
OntologyObjects, links, and their historyPalantir object storage with Lucene and Elasticsearch indexesFoundry architecture documentation
Gotham operational dataEntities and relationships for analystsAtlasDB on CassandraPalantir's GitHub
Service metadataPermissions, jobs, usersPer-service stores, not publishedNone

Datasets Are Files, Not Rows in a Database

A Foundry dataset is a folder of files plus a schema, not a table in a database server. Structured data is written in Parquet, a columnar file format in which each column is stored together. A query that reads three columns of fifty therefore touches only those three. The files sit in the customer's cloud object storage. Every change to a dataset creates a new transaction, so a pipeline can be rebuilt from any earlier version.

This design is why Foundry scales cheaply. Object storage costs a small fraction of a database server per terabyte, and compute is added only while a pipeline runs. Foundry now also supports Apache Iceberg, an open table format that lets other engines such as Spark, Trino, Databricks, and Snowflake read the same files without copying them.

The Ontology and Its Indexes

The Ontology is the part of Palantir that people usually mean when they ask about "the Palantir database". It maps datasets to object types, such as a Customer object with properties and links to Order objects. Gotham's graph views, Foundry's applications, and AIP all read from this layer.

Objects are loaded from datasets into Palantir's object storage service, which indexes them for filtering, search, and aggregation. Palantir's architecture documentation names Lucene and Elasticsearch in this layer. Writes made by users, such as an analyst editing a property, are recorded as actions and applied back to the datasets. The graph that analysts see in Gotham is a view over these objects and links. Palantir does not run a standalone graph database product.

AtlasDB and Cassandra in Gotham

AtlasDB is the one database technology Palantir has published in full. It is an open source transactional layer on top of key-value stores such as Cassandra. It adds serializable transactions, meaning that concurrent updates behave as if they ran one at a time. Palantir built it for Gotham, where analysts edit shared entities at the same time and must never see a half-applied change. It remains the clearest public statement of how Palantir stores operational data.

Databases Palantir Connects To

Most data in a Palantir deployment starts in the customer's own systems. Foundry ships connectors for PostgreSQL, Oracle, SQL Server, MySQL, Cassandra, MongoDB, Snowflake, BigQuery, Databricks, SAP, and many more. Some data is copied into datasets on a schedule. Some is queried in place through virtual tables, so the customer's warehouse stays the system of record.

That also answers the "how does Palantir collect data" question. Palantir does not collect data itself. Customers bring their data, and Palantir's software integrates it inside the customer's own cloud account or on the customer's own servers. AIP, the product that connects large language models to that data, is not a database either. It reads from the Ontology.

What to Take Into a System Design Interview

The Palantir pattern is a useful example for a system design interview. Use cheap object storage for raw data, a columnar file format for analytics, a search index for interactive filtering, and a transactional key-value store for shared edits. Each store does one job. That layered answer, with a reason for each layer, is what an interviewer wants when the question is to store and query a large, mixed dataset.

Palantir's own design round is described in what to expect in the Palantir system design interview, and the wider loop in the Palantir interview process, round by round. For what the company does with these systems, read what Palantir is famous for.

How to Prepare

  • Learn the storage building blocks by name. Object storage, columnar files, search indexes, and transactional key-value stores each solve one problem, and an interviewer expects you to say which. Grokking System Design Fundamentals covers each of them.
  • Practice a data platform design end to end. Ingest from ten sources, transform on a schedule, and serve interactive queries over the result. Grokking the System Design Interview works through designs of this shape.
  • State a reason for every store you add. A design with four storage systems and no reasons scores lower than one with two systems and a reason for each.
  • Read Foundry's public documentation once. The dataset, transform, and Ontology pages explain the layers above in Palantir's own terms.
TAGS
System Design Interview
CONTRIBUTOR
Arslan Ahmad
Arslan Ahmad
ex-FAANG engineering manager and author or Grokking series.

GET YOUR FREE

Coding Questions Catalog

Design Gurus Newsletter - Latest from our Blog
Boost your coding skills with our essential coding questions catalog.
Take a step towards a better tech career now!
Explore Answers
Why do you want to join Netflix?
Does Stripe negotiate salary?
What do I need to apply for Netflix?
What Is the Paytm Interview Process Like? (Round by Round)
Candidates report an online coding round, two or three technical rounds, a design round for experienced roles, a managerial round, and an HR round.
What qualifications do you need to work at Netflix?
What to Expect in the Bloomberg System Design Interview
Bloomberg's hardest round: real-time financial systems (market data distribution, alerting, news pipelines) probed with relentless follow-ups. Themes, a walkthrough, and preparation.
Related Courses
New
Grokking Agentic Design Patterns course cover
Grokking Agentic Design Patterns
Design agents that act safely, recover from failure, and justify their cost.
4.9
(561 learners)
Discounted price for Your Region

$98

New
Grokking the AI System Design Interview course cover
Grokking the AI System Design Interview
Learn to design AI systems the way interviewers expect: classic ML products, LLM and RAG architectures, and agentic systems, all through the lens of the system design interview.
4.6
(3,192 learners)
Discounted price for Your Region

$98

Grokking the Coding Interview: Patterns for Coding Questions course cover
Grokking the Coding Interview: Patterns for Coding Questions
The 24 essential patterns behind every coding interview question. Available in Java, Python, JavaScript, C++, C#, and Go. The most comprehensive coding interview course with 543 lessons. A smarter alternative to grinding LeetCode.
4.6
Discounted price for Your Region

$197

Design Gurus logo
One-Stop Portal For Tech Interviews.
About Us
Our Team
Careers
Partners
Contact Us
Become Affiliate
Copyright © 2026 Design Gurus, LLC. All rights reserved.