A Brief Analysis of Palantir Gotham A Collaborative and Interactive Big Data Visualization Analysis Software Based On Dynamic Ontology
A Brief Analysis of Palantir Gotham A Collaborative and Interactive Big Data Visualization Analysis Software Based On Dynamic Ontology
Abstract—Palantir Gotham is a big data analysis and for business analysts within Gotham. Employing interface
management software based on dynamic ontology technology, analysis and process analysis methodologies, it organizes the
catering to the domains of military decision-making, national stages of collaborative interactive analysis of big data
defense security, government administration, etc. This paper selects featuring multi-source heterogeneity, multi-modality, and
an frontend analytics software targeted at business analysts from multiple AI models based on this software. Key capabilities
Gotham, delves into its primary capabilities and core and functions are analyzed and outlined. Subsequently, the
functionalities, examines and organizes the underlying core paper summarizes Gotham's core technologies, namely,
technologies, primarily consisting of big data integration and dynamic ontology-based big data integration and business
business mapping techniques based on dynamic ontologies, an
mapping technology, integrated secure collaboration-oriented
integrated security-enhanced collaborative big data system
technical architecture, and human-centered collaborative
big data system technical architecture, and human-centric
interactive visualization analysis techniques for big data. The paper interactive visualization analytics for big data.
analyzes and summarizes the primary mapping principles of Within this context, through document analysis, patent
structured data within the Palantir ontology, the key application analysis, and architecture analysis, the paper explains the
principles of Palantir's dynamic ontology technology, along with its primary mapping principles of structured data within the
comprehension of the three-layer structure and three characteristics Palantir Ontology, contrasting traditional data manipulation
of the dynamic ontology. The paper outlines and summarizes the
with Palantir's ontology-based Action Type approach. The
understanding diagram of Palantir's big data system technical
paper summarizes the main operational principles of Palantir's
architecture, identifying and elucidating its crucial technological
components, and identifies and summarizes three typical frontend dynamic ontology technology, expounds upon the three-layer
styles employed in Gotham's interactive visualization analysis. understanding of its dynamic ontology, and proposes three
Ultimately, the paper shares three insights: human-computer characteristics of this dynamic ontology.
collaborative analysis, the philosophy of dynamic ontology, and Given the lack of publicly available information on
collaborative interactive analysis. Palantir's big data system technical architecture, the paper
compiles and summarizes a comprehensive understanding
Keywords—Big Data Analysis, Collaborative Interactive
Visualization, Dynamic Ontology, Palantir Gotham, Human-
diagram of Palantir's big data system architecture through data
Machine Collaboration collection and analysis, identifying and elucidating its key
technological components. Furthermore, through software
I. INTRODUCTION interface analysis and human-computer interaction analysis,
the paper identifies and summarizes three typical front-end
Palantir's big data analytics technology grounded in styles employed in Gotham's interactive visualization
dynamic ontologies, alongside its collaborative and analysis.
interactive analysis software supporting distributed geo-
environments, has achieved remarkable success across Finally, the paper shares insights gained in three areas:
military, defense, security, and commercial sectors, garnering human-machine collaborative analysis, the philosophy of
recognition from users in the military, government, and dynamic ontology, and collaborative interactive analysis.
various industries such as finance. Palantir's digital twin
modeling paradigm, which integrates data and models based II. OVERVIEW OF PALANTIR
on dynamic ontologies, coupled with its intuitive, wizard- A. Introduction to Palantir Technologies Inc.
driven modeling software tools and collaborative interactive
analysis tools, enables business users to bypass the constraints Palantir Technologies Inc. (Palantir for short) [1], founded
of complex programming to a certain extent, enabling them to in the United States in 2004, is a digital technology service
dynamically and swiftly leverage data for decision-making. provider and a big data technology company. Its clientele
encompasses military and government agencies, investment
This paper, after introducing Palantir Inc. and its product banks, etc. Palantir has long been dedicated to and excelled in
Palantir Gotham, selects a front-end analysis software tailored fusing dispersed, multi-source, and heterogeneous data into
*Corresponding author
Fig. 1. The Four Major Platform of Palantir [Source: Palantir Blog, Dolphin
Research]
770
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.
capabilities and functions of this software are summarized as In the Palantir platform, the definitions of Objects, Links,
follows: and Actions collectively constitute the so-called ontology—a
digital representation of the organization [8]. Objects can be
1) Key Capabilities categorized into regular entity objects and two types of special
• Interactive Analysis and Online Collaboration entity objects: Document and Event. Specifically, Document
• Real-time Data Integration, Sharing, and Computation Objects primarily refer to unstructured textual data content
itself, while Event Objects signify occurrences based on time.
• AI Integration and Capabilities
The basic mapping principles for structured data within the
• Dynamic Ontology-Related Capabilities Palantir ontology are illustrated in the diagram below:
2) Main Functions Datasets Palantir Ontology UML Element
• Interactive Analysis, Online Collaborative Analysis,
Online Approval Dataset Object Type Class
771
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.
in ontology modeling. The fundamental principle of utilizing
dynamic ontology in Gotham is rooted in its ability to
integrate diverse and heterogeneous data, transforming them
into the data object format utilized within Gotham. This
process can adapt to changes in clients' business models and
data sources, significantly streamlining the data integration
process. And by connecting underlying data and models to
their real-world business objects, Gotham allows users to
collaborate on dynamic knowledge assets in real-time [14].
[Prerequisite 1] [Step 1]
Should master SQL or other Define Action Type Change Name, Fig. 9. Palantir Dynamic Ontology[Source: Palantir]
programming skill Select Change object(s),chooes
[Prerequisite 2] Object Pacific and Modify property
Should master the underlying Name The Palantir Dynamic Ontology encompasses three layers
database tables
[Step 2]
of meaning:
AND type following code: Do the Action
UPDATE Table_shipinfo (1) Semantic Layer: its core components primarily consist
SET ship_name = 'Arctic'
Manger Ship
of dynamic objects & links, multi-modal attributes, and
WHERE Ship_id = 'S0001';
Amanda Pacific
ontology primitives. In this layer, by mapping existing data
table_shipinfo Ship Ship_Pacific
sources into ontology Objects, Object Properties, and Links
Change
ship_id ship_name ship_length Name ID S001
between Objects, it establishes a semantic foundation for the
Pacific Pacific Kinetic Layer. This foundation includes comprehensive
S0001 140 Name
Arcitc Arcitc metadata, fine-grained security controls, and governance over
... ... ... Length 140
all changes.
Fig. 8. Traditional Data Manipulation versus Ontology-based Data (2) Kinetic Layer: its core functionalities encompass AI-
Manipulation with ActionType driven actions and functions, process mining & automation,
action orchestration, and real-time monitoring. Building upon
As can be seen from Fig.8, traditional data operations the Semantic Layer, this layer leverages the Action Types
necessitate collaboration between business personnel and within the ontology to capture data during various operations,
developers, where developers must possess relevant orchestrate decision-making processes connected to existing
programming skills and an intimate understanding of the systems, and model organizational kinetics. Additionally, it
detailed definitions of database tables. This approach suffers provides Functions as a means to implement arbitrarily
from requiring a large number of personnel, lengthy complex business processing logic.
development timelines, high technical barriers, and an
obscured presentation of business logic. In contrast, by (3) Dynamic Layer: its core capabilities include AI-
utilizing Palantir's ontology-based Action Type for data powered decision-making, multi-step simulations, and
operations, business personnel can leverage a guided frontend decision capture & learning. Drawing from the core
software tool to select pre-defined ontology Objects based on components and functionalities of both the Semantic and
their own business processing logic. This approach requires Kinetic layers, this layer deeply integrates the ontology into
fewer personnel, simplifies operation definitions, lowers the user-facing front-end analysis and operational software,
technical threshold, and clearly presents business logic. enabling dynamic decision-making within human-computer
interactions.
2) Palantir Dynamic Ontology Technology
Dynamic ontology typically refers to the capability of This paper argues that the Palantir Dynamic Ontology
flexibly expanding, modifying, or deleting ontology content primarily exhibits the following three characteristics:
during system operation [9]. It enables automatic updates and (1) Highly Universal Meta-ontology Concepts and Highly
accomplishes data integration when data changes or new data Customizable Domain-specific Ontology Content: It
sources are added [10]. This is manifested primarily in aspects establishes top-level meta-ontology concepts such as "Entity,"
such as self-adjustability, dynamic generation, dynamic "Event," and "Document," which possess cross-domain
adjustment of models, and dynamic evolution of knowledge. universal applicability. Additionally, users can customize
Traditional ontology modeling software [11][12][13] ontology content relevant to their specific domains.
struggle to effectively support scenarios with frequent (2) Dynamic Maintenance and Updates to Maintain the
changes in requirements, especially when there are high Timeliness of Ontology Knowledge Information: The
demands for agility, timeliness, completeness, and ease of use
772
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.
dynamic ontology technology supports flexible modifications Fig.11 shows the example of Lineage in Palantir,
to existing ontologies, ensuring the timeliness of ontology illustrating the detailed lineage from raw data sourced from
knowledge information. It also enables auxiliary multiple structured database tables to the object entities within
modifications to existing objects, attributes, and relationships, the ontology [17]. This demonstration underscores how data
such as adding and modifying tags, icons, parsers, among is progressively reconstituted to align with the client's
others. objective world and business perspectives in terms of data
organization.
(3) Specialized Parsers for Attribute Types Facilitate
Heterogeneous Data Integration: It allows users to define
dynamic ontologies named "database." Through parsers,
multi-source heterogeneous data can be integrated, mapping
input data to the dynamic ontology. This feature simplifies the
integration process and enhances data interoperability.
B. Big Data System Technical Architecture for Integrated,
Secure, Collaboration and Related Technologies
1) Technical Architecture of Big Data
Through analyzing and organizing the software tools and
controls mentioned in Palantir's public materials [15][16], this
paper forms an understanding of its technical architecture for
big data systems:
Gotham- Foundry-
Application GAIA, Dossier, Video,
Monocle,Contour, Fusion, Object AIP
Explorer, Workshop, Vertex,
Layer Brifings, Graph, Table,
AVA, Chat, ...
Code Authoring, Quiver, AI/ML,
AI Product
Fig. 11. An Example of Lineage in Palantir [Source: Palantir]
Code Workshop, Reports, ...
Open Data Pluggable UI/Tools Explanation: In Fig.11, from left to right, the yellow
Analytic Import/Export Platform
Layer elements represent raw data, the green elements represent
Analytic API Palantir Web Palantir Workshop
cleaned data, the orange elements represent transformed data,
Persistent Faceted Search Unstructured the pink elements represent data processed through
Search Search Search Around Search parsing/NLP/ML, and the dark brown elements represent
Layer Search APIs REST WS ontologies.
Horizion
powered
773
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.
C. Human-centered Big Data Interactive Visualization and 2) Time-based Information Comparison
Analysis Technologies The software facilitates information comparison across
In section " Analysis of the Software’s Display Interface" different time points by providing a Timeline panel that
showcases fundamental interactive controls, where the display interacts with the main application interface. It also assists
interface design and the interconnectivity between controls, in with AI model recognition functionality for differential
conjunction with application designs that align with clients' annotation or directly presents AI model recognition results
business processing logic, provide users with convenient and comparison effects, as depicted in Fig.12-2.
heuristic and interactive analysis tools. Palantir is also 3) Space-based Query and Calculation
continuously engaged in research on how machines can better The software supports functions such as Collect satellite
assist and drive human operations. The samples of its patents imagery, Geosearch[22], and Create geofence[23], offering
related to human-computer interaction and visualization are business analysts intuitive and visual ways to access and view
presented in Table I and Table II [21]: information, as illustrated in F Fig.12-3.
TABLE I. SAMPLES OF PALANTIR'S PATENTS RELATED TO HUMAN-
COMPUTER INTERACTION AND VISUALIZATION [21]
No. Subhead
1 Systems and methods for visual definition of data associations
Topic Example
Selecting "Another type of user input device is cursor Fig. 12. Typical Frontend Pattern of Interactive Analysis in the Software
Customizable data control, such as a mouse, a trackball, or [Source: Palantir]
objects in graphs with cursor direction keys for communicating
nodes and edges direction information and command."
The collaborative interaction of this software is primarily
achieved through real-time online sharing of the current
Segmentation and "Rendering one or more graphical data
partitioning objects display widgets according to each display
interface and associated data, online sharing of Dossiers, as
using sets, claims, order value, which widget type and the well as collaboration facilitated by functions such as online
time series, and values widget configuration values" discussions and file sharing in Section III-B.
774
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.
such as cross-domain comprehension, creativity, moral aim to enhance the macro understanding, situational
judgment, and emotional communication. awareness, and change prediction capabilities of the dynamic
twin model, which is built upon a dynamic ontology and
Palantir has inherited the human-machine collaboration reflects the objective world, then it will lead to the formation
model from its founders' work on PayPal's security of an intelligent dynamic ontology.
authentication system [24], demonstrating the typical
application and validation of the human-machine symbiosis C. Innovating Interactive Visualization Analysis Tools
and collaboration concept in specific proprietary domains. Based on Big Data to Heuristically and Collaboratively
This article argues that in the business environment, Stimulate Collective Human Intelligence
clearly defining the functional boundaries and scopes of Palantir's developed and iteratively refined data analysis
human and system software, adopting human-centered design, products, widgets, and technologies (as shown in Fig. 5)
iteration, and optimization of technology, and achieving embody best practices in the field of data analysis, enabling
human-machine collaboration can maximize the strengths of better support for heuristic individual exploration and
both sides. On the one hand, it is necessary to establish human stimulating collaborative group analysis to a certain extent.
thinking patterns and interaction habits as the guiding This article believes that in the "human-machine"
principle, explore and research new interactive spaces formed information interaction, it is necessary to further study the
by Augmented Reality, Virtual Reality, brain-computer visualization of dynamic ontology models in Augmented
interfaces, etc. Technologies and tools that assist in enhancing Reality to assist human users in quickly and accurately
human users' insight generation and decision-making should forming decisions based on information and data in a way that
be studied, such as multi-modal information visualization and can be approximately encompassed by human vision and
interactive operation techniques associated with the ontology overarchingly understood by the human brain. Innovative
in AR space. On the other hand, within a unified data space research is needed in areas such as visual space information
based on dynamic ontology, it is essential to explore and visualization through Augmented Reality, high-sensitivity
research the application of AI and Agent technologies for virtual interaction operations in confined spaces, AI-assisted
automatic and autonomous subject relationship mining and multi-mode interaction decision-making technology. In terms
prediction, event expansion analysis and forecasting, etc. of improving the efficiency of "humans-machines", we should
B. Dynamic Ontology: Creating Digital Twins of Customer also conduct innovative research on visual interactive
Data and Models collaborative operation software and tools for a wider
geographical area, greater decentralization, more complex
Palantir adheres to the philosophical concept of ontology,
situations, and more teams and personnel, based on the
revolutionizing the traditional linear approach to data
analysis of business models and storage distributed big data
organization and processing. By constructing domain-specific
environments, such as distributed multi-seat human-machine
dynamic ontologies, it establishes mappings from data to
online analytical context sharing technology, temporary
ontologies and from ontologies to physical entities. These
offline environment analytical data caching and
mappings, validated and precise by humans, enable digital
synchronization technology, small group of adjacent units
twins across concepts, data, and processing logic. Instead of
temporary networking and interactive analysis technology,
working with fragmented, semantically impoverished, and
etc.
relationally unclear discrete data, customer business personnel
can now analyze and manipulate objects within dynamic VI. CONCLUSION
ontologies from their unique perspectives.
By analyzing the front-end analysis software within
IoT/
Real-time
Triditional Key Foundry Palantir's Gotham platform, this paper has identified the
Componets
primary capabilities and functionalities of the software. It has
ERP
preliminarily explored dynamic ontology technology, big data
CRM
system technical architectures, and human-centric interactive
visualization analysis techniques for big data. Furthermore,
insights have been gained regarding the benefits of human-
Foundry
computer collaboration and symbiosis in maximizing the
Digital Twin
Foundry Ontology strengths of both, the role of dynamic ontology in bridging
data and digital twins, and the innovation of human-centric
interactive visualization technologies. These findings lay a
solid foundation for subsequent in-depth research.
REFERENCES
Fig. 13. Presentation of Palantir Ontology Principles and Concepts [25] [1] Palantir. https://www.palantir.com/[EB/OL].(2023-06-14)
[2] Yibing Wang. The Rise of the Most Mysterious Unicorn: Palantir.
This article believes that ontology can reconstruct discrete https://new.qq.com/rain/a/20200705A0KZ1800[EB/OL].(2020-07-
data into information models that conform to human cognitive 06)
and thinking patterns, improving the efficiency of searching, [3] Uncovering the Core Technologies of Big Data Unicorn Palantir.
understanding, and generating insights from information and https://www.sohu.com/a/138760741_464065/[EB/OL].(2017-05-06)
data. Next, we need to conduct in-depth research on the [4] Dolphin Investment Research. Palantir : "Mysterious" Military
technology of dynamic ontology construction for multi-source Weapons Activated by AI.
and multi-modal data. Furthermore, leveraging the advantages https://www.36kr.com/p/2448673066506372/ [EB/OL].(2023-09-26)
of current LLMs in intent understanding and reasoning, we [5] Palantir-Gotham. https://www.palantir.com/platforms/gotham/
[EB/OL].(2023-06-14)
775
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.
[6] Leqing Think Tank. The Mysterious Big Data Unicorn Palantir: The [16] Secure Collaboration.
Exclusive Visualization Service Provider for the CIA. https://www.palantir.com/offerings/defense/secure-
https://baijiahao.baidu.com/s?id=1594469698778410206&wfr=spider collaboration/features/ [EB/OL].(2024-10-08)
&for=pc [EB/OL].(2018-03-09) [17] Palantir-Foundry-DataIntegration.
[7] Is it Really a Good Business? Exclusive Decoding of Palantir's https://www.palantir.com/platforms/foundry/data-integration/
Differentiated Competitive Advantages | In-Depth Research Report [EB/OL].(2023-10-16)
(Part II). https://xueqiu.com/2445992253/256975914 [EB/OL].(2023- [18] Palantir-Attributes-Security.
07-31) https://www.palantir.com/attributes/security/ [EB/OL].(2023-10-22)
[8] Palantir-Foundry-Getting started. [19] Palntir-Palantir and Data Protection.
https://www.palantir.com/docs/foundry/getting-started/introductory- https://www.palantir.com/offerings/data-protection/#right-to-be-
concepts/ [EB/OL].(2023-08-26) forgotten-module [EB/OL].(2023-10-22)
[9] Na Wang, Zhihui Jiang. Overview of Domestic and International [20] Introduction to Palantir Gotham, the Big Data Analysis Platform of
Research Status on Dynamic Ontology Construction [J]. Journal of Palantir. http://www.d1net.com/bigdata/news/322330.html
Modern Information, 2020, 040(004):159-166. [EB/OL].(2014-12-15)
[10] Xiang Li,Kun Liu,Yi Liu,Rui Liu,Qiang Wang. Research on [21] Andrew Iliadis & Amelia Acker (2022). The seer and the seen:
Reconstruction Methods of Implicit Relationships in Operational Data Surveying Palantir's surveillance platform.
Oriented to Dynamic Ontology [C]. China Command and Control https://doi.org/10.1080/01972243.2022.2100851 [EB/OL].(2022-08-
Conference, 2024. 23)
[11] [Protégé. https://protege.stanford.edu/ [EB/OL].(2023-08-11) [22] Geocoding and geosearch. https://doc.arcgis.com/en/arcgis-
[12] [TopBraid Composer. https://topbraidcomposer.org/html/ [EB/OL]. online/reference/geocode.htm [EB/OL].(2022-09-06)
(2023-08-11) [23] What is geofence?. https://proximi.io/geofence-complete-guide-
[13] WebODE. https://github.com/oeg-upm/webODE [EB/OL].(2023-08- geofencing/ [EB/OL].(2022-09-06)
11) [24] Alpha Factory. Palantir: Cathie Wood's Favorite, Silicon Valley's Most
[14] Palantir-Foundry-The Platform-Ontology. Mysterious Big Data Analysis Company.
https://www.palantir.com/foundry-explained-get-demo/#ontology https://baijiahao.baidu.com/s?id=1700710271263079773&wfr=spider
[EB/OL].(2023-09-10) &for=pc [EB/OL].(2021-05-25)
[15] Registration Statement on Form S-1 of Palantir Technologies Inc.. [25] Palantir-Foundry-Power next-generation operations.
https://www.sec.gov/Archives/edgar/data/1321655/000119312520230 https://www.palantir.com/foundry-explained-get-demo/
013/d904406ds1.htm#rom904406_11 [EB/OL].(2023-10-08) [EB/OL].(2023-11-11)
776
Authorized licensed use limited to: Gangneung Wonju National University. Downloaded on March 13,2025 at 08:19:40 UTC from IEEE Xplore. Restrictions apply.