DataHub Integrations

Aerospike is a high-performance NoSQL database designed for real-time applications requiring low latency and high throughput at scale.

Open-source data integration platform for syncing data from APIs, databases, and files to warehouses and lakes.

Airflow is an open-source data orchestration tool used for scheduling, monitoring, and managing complex data pipelines.

Fully managed Apache Kafka service available across major cloud providers with built-in monitoring and security.

Fully managed PostgreSQL-compatible database service on Google Cloud designed for demanding enterprise workloads.

Self-service data analytics platform for data preparation, blending, and advanced analytics workflows.

AWS managed service for delivering streaming data to S3, Redshift, OpenSearch, Snowflake, Apache Iceberg, and MongoDB (formerly Amazon Kinesis Data Firehose). Ingested via the unified `kinesis` connector.

AWS real-time data streaming service for collecting, processing, and analyzing data streams at any scale.

Fully managed Apache Kafka service on AWS for building and running streaming data applications.

AWS serverless business intelligence service for creating interactive dashboards and visualizations.

Cloud-based enterprise planning platform for financial planning, supply chain, and workforce planning.

Unified programming model for defining and executing both batch and streaming data processing pipelines.

High-performance real-time analytical database based on MPP architecture for large-scale data analytics.

Apache Hudi is an open-source data lake framework that provides ACID transactions, efficient upserts, time travel queries, and incremental data processing for large-scale datasets.

Open-source massively parallel processing SQL query engine for data stored in Apache Hadoop.

Athena is a serverless interactive query service that enables users to analyze data in Amazon S3 using standard SQL.

Azure AD is a cloud-based identity and access management tool that provides secure authentication and authorization for users and applications.

Azure Blob Storage is a cloud-based object storage service that allows users to store and manage large amounts of unstructured data.

Globally distributed, multi-model NoSQL database service on Azure for mission-critical applications.

Cloud-based data integration service for creating, scheduling, and orchestrating data pipelines at scale.

Cloud-native data streaming service on Azure with native Apache Kafka support for real-time event ingestion.

Fast and scalable data exploration service optimized for log and telemetry data analytics.

Fully managed relational cloud database service built on SQL Server for modern application development.

Integrated analytics service on Azure that combines enterprise data warehousing with big data analytics.

Enrich DataHub datasets with BigID classification and governance metadata: GlossaryTerms, Tags, risk scores, IDSoR correlation results, and profiles.

BigQuery is a cloud-based data warehousing and analytics tool that allows users to store, query, and analyze large datasets quickly and efficiently.

Ingest a comprehensive list of business terms, definitions, and term hierarchies into DataHub from a YAML-based business glossary file.

Apache Cassandra is a distributed NoSQL database designed to handle large amounts of data across many commodity servers.

ClickHouse is an open-source column-oriented database management system designed for high-performance data processing and analytics.

CockroachDB is a distributed SQL database that provides strong consistency, high availability, and horizontal scalability.

Atlassian's team workspace for creating, organizing, and collaborating on documentation and knowledge bases.

Enterprise-grade data streaming platform built on Apache Kafka with schema registry, governance, and managed cloud service.

Distributed NoSQL cloud database for enterprise applications with built-in full-text search and analytics.

Distributed SQL database built on a shared-nothing architecture for machine data and IoT workloads.

An ingestion source for enriching metadata provided in CSV format provided by DataHub

Import cubes, views, measures, and dimensions from the Cube semantic layer, including view-to-cube and warehouse lineage.

Dagster is a next-generation open source orchestration platform for the development, production, and observation of data assets.

Databricks is a cloud-based data and AI platform built on Apache Spark, used for data engineering, analytics, and machine learning workflows.

Integrate your open source DataHub instance with DataHub Cloud or other on-prem DataHub instances

DataHub utility for applying metadata changes and configurations to your DataHub instance.

DataHub utility for debugging and diagnosing metadata issues in your DataHub instance.

DataHub utility for ingesting and managing documentation assets, runbooks, and tribal-knowledge documents stored in DataHub.

DataHub garbage collection utility for cleaning up stale metadata and soft-deleted entities.

IBM's enterprise relational database management system for transactional and analytical workloads.

dbt is a data transformation tool that enables analysts and engineers to transform data in their warehouses through a modular, SQL-based approach.

Delta Lake is an open-source data lake storage layer that provides ACID transactions, schema enforcement, and data versioning for big data workloads.

Demo Data is a data tool that provides sample data sets for demonstration and testing purposes.

Open-source Python library for building data pipelines. Ingest pipeline metadata and lineage from dlt runs into DataHub.

Cloud-based business intelligence platform with data integration, visualization, and collaboration capabilities.

Dremio is a data lake engine that provides fast, direct access to data lake storage with enterprise-grade security and governance.

Druid is an open-source data store designed for real-time analytics on large datasets.

DynamoDB is a fully managed NoSQL database service that provides fast and predictable performance with seamless scalability.

Elasticsearch is a distributed, open-source search and analytics engine designed for handling large volumes of data.

High-performance in-memory analytics database optimized for data warehousing and analytics workloads.

Microsoft Excel spreadsheet integration for importing metadata definitions and enrichment data.

Microsoft Fabric Data Factory is a cloud-based data integration service for building and orchestrating data pipelines within the Microsoft Fabric platform.

Microsoft Fabric's unified data lake for storing and managing all organizational data in one place.

Feast is an open-source feature store that enables teams to manage, store, and discover features for machine learning applications.

Ingest metadata from a JSON file containing pre-generated DataHub MCEs/MCPs — useful for backfills, debugging, and offline pipelines.

File Based Lineage is a data tool that tracks the lineage of data files and their dependencies.

Fivetran is a cloud-based data integration platform that provides automated data pipelines for analytics and business intelligence.

Real-time stream processing framework for stateful computations over bounded and unbounded data streams.

Import files and documentation from GitHub repositories into DataHub as Documents, keeping them discoverable and governed alongside the rest of your metadata. Ingested on a schedule through UI or CLI ingestion.

Glue is a data integration service that allows users to extract, transform, and load data from various sources into a data warehouse.

Fully managed, scalable NoSQL database service for large analytical and operational workloads on Google Cloud.

Google Cloud's intelligent data fabric for unified data management, governance, and analytics across data lakes and warehouses.

Google Cloud Storage is a unified object storage service that provides industry-leading durability and availability for data.

Grafana is an open-source analytics and monitoring platform that allows users to query, visualize, and alert on metrics and logs.

Great Expectations is an open-source data validation and testing tool that helps data teams maintain data quality and integrity.

Open-source massively parallel processing data warehouse based on PostgreSQL for large-scale analytics.

Hex is a collaborative data workspace that allows teams to explore, analyze, and share data insights through interactive notebooks.

Reverse ETL platform that syncs data from your warehouse to business tools like CRMs, ad platforms, and SaaS apps.

Hive is a data warehousing tool that facilitates querying and managing large datasets stored in Hadoop Distributed File System (HDFS).

Hive Metastore (HMS) stores metadata for Hive, Presto, Trino, and Spark in a backend RDBMS such as MySQL or PostgreSQL.

Enterprise business intelligence suite for interactive dashboards, reports, and AI-powered data exploration.

Iceberg is a data tool that allows users to manage and query large-scale data sets using a distributed architecture.

Enterprise data integration and management platform for ETL, data quality, and master data management.

Informix is a relational database management system from IBM/HCL used for transactional and analytical workloads.

JSON Schemas is a data tool used to define the structure, format, and validation rules for JSON data.

Kafka is a distributed streaming platform that allows for the processing and storage of large amounts of data in real-time.

Kafka Connect is an open-source data integration tool that enables the transfer of data between Apache Kafka and other data systems.

LDAP (Lightweight Directory Access Protocol) is a data tool used for accessing and managing distributed directory information services over an IP network.

Open-source BI tool that connects to your dbt project to provide self-serve analytics and exploration.

Looker is a business intelligence and data analytics platform that allows users to explore, analyze, and share data insights in real-time.

MariaDB is an open-source relational database management system that is a fork of MySQL.

Import pipelines, streaming pipelines, projects, environments, and table/column-level lineage from Matillion Data Productivity Cloud.

Metabase is an open-source business intelligence and data visualization tool that allows users to easily query and visualize their data.

Unified analytics platform from Microsoft that integrates data engineering, data science, warehousing, and real-time analytics.

Enterprise analytics and mobility platform for business intelligence, dashboards, and reporting.

MLflow is an open-source platform for managing the end-to-end machine learning lifecycle.

Mode is a cloud-based data analysis and visualization platform that enables businesses to explore, analyze, and share data in a collaborative environment.

MongoDB is a NoSQL database that stores data in flexible, JSON-like documents, making it easy to store and retrieve data for modern applications.

Data observability platform that detects, resolves, and prevents data quality issues across your data stack.

MySQL is an open-source relational database management system that allows users to store, organize, and retrieve data efficiently.

Neo4j is a graph database management system that stores data in nodes and relationships, enabling complex graph queries and analytics.

NiFi is a data integration tool that allows users to automate the flow of data between systems and applications.

Notion is an all-in-one workspace for notes, docs, wikis, and project management. Ingest pages and databases as DataHub datasets.

Okta is a cloud-based identity and access management platform that enables secure single sign-on across applications and devices.

Omni is a business intelligence and analytics platform that combines SQL, spreadsheets, and no-code exploration for collaborative data analysis.

Open Data Contract Standard (ODCS), governed by the Linux Foundation's Bitol project, is a YAML specification for data contracts. Ingest ODCS files as logical datasets with schema, ownership, tags, and quality rules modeled as assertions.

OpenAPI is a specification for building and documenting RESTful APIs. Ingest endpoints and schemas as DataHub datasets and lineage.

Open standard for data lineage collection and analysis. DataHub supports OpenLineage via a native REST endpoint and Spark event listener plugin.

Oracle is a relational database management system that provides a comprehensive and integrated platform for managing and analyzing large amounts of data.

Pinecone is a vector database designed for building fast, scalable similarity search and AI-powered applications.

Real-time distributed OLAP datastore designed for low-latency analytics on large-scale datasets.

Postgres is an open-source relational database management system that provides a powerful tool for storing, managing, and analyzing large amounts of data.

Power BI is a Microsoft business analytics service that provides interactive visualizations and self-service business intelligence dashboards.

On-premises report server for hosting and managing Power BI reports, paginated reports, and KPIs.

Prefect is a modern workflow orchestration for data and ML engineers.

Preset is a cloud-native business intelligence platform that provides self-service analytics and data visualization capabilities.

Presto is an open-source distributed SQL query engine designed for fast and interactive analytics on large-scale data sets.

Protobuf Schemas is a data tool used for defining and serializing structured data in a compact and efficient manner.

Pulsar is a real-time data processing and messaging platform that enables high-performance data streaming and processing.

Qlik Sense is a business intelligence and data analytics platform that enables users to create interactive visualizations and dashboards.

RDF (Resource Description Framework) is a standard model for data interchange. Ingest ontologies and knowledge graphs as DataHub glossary terms.

Redash is a data visualization and collaboration platform for connecting to data sources and building interactive dashboards.

Kafka-compatible streaming data platform built for mission-critical workloads without ZooKeeper.

Redshift is a cloud-based data warehousing tool that allows users to store and analyze large amounts of data in a scalable and cost-effective manner.

Amazon S3 is a cloud object storage service for storing and analyzing data files at scale, commonly used as a data lake foundation.

SAP Analytics Cloud (SAC) is a cloud-based business intelligence and planning platform that provides analytics and planning capabilities.

SageMaker is a data tool that provides a fully-managed platform for building, training, and deploying machine learning models at scale.

Salesforce is a cloud-based CRM platform that helps businesses manage sales, marketing, customer service, and analytics activities.

SAP Datasphere is a cloud data warehouse and data-fabric service for integrating, modeling, and governing data across an organization.

SAP HANA is an in-memory data platform that enables businesses to process large volumes of data in real-time.

Sigma is a cloud-native analytics and business intelligence platform that provides spreadsheet-like interface for data analysis.

Distributed SQL database designed for real-time analytics and transactional workloads in a single unified engine.

Embedded analytics platform for building and integrating data-driven insights into products and workflows.

Send notifications to Slack channels for entity changes, assertions, and incidents in DataHub. Includes user discovery from Slack workspaces.

SnapLogic is an enterprise iPaaS that connects applications, data sources, and APIs across cloud and on-premises environments via low-code workflows.

Snowflake is a cloud-based data warehousing platform that allows users to store, manage, and analyze large amounts of structured and semi-structured data.

Open-source behavioral data platform for collecting, processing, and modeling event-level data.

Data quality platform for testing, monitoring, and profiling data with checks defined as code.

Spark is a data processing tool that enables fast and efficient processing of large-scale data sets using distributed computing.

Open-source data lineage tracking and visualization tool for Apache Spark pipelines.

DataHub utility for ingesting SQL query metadata and lineage from query log files, generating column-level lineage between datasets.

Microsoft SQL Server is a relational database management system designed to store, manage, and retrieve data efficiently and securely.

SQLAlchemy is a Python-based data tool that provides a set of high-level API for connecting to relational databases and performing SQL operations.

SQLMesh is an open-source data transformation framework for building and operating versioned, SQL-native model pipelines with built-in data quality audits. DataHub ingests SQLMesh models as datasets with schema, column-level lineage, descriptions, tags, and audit assertions, and stitches each model to its warehouse view as a sibling. Multi-gateway projects are supported, with each model's sibling routed to the correct warehouse platform automatically.

SQL Server Integration Services — Microsoft's enterprise ETL platform for data migration, transformation, and workflow automation.

High-performance analytical database for real-time, multi-dimensional analytics at scale.

Apache Superset is an open-source data exploration and visualization platform for building interactive dashboards and ad-hoc analysis.

Tableau is a data visualization and business intelligence tool that helps users analyze and present data in a visually appealing and interactive way.

Open-source and enterprise data integration platform for ETL, data quality, and cloud data management.

Teradata is an enterprise data warehouse platform for storing, managing, and analyzing large volumes of structured data at scale.

AI-powered analytics platform with natural language search for self-service business intelligence.

TiDB is an open-source, distributed SQL database compatible with the MySQL protocol and ecosystem.

Open-source time-series database built on PostgreSQL for fast analytics on time-series data.

Trino is an open-source distributed SQL query engine for fast analytics on large-scale data warehouses, lakes, and federated sources.

Vertex AI is Google Cloud's machine learning platform that provides tools for building, training, and deploying ML models at scale.

Vertica is a high-performance, column-oriented, relational database management system designed for large-scale data warehousing and analytics.