Apache Spark

Hadoop

Apache Hadoop is an open-source framework for distributed storage and processing of very large datasets across clusters of commodity servers, using simple prog…

BigQuery

BigQuery is Google Cloud's fully managed, serverless data warehouse that lets users run fast SQL analytics over massive datasets without provisioning or managi…

Dagster

Dagster is an open-source, Python-based data orchestration platform that lets teams define, schedule, test, and monitor data pipelines as software assets with…

Databricks

Databricks is a cloud-based data and AI platform, built by the original creators of Apache Spark, that unifies data engineering, analytics, and machine learnin…

Scala

Scala is a statically typed programming language that runs on the Java Virtual Machine, combining object-oriented and functional programming paradigms and inte…

MinIO

MinIO is a high-performance, open-source object storage system that implements the Amazon S3 API, letting teams run S3-compatible storage on their own infrastr…

Apache Kafka

Apache Kafka is an open-source distributed event streaming platform used to publish, subscribe to, store, and process high-throughput streams of records in rea…

Apache NiFi

Apache NiFi is an open-source data integration tool that lets teams design, automate, and monitor data flows between systems using a visual, drag-and-drop inte…

Apache Spark

Apache Spark is a unified, open-source analytics engine for large-scale distributed data processing, offering in-memory computation and built-in modules for SQ…

Apache Storm

Apache Storm is an open-source, real-time distributed stream computation system designed to process high-velocity, unbounded data streams with low latency, arr…

Apache Zeppelin

Apache Zeppelin is a web-based notebook that enables interactive, collaborative data analytics, supporting multiple language and engine backends — including Sp…

Apache Solr

Apache Solr is an open-source enterprise search platform built on the Lucene search library, providing full-text search, faceted navigation, and distributed in…

Apache

The Apache Software Foundation (ASF) is a US-based non-profit organization, founded in 1999, that provides legal, financial, and organizational support for hun…

Apache Airflow

Apache Airflow is an open-source platform for programmatically authoring, scheduling, and monitoring data and workflow pipelines, defined in Python as Directed…

Apache Cassandra

Apache Cassandra is an open-source, distributed NoSQL wide-column database designed for high write throughput, linear horizontal scalability, and continuous av…

Apache Druid

Apache Druid is a real-time analytics database built for fast, interactive OLAP queries and sub-second aggregations over large streaming and batch event datase…

Apache Flink

Apache Flink is an open-source distributed stream-processing framework for stateful computations over both unbounded (streaming) and bounded (batch) data at sc…

Apache Hive

Apache Hive is a data warehouse system built on top of Hadoop that lets users query and manage large distributed datasets using HiveQL, a SQL-like query langua…

Apache HBase

Apache HBase is an open-source, distributed, column-oriented NoSQL database modeled after Google's Bigtable, built to run on top of the Hadoop Distributed File…

Apache Ignite

Apache Ignite is an open-source, distributed database and in-memory computing platform that combines a distributed key-value store, SQL engine, and compute gri…

Delta Lake

Delta Lake is an open-source storage layer and table format, originally developed by Databricks, that brings ACID transactions, schema enforcement, and time tr…

Apache Hudi

Apache Hudi (Hadoop Upserts Deletes and Incrementals) is an open-source data lake table format and framework that enables efficient upserts, deletes, and incre…