Hadoop
Apache Hadoop is an open-source framework for distributed storage and processing of very large datasets across clusters of commodity servers, using simple programming models to scale from a single machine to thousands of nodes.
19 resources across 2 libraries
Glossary Terms(7)
Hadoop
Apache Hadoop is an open-source framework for distributed storage and processing of very large datasets across clusters of commodity servers, using simple prog…
Apache Spark
Apache Spark is a unified, open-source analytics engine for large-scale distributed data processing, offering in-memory computation and built-in modules for SQ…
Apache Hive
Apache Hive is a data warehouse system built on top of Hadoop that lets users query and manage large distributed datasets using HiveQL, a SQL-like query langua…
Apache ZooKeeper
Apache ZooKeeper is an open-source distributed coordination service that provides a hierarchical key-value store, consensus, and primitives such as locks and l…
Apache HBase
Apache HBase is an open-source, distributed, column-oriented NoSQL database modeled after Google's Bigtable, built to run on top of the Hadoop Distributed File…
Presto
Presto is an open-source, distributed SQL query engine designed to run fast, interactive analytic queries against data of any size, spanning multiple data sour…
Apache Drill
Apache Drill is an open-source, schema-free SQL query engine designed for interactive analysis of large-scale datasets across files, NoSQL databases, and cloud…
Study Notes(12)
Spark vs Hadoop MapReduce
How Spark's in-memory DAG execution model compares to classic Hadoop MapReduce in performance, fault tolerance, and use cases.
What Is Apache Spark?
An introduction to Apache Spark as a unified, in-memory distributed computing engine and why it replaced Hadoop MapReduce for many workloads.
Hadoop Best Practices
A practical guide to designing, tuning, and operating Hadoop clusters so they stay reliable and performant as data volumes grow.
Hadoop Daemons
What NameNode, DataNode, ResourceManager, NodeManager, and the other Hadoop background processes actually do, and how they interact.
Hadoop Interview Questions
The core HDFS, MapReduce, and YARN questions Hadoop interviewers ask most often, with the reasoning behind strong answers.
Hadoop Quick Reference
A condensed cheat sheet of the HDFS and YARN commands, key configuration properties, and defaults you reach for daily.
Hadoop Security with Kerberos
How Kerberos authentication secures a Hadoop cluster, covering the KDC, tickets, keytabs, SPNEGO, delegation tokens, and how authorization layers like Ranger b…
Hadoop vs Spark
A technical comparison of MapReduce's disk-based batch model and Spark's in-memory DAG execution, and when to reach for each.
Setting Up a Hadoop Cluster
A practical walkthrough of planning and configuring a Hadoop cluster, from single-node pseudo-distributed setups to multi-node production layouts.
The Hadoop Ecosystem
A tour of the major projects that surround core Hadoop — Hive, Pig, HBase, Sqoop, Flume, ZooKeeper, and Oozie — and how they fit together.
What Is Hadoop?
An introduction to Apache Hadoop, the open-source framework that popularized distributed storage and processing of massive datasets on commodity hardware.
Your First Hadoop Job
A hands-on walkthrough of writing, packaging, and running a classic word count MapReduce job on Hadoop, from source to output.