Showing posts from January, 2025

DBA Index

DBA _RMAN-list-backup-summary - RMAN-list-backup-summary _Hostname from /etc/hostname & DNS domain name - Hostname …

Additional Index

Additional _Git and Github -  Git and Github _Hive -  Hive _Data Modeling -  Data Modeling _Data Processing-Batch vs Strea…

ADF Index

ADF _ADF Overview -  ADF Overview _Pipeline and Triggers -  Pipeline and Triggers _Azure Synapse -  Azure Synapse

Databricks Index

Databricks _Cloud Fundamental -  Cloud Fundamental _Databricks Fundamental -  Databricks Fundamental _Azure Storage, manag…

Pyspark Index

PySpark _Big-Data -  Big Data _HDFS Architecture -  HDFS Architecture _Distributed Processing -  Distributed Processing _C…

Apache Kafka

Apache Kafka: A Comprehensive Overview What is Apache Kafka? Apache Kafka is an open-source distributed event streaming p…

Structured Streaming

Here’s a document capturing the details you requested, with examples and code: Structured Streaming Concepts in Apache Sp…

Autoloader

Autoloader for Handling Streaming Data Autoloader is a solution designed to handle streaming data workloads, particularly…

Data Processing - Batch vs Stream

Data Processing in Spark: Batch vs Stream Processing Overview Data processing can be broadly classified into two types: …

Data Modeling

Data Modeling: In-depth Explanation with Examples 1. What is Data Modeling? Data modeling is the process of structuring …

Azure Synapse

Azure Synapse Analytics Overview Azure Synapse Analytics is a unified analytics service combining: Data Integration: Syna…

Pipeline creation and Triggers

Data Ingestion Using HTTP Connector in Azure Data Factory (ADF) Scenario: Ingest Order Dataset (  orders.csv , order_items.c…

ADF Overview

ADF Overview ADF is a serverless, fully managed service for data ingestion, basic transformations, and orchestration. Suit…

Unity Catalog

Unity Catalog in Databricks is a data governance solution that helps ensure security, access control, and metadata manage…

Lakehouse Architecture

Lakehouse Architecture vs. 2-Tier Data Warehouse Architecture: 1. Lakehouse Architecture The Lakehouse Architecture is a…

Load More
That is All