Azure
is a versatile cloud platform that can meet the needs of organizations across a
wide range of industries and use cases, and its continued growth and
investment by Microsoft make it a reliable choice for organizations looking to
take advantage of the benefits of cloud computing.
The
objective of Infyni's Azure for Data Engineering Live Training is to equip
participants with the skills needed to design and implement data storage,
processing, and transformation solutions using Azure. All classes are live and
online, with an instructor. You will also be accompanied in every class by a
Moderator dedicated to the course. In case of any difficulty or academic
challenge, we encourage you to reach out to your Moderator for help and
support.
You
will learn :
This
live online course is best for professionals who already know SQL and Python.
Your instructor is an excellent trainer with more than 12 years of experience
in the software industry. Both as a passionate trainer and an industry expert
your interactive sessions with him are a great opportunity to learn the
fundamentals of Azure.
Take
a detailed look at the curriculum to know what is included in your
course.
The
demand for Azure Data Engineers is growing as more organizations adopt cloud
computing and seek to leverage the benefits of big data and advanced
analytics. To read why a career as an Azure Data Engineer can be a good
choice check our blog section.
Join
us for a free live trial with our expert Azure engineer to answer all your
doubts.
Introduction to Big Data (Classification and Characteristics)
Drawbacks of RDBMS
Challenges of Big Data
Sources of Big Data
Distributed Systems
What is Data Engineering, Roles and Responsibilities
Data Pipelines and types
Hadoop 2.x and Core Components
Hadoop Daemons
Hadoop Architecture
HDFS File Blocks
HDFS Architecture
Introduction to YARN and Architecture
YARN Application Execution Flow
Overview of Apache Spark
Data Sharing in MapReduce vs Apache Spark
Exploring Spark Ecosystem
RDD's : Basic Building Block
Partitions
Starting Spark Shell 
Introduction to Microsoft Azure
Resource Groups
Introduction to Microsoft Azure
Resource Groups
Introduction to Azure Databricks
Signup for the Azure Account
Launch Azure Workspace and Databricks Cluster
Upload Data
Databricks Clusters
Databricks Notebook Introduction (Create, Import and Export)
Magic Commands
Databricks Mounts
Develop Spark Application using Azure Databricks
Performing ETL Operations using Azure Databricks
Export and Import Databricks Notebooks
Getting Started with Azure CLI
Create Resource Group using Azure CLI
Databricks CLI - Installing and Authenticating
Databricks CLI - Clusters
Databricks CLI - Workspaces
Databricks CLI - DBFS
Databricks CLI - Libraries
Databricks CLI - Jobs
Databricks CLI - Secrets
Create and Upload data to ADLS File System or Container
Mount ADLS on to Azure Databricks to access files from Azure Blob Storage
Creating and ADLS Gen2 Account
Storage Explorer
Accessing via Access Keys
Accessing via SAS Token
Mounting ADLS to DBFS Overview
Data Lake House Architecture
Medallion Architecture
Delta Lake
Read and Write to Delta Table
Schema Validation
Incremental ETL Loads
API Selection
Caching and Persistence
Broadcast Variables
Optimizing Spark Joins
Memory Partitioning
What is Azure Synapse Analytics
Compute Options
Modern Data Warehouse Architecture
I have more than 12 years of experience in IT industry working at Cisco, Oracle, HP, YAHOO, NOKIA, IT2 Automate along with teaching technology, which is my passion. I take trainings online for Corporate Clients, Universities and Professionals & create my own syllabus and have done about 100+ mentorship sessions for multiple clients. My technical training covers Software Development, Test Automation & Data Engineering, using Java, Python, Spark, Kafka. Take a live class with me to learn well.
Ratings
Reviews
Students
Courses
Infyni's Data Engineering with Datbricks course is a very good training for those who want to learn the latest technology. Instructor Naveen is covering all the fundamentals in his training.
"This course was very good.
"The pace of the lectures were very fast.
"Great course! It helped me bridge my beginner-level understanding of Azure to working confidently with Data Bricks.
"I have a decent grasp of data engineering, and this course helped me transition to using Azure for Data Bricks.
"I expected more in certain topics. However, the practical were valuable."
"I'm relatively new to data engineering, but this made it easy to grasp complex Azure concepts.
"I found this course really helpful for diving into Azure Data Bricks.