Introduction to Azure Cloud Computing

 

Introduction

 

Create Azure free subscription

 

Azure Portal overview

 

Azure Services Overview

 

Managed and Unmanaged Service

 

Resource Groups

 

Resource Provider

 

Tagging

 

Access Control

 

Demo – Create Azure SQL Database service

 

Delete resources and set budget

 

Conclusion

 

 

Introduction to Data Engineer Profile

 

Introduction

 

How did Data Engineer profile evolve?

 

Data Engineer role and responsibility

 

Introduction to Data Engineer technologies

 

Conclusion

 

 

Azure SQL Database Service for DBA and Developers

 

Introduction

 

Why choosing SQL Server in Azure

 

Azure IaaS vs PaaS database offerings

 

SQL Server PaaS deployment options

 

Further References from Microsoft Docs

 

 

Azure SQL Server in Virtual Machine (IaaS)

 

Introduction

 

SQL Server in Azure Virtual Machine

 

Demo – SQL Server in Azure Virtual Machine

 

 

Further References from Microsoft Docs

 

 

Azure Single Database

 

Introduction

 

Demo – Azure Single Database

 

Purchasing models and Service Tier

 

Azure Database vs Azure Data warehouse

 

Further References from Microsoft Docs

 

 

Elastic Database Pool

 

Introduction

 

Azure Elastic Database

 

Demo – Azure Elastic Database

 

Further References from Microsoft Docs

 

 

Managed Instance Database

 

Introduction

 

Azure Managed Instance Database

 

Difference between on-premises and Managed Instance

 

Migration options for Managed Instance

 

Service tiers for Managed Instance

 

Management operations

 

Demo – Managed Instance

 

Further References from Microsoft Docs

 

 

Azure Database Security

 

Introduction

 

Azure Database Security options

 

Azure Managed Instance advance security

 

Further References from Microsoft Docs

 

 

Data Warehouse – crash course

 

Module Introduction

 

Module Resources

 

 

Introduction to Azure Synapse Analytics Service

 

Introduction

 

Why warehousing in cloud

 

Traditional vs Modern Warehouse architecture

 

Azure Synapse a Game changer

 

Azure Synapse Benefits

 

Modern vs Azure Synapse Architecture

 

Demo Azure Synapse Analytics

 

Azure Synapse Studio

 

Synpase unified experience

 

 

Azure Synapse Internal and Architecture

 

Introduction

 

Azure Synapse MPP Architecture

 

Storage and Sharding patterns

 

Data Distribution and Distributing Keys

 

Data Types and Table Types

 

Partitioning

 

Best Practices for Fact and Dimension tables

 

Demo – Analyse data distribution before migration to azure

 

Summary

 

 

Data Migration to Azure Synapse Data Warehouse

 

Introduction

 

 best practices for Data Load

 

DIfferent loading methods

 

Loading with SSIS vs PolyBase

 

Demo – Loading with SSIS

 

Demo – Loading with Polybase

 

Demo – Loading with Data Factory

 

Summary

 

 

Security layers in Azure Synapse Service

 

Introduction

 

Advance Data Security

 

Auditing

 

Network Security

 

Transparent data encryption

 

Dynamic Data Masking

 

Access Management

 

Summary

 

 

Configuring and Optimizing Azure Synapse Service

 

Introduction

 

Configuration Options

 

Performing other tasks

 

Backup and Restore

 

Price Optimization

 

Managing Workloads

 

Monitoring

 

Support and Troubleshooting

 

Delete Resources

 

Summary

 

Introduction to Azure Data Lake

 

Problem statement

 

How Data Lake can solve this problem?

 

Data Lake vs SSIS vs Hadoop vs DW

 

Advantages of Data Lake

 

Data Lake Storage vs Analytics

 

 

Demo – Data Lake

 

Requirement

 

Create Data Lake Accounts

 

How to upload data in Data Lake

 

Write U-SQL Script to transform data

 

Schedule a job in Data Lake

 

Summary

 

 

Introduction to Azure Data Factory

 

Data Life Cycle

 

Azure Solutions

 

What is Azure Data Factory

 

Key components of Data Factory

 

Pipeline workflow –  steps

 

 

Demo – Data Factory

 

Module Introduction

 

Create Azure Data Lake Storage Gen  Account

 

Deploy Azure SQL Data Warehouse

 

Deploy Data Factory

 

Getting familiar with Azure Data Factory UI

 

ETL Operation

 

Permissions

 

Data Factory Monitoring

 

 

HDInsight 

 

Hadoop – crash course

 

HDInsight overview

 

 

Introduction to HDInsight

 

Why Hadoop is Hard

 

How HDInsight make Hadoop Easy

 

Important aspects of HDInsight

 

HDInsight cluster types

 

HDInsight Architecture

 

 

Demo – HDInsight

 

Demo overview

 

Create Azure Data Lake Storage Gen  (source) and SQL Server (destination)

 

What is Managed Identity

 

Add Managed Identity to Gen and Database accounts

 

Create HDInsight Interactive Query Cluster

 

Ambari overview and UI

 

Ingest dataset in to DataLake storage

 

Data Extraction with Hive

 

Data transformation with Hive

 

Data Export with Sqoop

 

Summary

 

 

Cloud Computing basics for absolute beginners

 

Introduction

 

Why we need a cloud computing

 

What is cloud computing

 

Benefits of Cloud computing

 

Cloud Deployment models

 

Types of cloud services

 

AWS vs Azure vs Google

 

Conclusion

 

 

Data Warehouse crash course for absolute beginners

 

Introduction

 

What is Data Warehouse

 

Why we need Data Warehouse

 

Ideal Data Warehouse Solution

 

Responsibilities of Data Warehouse designer

 

SQL Server vs Data Warehouse

 

Dimensional Modeling

 

Facts and Fact Table

 

Dimensions and Dimension table

 

Star vs Snowflake

 

Summary

 

 

Hadoop crash course for absolute beginners

 

Hadoop overview

 

Why we need distribute computing?

 

Two ways to build system

 

Introducing Hadoop

 

Hadoop vs RDBMS

 

Hadoop Ecosystem

 

Hadoop Summary

 

 

Wrapping up

 

Bonus Lecture