-
Module 1: Core concepts
11 Lessons-
StartModule introduction
-
StartRole of Integration in modern analytics
-
StartCommon loading patterns - ETL vs ELT
-
StartOn-premises tooling vs cloud-based tooling
-
StartWhat are pipelines?
-
StartWhat is Azure Data Factory (ADF)?
-
StartWhat is Fabric Data Factory (FDF)?
-
StartCore Data Factory components
-
StartDifferences between ADF and FDF
-
StartPros and cons of each Data Factory platform
-
StartQuiz 1
-
-
Module 2: Provisioning data factories
10 Lessons-
StartModule introduction
-
StartCreating an Azure Resource Group
-
StartCreating an Azure Data Factory
-
StartUsing ADF with and without source control
-
StartConnecting source control
-
StartUsing ADF Studio
-
StartCreating a Fabric Workspace and Data Factory
-
StartUsing Fabric Studio
-
StartLab 2
-
StartQuiz 2
-
-
Module 5: Implementing workflow logic in pipelines
17 Lessons-
StartModule introduction
-
StartPipeline workflow
-
StartCommon activity settings
-
StartWait activity
-
StartCommon activity actions
-
StartVariables
-
StartSet Variable activity
-
StartExpression language
-
StartAppend Variable activity
-
StartIf Condition activity
-
StartImplementing For Each loops
-
StartImplementing While Until loops
-
StartFilter activity
-
StartSwitch activity
-
StartLogical AND vs logical OR
-
StartLab 5
-
StartQuiz 5
-
-
Module 7: Triggering pipeline execution
11 Lessons -
Module 8: Working with common activities
13 Lessons -
Module 9: Managing integration runtimes
11 Lessons-
StartModule introduction
-
StartIntegration runtimes
-
StartAzure integration runtimes
-
StartSelf-hosted integration runtimes
-
StartLinking and sharing integration runtimes
-
StartSQL Server Integration Services
-
StartExecuting SSIS packages in ADF
-
StartAzure SSIS integration runtimes
-
StartSSIS IR cost implications
-
StartLab 9
-
StartQuiz 9
-
-
Module 10: Working with data flows
10 Lessons -
Module 11: Managing pipelines
13 Lessons-
StartModule introduction
-
StartDebugging pipelines
-
StartAnnotations
-
StartUser properties
-
StartDefining dynamic connections by using expressions
-
StartMonitoring ADF pipelines
-
StartSending alerts on failure
-
StartCopying JSON to create pipelines
-
StartUseful 3rd party deployment utilities and tools
-
StartGit Integration in Fabric
-
StartMonitoring FDF pipelines
-
StartLab 11
-
StartQuiz 11
-
-
Module 12: Managing Data Factory security
14 Lessons-
StartModule introduction
-
StartIdentity concepts in Azure
-
StartRBAC based security
-
StartSystem-assigned managed identities
-
StartUser-assigned managed identities
-
StartWorkspace identities in FDF
-
StartUsing managed identities in connections
-
StartAzure Key Vault
-
StartIntegrating ADF with Azure Key Vault
-
StartIntegrating FDF with Azure Key Vault
-
StartUsing key vault secrets in connections
-
StartConnecting via private endpoints
-
StartLab 12
-
StartQuiz 12
-
-
Module 13: Medium complexity worked example
9 Lessons -
Module 14: Very detailed worked example (medium complexity)
17 Lessons-
StartModule introduction
-
StartProblem to solve
-
StartOverall solution design
-
StartCreate resource group
-
StartCreate and configure storage account
-
StartCreate SQL database
-
StartCreate data factory
-
StartConfigure linked services
-
StartUpload test files
-
StartCreate datasets
-
StartCreate and test file move pipeline
-
StartCreate incremental load pipeline
-
StartAdd and test loop for file processing
-
StartCreate database objects
-
StartAdd database processing to file processing loop
-
StartTest completed pipeline
-
StartFurther thoughts
-
-
Module 15: Complex worked example
17 Lessons-
StartModule introduction
-
StartProblem to solve
-
StartOptions considered
-
StartOverall solution design
-
StartFile in storage account
-
StartTesting requirements
-
StartFirst attempt - add dataset reference
-
StartCorrect multipart form data
-
StartAttachment file contents
-
StartReturned preview data
-
StartMultipart form data format
-
StartWeb request content type and body
-
StartConfigure the web activity for upload
-
StartHTTP request timeout
-
StartLine endings
-
StartRequirement achieved
-
StartFurther thoughts
-
-
Module 16: Advanced ADF and FDF concepts
9 Lessons
