In this Part 2 video of CI/CD in Azure Databricks, I discussed the different environment configurations required for building CI/CD pipelines. Things like Azure DevOps integration with the Azure Databricks workspace, branch protection, and merge techniques are demonstrated in this demo video.

The next parts will be posted online soon, stay tuned!

Part #3. Creating a CI Pipeline
Part #4. Creating a CD Pipeline and Testing

Here's what you'll see in this video:

0:00:00 – Introduction
0:02:10 – Creating the Azure DevOps Git repository
0:05:51 – Git integration in Azure Databricks
0:11:23 – Branch protection
0:20:13 – Merging changes to Main
0:28:00 – Exit

– – – Book a private appointment with me (1 hour) – – –

https://www.buymeacoffee.com/mrktalkstech/e/166354

– – – /“Express your encouragement by making me a cup of support/” – – –

https://www.buymeacoffee.com/mrktalkstech

– – – Other useful playlists: – – –

Azure Data Factory playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXwTClTt3_28CMz2dZoaFhKD

Azure General Topics Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXxv0IEASoJRTHuRq_DUqrjR

Microsoft Fabric Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXybedCIBBI4lmaIbtbn7MdM

Azure Databricks playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXznRvTJXwmazGCvTSxdCMsN

Azure Project End-to-End Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXx6KE4nBmhf6QwSHMbznP2W

CICD Databricks Playlist: https://www.youtube.com/playlist?listPLrG_BXEk3kXzMLDAgRbDsbIKvhoWsu-Gq

End-to-end Azure data engineering project: https://youtu.be/iQ41WqhHglk

– – – Let’s connect: – – –

Email: [email protected]
Instagram: mrk_talkstech

– – – Tools and equipment (equipment I use): – – –

Disclaimer: Links included in this description may be affiliate links. If you purchase a product or service using links I provide, I may receive a small commission. There is no additional cost to you! Please support me so I can continue to offer you free content every week!

DJI Microphone: https://amzn.to/3sNpDv8
Dell XPS 13 Plus 13.4/" 3.5K: https://amzn.to/45KqH1c
Rode VideoMicro Vlogger Kit: https://amzn.to/3sVFW8Y
DJI Osmos Action 3: https://amzn.to/44KYV3x
DJI Mini 3 PRO: https://amzn.to/3PwRwAr

– – – On me: – – –

Mr. K is a passionate teacher who created this channel with one purpose / "HELPS PEOPLE DISCOVER MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES/"

I will create a playlist that covers the topics below (with DEMO)

1. Azure tutorials for beginners
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Data Bricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)

After creating a few basic foundation videos, I will create some videos with the real-time scenarios/use cases specific to the three common data fields,

1. Data engineer
2. Data Analyst
3. Data Scientist

I can't wait to help people with my videos.

– – – To support me: – – –

Please subscribe: https://www.youtube.com/@mr.ktalkstech

#AzureDatabricks #ApacheSpark #Sparkcompute #clusters #notebooks #magiccommands #machinelearning #ETL

Please take the opportunity to connect and share this video with your friends and family if you find it useful.