-
Recent Posts
- Designing and Implementing a Modern Data Architecture on Azure Cloud.
- Ingest Azure Event Hub Telemetry Data with Apache PySpark Structured Streaming on Databricks.
- Publish PySpark Streaming Query Metrics to Azure Log Analytics using the Data Collector REST API.
- Write Data from Azure Databricks to Azure Dedicated SQL Pool(formerly SQL DW) using ADLS Gen 2.
- Incrementally Process Data Lake Files Using Azure Databricks Autoloader and Spark Structured Streaming API.
Recent Comments
Archives
- May 2022
- May 2021
- November 2020
- September 2020
- June 2020
- March 2020
- May 2019
- March 2019
- July 2018
- January 2018
- October 2017
- September 2017
- August 2017
- July 2017
- June 2017
- January 2017
- November 2016
- October 2016
- September 2016
- August 2016
- April 2016
- March 2016
- December 2015
- November 2015
- August 2015
- July 2015
- May 2015
- April 2015
- March 2015
- February 2015
- January 2015
- December 2014
- November 2014
- October 2014
- August 2014
- July 2014
- June 2014
- May 2014
- April 2014
- March 2014
- February 2014
- January 2014
- December 2013
- November 2013
- October 2013
- September 2013
Categories
- Access-Lists
- Active Directory
- Active Directory Domain Services
- Active Directory Replication
- Active Directory Time
- AD Forest
- Apache Spark
- ASA
- Audit Logs
- AWS
- Azure
- Azure Active Directory
- Azure AD Service Principal
- Azure AD Sync
- Azure Automation Account
- Azure Databricks
- Azure Disk Encryption
- Azure Event Hub
- Azure File Storage Copy
- Azure Function App
- Azure Key Vault
- Azure Kubernetes
- Azure Resource Manager
- Azure Runbook
- Azure Site Recovery
- Azure Synapse DW
- Azure VPN
- Azure Windows PowerShell
- Bash
- Batch Migration
- BCDEdit
- BCDR
- Business Continuity
- Cisco
- Cisco 3750G
- Cisco IOS
- Cisco Switch
- Clock
- Cluster Disk
- Cluster Init Scripts
- Cluster Shared Volume
- CSV
- Database Replication
- Databricks Notebooks
- DCPromo
- DHCP
- DHCP Failover
- DHCP High Availability
- DirectAccess
- Directory Synchronization
- Disaster Recovery
- Domain Controller
- DSRM
- Event Logs
- Exchange 2010 SP2
- Exchange Cmdlets
- Exchange Management Roles
- Exchange Management Shell
- Exchange Online
- Failover Cluster
- Failover Cluster Manager
- Firewall
- Flexible Single Master Operations
- FSMO
- Generation 2 Virtual Machines
- Helper Address
- Hyper-v
- Hyper-v 2012 R2
- Hyper-v Manager
- Hypervisor Replication
- I.T Management
- Install.packages()
- Interstellar Movie
- IOS
- IP
- ISCSI
- ISCSI Initiator
- ISCSI Target
- Jumbo Frames
- Kubernetes
- Logs
- Microsoft Exchange
- Microsoft Hyper-v
- Microsoft SQL Server
- Migration
- Miscellaneous
- Modern Data Architecture
- MSSQL 2000
- MSSQL 2008 R2
- MSSQL 2012
- Multipath-IO
- NAT
- Network
- Network Address Translation
- Network Load Balancing
- Network Policy Server
- NIC Teaming
- NTDSUtil
- NTP
- Office 365
- Onboarding
- PowerShell
- PowerShell 3.0
- Powershell 4.0
- Pre-Boot Execution Environment
- Publisher
- PXE
- PySpark Streaming Logs
- Python
- Quorum
- R
- Radius Server
- RBAC
- Remote Access
- Replication Agents
- Role Based Access Control
- Router
- Script
- Scripts
- SCVMM2012 R2
- SCVMM2012R2
- Shell
- SQL2012
- ssh
- Subscriber
- svi
- Switch
- Switch Virtual Interface
- System Center 2012 R2
- Telnet
- Time
- Transactional Replication
- Uncategorized
- Unified Analytics
- VHDX
- Video
- Virtual Machine Manager 2012 R2
- Virtual Machines
- Virtual Switch System
- vlan
- VM Replica
- VMM2012R2
- VSS
- WDS
- WIndows 8.1
- Windows Azure PowerShell
- Windows Deployment Server
- Windows Server 2008 R2
- Windows Server 2008 R2 Backup
- Windows Server 2012
- Windows Server 2012 R2
- Witness
Meta
Follow me on Twitter
My Tweets
Tag Archives: Databricks
Ingest Azure Event Hub Telemetry Data with Apache PySpark Structured Streaming on Databricks.
Overview. Ingesting, storing and processing millions of telemetry data from a plethora of remote IoT devices and Sensors has become common place. One of the primary Cloud services used to process streaming telemetry events at scale is Azure Event Hub. … Continue reading
Automate Azure Databricks Job Execution using Custom Python Functions.
Introduction Thanks to a recent Azure Databricks project, I’ve gained insight into some of the configuration components, issues and key elements of the platform. Let’s take a look at this project to give you some insight into successfully developing, testing, … Continue reading
Chinny Chukwudozie, Cloud Solutions. 