Tag: Subprocess module

• Automate Azure Databricks Job Execution using Custom Python Functions.

  Introduction Thanks to a recent Azure Databricks project, I’ve gained insight into some of the configuration components, issues and key elements of the platform. Let’s take a look at this project to give you some insight into successfully developing, testing, and deploying artifacts and executing models. One note: This post is not meant to be…

  jbernec

  March 23, 2019

  Apache Spark, Azure Databricks, Cluster Init Scripts, Databricks Notebooks, Python

  Azure Data Factory, Databricks, Databricks CLI, Git, Jobs API, Jobs REST API, Logging module, MLFlow, Python, Subprocess module, Version Control