Tag Archives: PySpark Application Logs

Publish PySpark Streaming Query Metrics to Azure Log Analytics using the Data Collector REST API.

Overview. At the time of this writing, there doesn’t seem to be built-in support for writing PySpark Structured Streaming query metrics from Azure Databricks to Azure Log Analytics. After some research, I found a work around that enables capturing the … Continue reading

Posted in PySpark Streaming Logs | Tagged , , , , , , , | Leave a comment