Run Spark Job Definitions in Pipelines with Service Principal or Workspace Identity
The Spark job definition activity in Microsoft Fabric Data Factory pipelines now supports connection property, unlocking a more secure and production-ready way to run your SJDs. What’s New? With this update, you can configure Notebook activities to run as Service Principal (SPN) or Workspace Identity (WI). These authentication methods are our recommended approach for production … Continue reading “Run Spark Job Definitions in Pipelines with Service Principal or Workspace Identity”