Manage Azure Data Factory Monitoring with Nodinite
Take control of your Azure Data Factory monitoring with Nodinite. This guide shows you how your teams securely manage, monitor, and act on Data Factory and Pipelines with Remote Actions, without direct Azure Portal access.
- ✅ Proactively monitor Data Factory and pipelines for issues
- ✅ Enable secure, role-based self-service for business and support teams
- ✅ Access actionable details and remote actions from a single interface
Nodinite lets you delegate management and insights for selected Data Factory resources in Azure. Your support and maintenance teams gain deep insights for root cause analysis, while you minimize risk by limiting direct Azure Portal access. This approach reduces potential attack vectors and safeguards mission-critical services from accidental disruption.
Start with Monitoring Azure Data Factory if you want the collection overview and threshold context before working with the Data Factory and pipeline actions below.
Diagram: High-level overview of how Nodinite monitors and manages Azure Data Factory and Pipelines; each Subscription holds zero or more Data Factories, and each Data Factory zero or more Pipelines.
| Application Management Team | IT Operations | Business |
|---|---|---|
| Empower your AM team to proactively manage Data Factory without disrupting IT operations | Maintain full control and visibility over all actions | Deliver actionable insights and self-service for business solutions built on Data Factory |
Management Features
For Resources in Role-based Monitor Views with Remote Actions privileges, you can:
| Category | Monitoring | Actions | Metrics/Statistics |
|---|---|---|---|
| Data Factory | ✅ Monitoring | Details | - |
| Pipelines | ✅ Monitoring | Details Edit |
- |
As an Administrator with access to the Configuration of Monitoring Agents, you can:
| Monitoring | Remote Configuration |
|---|---|
| Monitoring Data Factory |
|
| Monitoring Data Factory Pipelines |
|
Example: Nodinite Monitor View with Data Factory resources.
Data Factory
The 'Data Factory' Category provides one Resource for each Data Factory found using the configuration, with the specified display name as the Resource name.
Example: Monitor View with a list of 'Data Factory'.
The Data Factory category provides Resources that display the evaluated monitored state according to built-in rules.
You can perform the following Remote Actions for the Data Factory Category:
Example: Remote Actions for Data Factory.
Data Factory Details
To view details about the selected Data Factory Resource, click the Action button and select Details from the 'Control Center' menu.
Use the 'Details' action to open the details modal for the selected Data Factory.
Next, select the option to present the modal.
Example: Details for the selected Data Factory.
Nodinite lists the Pipelines available within the selected Data Factory in the Pipelines accordion at the bottom of the modal:
Example: Existing pipelines within the selected Data Factory.
Pipelines
The 'Data Factory Pipeline' Category provides one Resource for each pipeline per Data Factory found using the configuration, with the deployed name as the Resource name.
Example: Monitor View with a list of 'Data Factory Pipelines'.
The Data Factory Pipeline category provides Resources that display the evaluated monitored state according to built-in rules. Review the Monitoring Data Factory user guide for details.
You can perform the following Remote Actions for the Data Factory Pipeline Category:
Example: Data Factory Pipeline Remote Actions.
Pipeline Details
To view details about the selected Data Factory Pipeline Resource, click the Action button and select Details from the 'Control Center' menu.
Use the 'Details' action to open the details modal for the selected Data Factory Pipeline.
Next, select the option to present the modal.
Example: Details about selected Data Factory Pipeline.
Edit Pipeline thresholds
Edit the monitoring thresholds by clicking the Action button and selecting the Edit menu item within the 'Control Center' section.
Example: Edit thresholds Action button menu item.
Next, select the option to present the modal.
Example: Editing monitoring thresholds for selected 'Data Factory Pipeline'.
You can manage the following monitoring properties:
- Description – The user-friendly description of this specific Data Factory Pipeline monitoring configuration
- Last clear date time – Ignore execution errors before this point in time
- Use global thresholds – When checked, monitoring thresholds use the global settings from the Remote Configuration
- Lookback period – How far back in time to look for problems. Monitoring evaluation uses this value if the current time is higher than the last clear date-time + the lookback period
- Min Execution count – Enter the monitoring thresholds for the count-based evaluation. -1 means that the check is disabled (default)
- ⚠️ Min execution count (Warning)
- ❌ Min execution count (Error)
- Max Execution count – Enter the monitoring thresholds for the count-based evaluation. -1 means that the check is disabled (default)
- ⚠️ Max execution count (Warning)
- ❌ Max execution count (Error)
- Duration (ms) – Set the threshold for the maximum duration
- ⚠️ Warning
- ❌ Error
Click the Save button to persist changes. After you save, Nodinite evaluates this pipeline with the specific settings instead of the global settings.
Save button.
Warning and Error states reach your team through Alarm Plugins. To override the evaluated state of a single pipeline, use the Expected State option of the Resource.
Next Steps
- Monitoring Data Factory
- Configuring the Nodinite Azure Monitoring agent
- Azure Logging and Monitoring Overview