- 4 minutes to read

Nodinite Monitoring of the Data Factory service and related Pipelines in Azure

Don't let your business down! Get alerts when thers is a problem with the Data Factory and related Pipelines. You can access details without the Azure portal.

This page provides documentation about Data Factory related monitoring options using Nodinite from one or more role-based Monitor Views. Nodinite monitor the Azure Data Factory and related Pipelines. You can manage the monitoring thresholds for the Data Factory Pipelines; Remote commands are available as Actions to help you swiftly address reported problems. The Remote Actions are detailed on the Managing Data Factory page.

Data Factory as Resources
Example list of monitored Data Factory in a Nodinite Monitor View

Monitoring Features

  • State Evaluation - Provide state evaluation according to the pre-defined policy.

    If Nodinite can't check your Data Factory items' state, chances are no one else can use them either.

  • The Data Factory discovers Automatically
    • The Nodinite Azure Agent makes use of the Azure Rest API. Hence, Data Factory presents automatically.
  • Category-based monitoring - The monitored Resources groups by the Nodinite Categories concept.
  • Share access to individual items from within Nodinite using one or more role-based Monitor Views.

State evaluation

The Data Factory and related Pipelines to monitor manifests within Nodinite as one or more Resources. For example, if you have three Data Factories with two pipelines each, you will have nine Resources in Nodinite.

  • The Nodinite Resources name is the same as the deployed Data Factory name.
  • Monitored Data Factory belongs to the 'Data Factory' Category:

Many other Azure related Categories exists as well, please review the Azure Logging and Monitoring Overview

  • The Application name is created with the following pattern: Configuration name/Resource Group Name

Each item (presented in Nodinite as a Resource) evaluates with a state (i.e. OK, Warning, Error, Unavailable).

You can override the evaluation process by configuring the Expected State option available for all Nodinite Resources.

Data Factory

For Data Factory Resources, the state evaluates as described in the table below:

State Status Description Actions
Unavailable Resource not available
  • Evaluation of the 'Data Factory' is not possible either due to network or security-related problems
Review prerequisites
Error Error threshold is breached Not implemented
Warning Warning threshold is breached Not Implemented
OK Within user-defined thresholds Details

Data Factory Pipeline

For the Data Factory Pipeline Resources, the state evaluates as described in the table below:

State Status Description Actions
Unavailable Resource not available
  • Evaluation of the 'Data Factory Pipeline' is not possible either due to network or security-related problems
Review prerequisites
Error Error threshold is breached Within the lookback period, one or more Pipeline runs:
  • Did not run in the minimum expected number of times
  • Run more times than the maximum expected number of times
  • Took too long time to execute according to the user-defined threshold
Edit
Warning Warning threshold is breached Within the lookback period, one or more Pipeline runs:
  • Did not run in the minimum expected number of times
  • Run more times than the maximum expected number of times
  • Took too long time to execute according to the user-defined threshold
Edit
OK Within user-defined thresholds Details

Alert history for Data Factory

During root cause analysis or other purposes, it might be helpful to understand how often your Data Factory problems happen. If your Monitor View allows it, you can search for historical state changes for the provided time-span either for all your Data Factory or individually. This topic is further detailed within the generic instructions on how to Add or manage Monitor View page.

Search Resource history

Search for alert history for all resources in the Monitor View

Alert history for the selected Data Factory item

Frequently asked questions

Use the troubleshooting guide to find the FAQ and answers to known problems.


Next step