SQL Server Configuration Example
Easily integrate your enterprise systems by configuring the Nodinite Pickup Logging Service to fetch JSON Log Events directly from your SQL Server database. This guide empowers you to set up secure, scalable, and reliable log event collection for your organization, with robust validation and table design for compliance and analytics.
✅ Seamless integration with SQL Server for real-time log event collection
✅ Secure and compliant long-term storage of log data
✅ Scalable configuration for enterprise environments
✅ Automated validation and error handling for reliable operations
The diagram above illustrates how the Pickup Service interacts with SQL Server tables, processes messages, and stores them in the Nodinite Log Database.
SQL Servers
The SQL Servers section lets you manage all SQL Server database sources for your log events.
You configure these sources in the Settings.json
file, which uses JSON format. The default path is:
C:\Program Files\Nodinite\Logging Agent - Pickup Service\Settings.json
{
...
"SQLServers": [
{
"Enabled": true,
"LogApi": "https://localhost/Nodinite/Dev/LogAPI/",
"UseConfigurationDatabase": false,
"ConfigurationDatabaseConnectionString": null,
"ConnectionString": "Server=myServerAddress;Database=myDataBase;Integrated Security=True;Connection Timeout=60;TrustServerCertificate=true",
"MaxRowsLimit": 500,
"ReplaceRules": [
{
"Name": "Fix Endpoint real customer id to {customerId}",
"ReplaceName": false,
"ReplaceUri": true,
"Pattern": "/([0-9]{4,})$",
"Group1Value": "{customerId}"
}
]
}
]
...
}
SQL Servers is an array of SQL Server configurations. Each entry defines how the Log Agent connects to and processes messages from a specific SQL Server database. This setup ensures your Nodinite JSON Log Events are reliably collected and managed.
Property | Description | Value Example | Comment |
---|---|---|---|
ConnectionString | SQL Server Database Connection string | Server=myServerAddress;Database=myDataBase;Integrated Security=True;Connection Timeout=60;TrustServerCertificate=true |
|
MaxRowsLimit | Maximum number of rows to fetch on each loop | 500 (default) | Larger values may impact memory usage |
Enabled | See the Shared Configuration section for more info | ||
LogAPI | See the Shared Configuration section for more info | ||
UseConfigurationDatabase | See the Shared Configuration section for more info | ||
ConfigurationDatabaseConnectionString | See the Shared Configuration section for more info | ||
ReplaceRules | See the shared Replace Rules section for more info |
Important
You must restart the Nodinite Pickup Logging Service for configuration changes to take effect.
SQL Server table
If you use a Microsoft SQL Server database to store Log Events, your custom logging solution must define the following LogEvents table:
Column | Datatype | Purpose |
---|---|---|
LogEvent | json | Your JSON encoded Log Event |
Id | bigint | Automatically created identity; the PickupService must know which row to flag as invalid if the value in LogEvent is not valid |
ValidationFailed | boolean | Automatically set to false when inserted; may be set to true during processing if errors are detected |
ValidationFailedText | text | Updated if errors occur validating the LogEvent during processing |
Created | timestamp | Automatically created during insert; useful for troubleshooting |
Important
Invalid Log Events will have ValidationFailed set to True. You must remove these entries manually.
-- Table: [LogEvents], used by :Nodinite: Logging
-- DROP TABLE [dbo].[LogEvents];
CREATE TABLE [dbo].[LogEvents](
[Id] [bigint] IDENTITY(1,1) NOT NULL,
[LogEvent] [nvarchar](max) NOT NULL,
[ValidationFailed] [bit] NOT NULL,
[ValidationFailedText] [nvarchar](max) NULL,
[Created] [datetimeoffset](7) NOT NULL,
CONSTRAINT [PK_LogEvents] PRIMARY KEY NONCLUSTERED
(
[Id] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON, FILLFACTOR = 7) ON [PRIMARY]
) ON [PRIMARY] TEXTIMAGE_ON [PRIMARY]
GO
ALTER TABLE [dbo].[LogEvents] ADD CONSTRAINT [DF_LogEvents_ValidationFailed] DEFAULT ((0)) FOR [ValidationFailed]
GO
ALTER TABLE [dbo].[LogEvents] ADD CONSTRAINT [DF_LogEvents_Created] DEFAULT (sysutcdatetime()) FOR [Created]
GO
-- Do not forget to assign user access rights
Important
Remember to assign the service account for the Pickup Service the following rights:
- db_datareader
- db_datawriter