AlwaysON – Script to sync SQL Server Agent Jobs from Primary Replica to Secondary Replica in an Always On Availability Group

Environment

Blog29_1

-> Create a Job called “SQL Server Agent Job Synchronization” on all the Database Servers as part of your Alwayson Availability group. In my Environment, the Job will be created on Database Server JBSERVER1, JBSERVER2 and JBSERVER3. The Job “SQL Server Agent Job Synchronization” will have the below script executed as part of it.

-- Script to sync SQL Server Agent Jobs from Primary Replica to Secondary Replica in an Always On Availability Group
-- Dont forgot to change the listener name below
SET NOCOUNT ON;

DECLARE @primary_replica NVARCHAR(128),
        @local_replica NVARCHAR(128),
        @job_name NVARCHAR(128),
        @job_id UNIQUEIDENTIFIER,
        @tsql NVARCHAR(MAX),
        @sql NVARCHAR(MAX);

				

-- Get the primary replica name
SELECT @Primary_Replica = primary_replica
FROM sys.dm_hadr_availability_group_states a INNER JOIN sys.availability_group_listeners b
ON a.group_id=b.group_id where b.dns_name='DISL' ---Change the LISTENER NAME here

-- Get the current replica name (where this script is running)
SELECT @local_replica = @@SERVERNAME;

-- If this server is the primary replica, no need to sync jobs
IF @local_replica = @primary_replica
BEGIN
    PRINT 'This server is the primary replica. No job sync required.';
    RETURN;
END


-- Create a table to store jobs from the primary replica
IF OBJECT_ID('tempdb..#primary_jobs') IS NOT NULL
    DROP TABLE #primary_jobs;

CREATE TABLE #primary_jobs (
    job_id UNIQUEIDENTIFIER,
    job_name NVARCHAR(128)
);

-- Insert jobs from primary replica into the temp table
SET @sql = 'INSERT INTO #primary_jobs (job_id, job_name)
            SELECT job_id, name FROM [' + @primary_replica + '].msdb.dbo.sysjobs';

EXEC sp_executesql @sql;

-- Loop through jobs on primary replica and compare with local (secondary) replica
DECLARE job_cursor CURSOR FOR
SELECT job_id, job_name
FROM #primary_jobs;

OPEN job_cursor;
FETCH NEXT FROM job_cursor INTO @job_id, @job_name;

WHILE @@FETCH_STATUS = 0
BEGIN
    -- Check if the job exists on the local (secondary) replica
    IF NOT EXISTS (SELECT 1 FROM msdb.dbo.sysjobs WHERE name = @job_name)
    BEGIN
        PRINT 'Job missing on secondary replica: ' + @job_name;

        -- Script job creation from the primary replica
        DECLARE @job_creation_script NVARCHAR(MAX) = '';
        DECLARE @step_creation_script NVARCHAR(MAX) = '';
        DECLARE @schedule_creation_script NVARCHAR(MAX) = '';

        -- Step 1: Script the job creation
        SET @job_creation_script = 'EXEC msdb.dbo.sp_add_job @job_name = ''' + @job_name + ''', @enabled = 1, @description = ''' + @job_name + ''';';
        
        -- Step 2: Script the job steps from the primary replica
        DECLARE @step_id INT,
                @step_name NVARCHAR(128),
                @subsystem NVARCHAR(128),
                @command NVARCHAR(MAX),
                @on_success_action INT,
                @on_fail_action INT;
				

						set @sql=N''
				set @sql =         'SELECT step_id, step_name, subsystem, command, on_success_action, on_fail_action  INTO ##Primary_Job_jbs_wiki_details
        FROM [' + @primary_replica + '].msdb.dbo.sysjobsteps 
        WHERE job_id = '''+convert(nvarchar(max),@job_id)+''';'
		EXECUTE master.sys.sp_executesql @sql;

        DECLARE step_cursor CURSOR FOR 
        SELECT step_id, step_name, subsystem, command, on_success_action, on_fail_action 
        FROM ##Primary_Job_jbs_wiki_details;

        OPEN step_cursor;
        FETCH NEXT FROM step_cursor INTO @step_id, @step_name, @subsystem, @command, @on_success_action, @on_fail_action;

        WHILE @@FETCH_STATUS = 0
        BEGIN
		
            SET @step_creation_script = @step_creation_script + 'EXEC msdb.dbo.sp_add_jobstep 
                    @job_name = ''' + @job_name + ''', 
                    @step_name = ''' + @step_name + ''', 
                    @subsystem = ''' + @subsystem + ''', 
                    @command = ''' + REPLACE(@command, '''', '''''') + ''', 
                    @on_success_action = ' + CAST(@on_success_action AS NVARCHAR(10)) + ',
                    @on_fail_action = ' + CAST(@on_fail_action AS NVARCHAR(10)) + ';';
                    
            FETCH NEXT FROM step_cursor INTO @step_id, @step_name, @subsystem, @command, @on_success_action, @on_fail_action;
        END
		drop table ##Primary_Job_jbs_wiki_details
        CLOSE step_cursor;
        DEALLOCATE step_cursor;

        -- Step 3: Script the job schedule from the primary replica
        DECLARE @schedule_name NVARCHAR(128),
                @enabled INT,
                @freq_type INT,
                @freq_interval INT,
                @freq_subday_type INT,
                @freq_subday_interval INT,
                @freq_relative_interval INT,
                @freq_recurrence_factor INT,
                @active_start_date INT,
                @active_start_time INT;

				set @sql = N''
		set @sql = 'SELECT s.name, s.enabled, s.freq_type, s.freq_interval, s.freq_subday_type, s.freq_subday_interval, 
               s.freq_relative_interval, s.freq_recurrence_factor, s.active_start_date, s.active_start_time INTO ##Primary_Job_jbs_wiki_details1
        FROM [' + @primary_replica + '].msdb.dbo.sysschedules AS s
        INNER JOIN [' + @primary_replica + '].msdb.dbo.sysjobschedules AS js ON s.schedule_id = js.schedule_id
        WHERE js.job_id = '''+convert(nvarchar(max),@job_id)+''';'
		EXECUTE master.sys.sp_executesql @sql;

        DECLARE schedule_cursor CURSOR DYNAMIC FOR 
        SELECT s.name, s.enabled, s.freq_type, s.freq_interval, s.freq_subday_type, s.freq_subday_interval, 
               s.freq_relative_interval, s.freq_recurrence_factor, s.active_start_date, s.active_start_time 
        FROM ##Primary_Job_jbs_wiki_details1 s;

        OPEN schedule_cursor;
        FETCH NEXT FROM schedule_cursor INTO @schedule_name, @enabled, @freq_type, @freq_interval, @freq_subday_type, 
                                              @freq_subday_interval, @freq_relative_interval, @freq_recurrence_factor, 
                                              @active_start_date, @active_start_time;

        WHILE @@FETCH_STATUS = 0
        BEGIN
			SET @schedule_creation_script = @schedule_creation_script + 'EXEC msdb.dbo.sp_add_jobschedule 
                    @job_name = ''' + @job_name + ''', 
                    @name = ''' + @schedule_name + ''', 
                    @enabled = ' + CAST(@enabled AS NVARCHAR(10)) + ', 
                    @freq_type = ' + CAST(@freq_type AS NVARCHAR(10)) + ', 
                    @freq_interval = ' + CAST(@freq_interval AS NVARCHAR(10)) + ', 
                    @freq_subday_type = ' + CAST(@freq_subday_type AS NVARCHAR(10)) + ', 
                    @freq_subday_interval = ' + CAST(@freq_subday_interval AS NVARCHAR(10)) + ', 
                    @freq_relative_interval = ' + CAST(@freq_relative_interval AS NVARCHAR(10)) + ', 
                    @freq_recurrence_factor = ' + CAST(@freq_recurrence_factor AS NVARCHAR(10)) + ', 
                    @active_start_date = ' + CAST(@active_start_date AS NVARCHAR(10)) + ', 
                    @active_start_time = ' + CAST(@active_start_time AS NVARCHAR(10)) + ';';

            FETCH NEXT FROM schedule_cursor INTO @schedule_name, @enabled, @freq_type, @freq_interval, @freq_subday_type, 
                                                  @freq_subday_interval, @freq_relative_interval, @freq_recurrence_factor, 
                                                  @active_start_date, @active_start_time;
        END
		DROP TABLE ##Primary_Job_jbs_wiki_details1
        CLOSE schedule_cursor;
        DEALLOCATE schedule_cursor;

        -- Combine all scripts and execute to create the job on the secondary replica
        SET @tsql = @job_creation_script + @step_creation_script + @schedule_creation_script;

        EXEC sp_executesql @tsql;
        
        PRINT 'Job created on secondary replica: ' + @job_name;
    END

    FETCH NEXT FROM job_cursor INTO @job_id, @job_name;
END

CLOSE job_cursor;
DEALLOCATE job_cursor;

-- Cleanup
DROP TABLE #primary_jobs;


PRINT 'Job sync completed.';

-> Create a Linked Server to query the primary Replica. In my Environment, Linked servers JBSERVER2 and JBSERVER3 will be created on JBSERVER1. Linked servers JBSERVER1 and JBSERVER3 will be created on JBSERVER2. Linked servers JBSERVER1 and JBSERVER2 will be created on JBSERVER3.

-> The job will gracefully exit with a message “Script cannot run on primary Replica” if the job executes on Primary Replica. If the Job executes on the Secondary replica, It queries the list of SQL Server Agent Jobs on the primary replica and will create the jobs that are missing on the Secondary Replicas.

-> This solution just adds the missing jobs on the Secondary Replicas, but will not Drop Jobs on the Secondary Replica that are not present on the Primary.

Thank You,
Vivek Janakiraman

Disclaimer:
The views expressed on this blog are mine alone and do not reflect the views of my company or anyone else. All postings on this blog are provided “AS IS” with no warranties, and confers no rights.

Running SQL Server 2022 on Linux: Enhancements, Best Practices, and Business Use Cases

Microsoft’s decision to bring SQL Server to Linux marked a significant milestone, opening doors for more flexible and cost-effective database management solutions. SQL Server 2022 continues to enhance this cross-platform capability, offering a robust and feature-rich environment for enterprises leveraging Linux. In this blog, we will explore the enhancements in SQL Server 2022 for Linux, best practices for optimal performance, and compelling business use cases.


🎉 Why SQL Server on Linux?

Before diving into the technical details, let’s understand the benefits of running SQL Server on Linux:

  1. Cost Savings: Linux is an open-source platform, which can significantly reduce licensing costs compared to Windows environments.
  2. Flexibility: Enterprises can choose the platform that best suits their infrastructure and expertise, leveraging existing investments in Linux.
  3. Performance: SQL Server on Linux has been optimized for performance, taking advantage of the low overhead and efficient resource management of Linux systems.
  4. Security: Linux is known for its robust security features, which complement SQL Server’s advanced security capabilities.
  5. Compatibility: SQL Server on Linux supports many of the same features and functionalities as on Windows, ensuring a consistent experience across platforms.

🚀 SQL Server 2022 Enhancements on Linux

1. Enhanced Availability and Performance

SQL Server 2022 introduces several enhancements to improve availability and performance on Linux:

High Availability and Disaster Recovery (HADR)

SQL Server 2022 on Linux now supports improved Always On Availability Groups, providing robust high availability and disaster recovery (HADR) options. This includes:

  • Synchronous and Asynchronous Data Replication: Ensure data consistency and high availability across multiple Linux servers.
  • Automatic Failover: Minimize downtime by automatically switching to a standby server in case of a failure.

Implementation

Configure Always On Availability Groups using the following commands:

sudo /opt/mssql/bin/mssql-conf set hadr.hadrenabled 1
sudo systemctl restart mssql-server

Performance Improvements

SQL Server 2022 leverages Linux’s low-latency networking and I/O capabilities, enhancing performance for intensive workloads.

2. Advanced Security Features

Security is paramount, and SQL Server 2022 on Linux offers several advanced security features:

  • Transparent Data Encryption (TDE): Encrypts data at rest, protecting it from unauthorized access.
  • Always Encrypted: Protects sensitive data by encrypting it at the client side, ensuring that the database never sees the plaintext data.

Implementation

Enable TDE using the following SQL commands:

CREATE DATABASE ENCRYPTION KEY
WITH ALGORITHM = AES_256
ENCRYPTION BY SERVER CERTIFICATE MyServerCert;
ALTER DATABASE YourDatabase
SET ENCRYPTION ON;

3. Improved Cross-Platform Management

SQL Server 2022 enhances management capabilities, allowing seamless administration across Windows and Linux platforms:

  • SQL Server Management Studio (SSMS): Use SSMS to manage SQL Server instances on Linux.
  • SQL Server Data Tools (SSDT): Develop and deploy SQL Server solutions across platforms.

🛠️ Best Practices for Running SQL Server 2022 on Linux

  1. Choose the Right Distribution

Select a supported Linux distribution, such as Red Hat Enterprise Linux (RHEL), Ubuntu, or SUSE Linux Enterprise Server (SLES), based on your organization’s requirements and support considerations.

  1. Optimize System Configuration
  • Memory and CPU Configuration: Ensure adequate memory and CPU allocation based on workload requirements.
  • Disk I/O Optimization: Use SSDs for storage to take advantage of faster data access and improved I/O performance.
  1. Security Best Practices
  • Regularly Update and Patch: Keep your SQL Server and Linux OS updated with the latest security patches.
  • Implement Strong Authentication: Use integrated authentication methods and enforce strong passwords.
  1. Monitor and Tune Performance
  • Use Performance Monitoring Tools: Leverage SQL Server tools like sys.dm_os_performance_counters and Linux tools like iostat and vmstat to monitor performance.
  • Query Optimization: Regularly review and optimize queries to ensure efficient execution.

🏢 Business Use Cases

1. Cost-Effective Database Solutions

Organizations with existing Linux infrastructure can reduce licensing costs by deploying SQL Server on Linux. This is especially beneficial for startups and small to medium-sized enterprises (SMEs) looking to optimize their budget without compromising on database capabilities.

2. High-Performance Data Analytics

SQL Server 2022 on Linux provides the performance and scalability needed for data-intensive applications, such as real-time analytics and big data processing. Companies can leverage the robust performance capabilities of Linux to handle large volumes of data efficiently.

3. Cross-Platform Development and Deployment

For organizations with a mixed OS environment, SQL Server 2022 on Linux enables consistent database management across platforms. This allows for streamlined development and deployment processes, reducing complexity and enhancing productivity.

4. Enhanced Security and Compliance

With advanced security features like TDE and Always Encrypted, SQL Server 2022 on Linux helps organizations meet stringent data security and compliance requirements, such as GDPR and HIPAA.


🏁 Conclusion

SQL Server 2022 on Linux offers a powerful, flexible, and cost-effective solution for modern enterprises. With enhancements in performance, security, and management, along with the advantages of the Linux platform, it is an excellent choice for businesses looking to leverage the best of both worlds. Whether you’re aiming to reduce costs, improve performance, or ensure robust security, SQL Server 2022 on Linux provides the tools and features necessary to achieve your goals.

If you have any questions or need further guidance, feel free to leave a comment or reach out! Happy computing! 🚀

For more tutorials and tips on SQL Server, including performance tuning and database management, be sure to check out our JBSWiki YouTube channel.

Thank You,
Vivek Janakiraman

Disclaimer:
The views expressed on this blog are mine alone and do not reflect the views of my company or anyone else. All postings on this blog are provided “AS IS” with no warranties, and confers no rights.

Deploying and Managing SQL Server 2022 on Kubernetes: A Comprehensive Guide

Kubernetes has become a popular choice for managing containerized applications, and SQL Server 2022 is no exception. This guide will walk you through deploying and managing SQL Server 2022 on Kubernetes, offering examples and screenshots to illustrate the process.


🛠️ Prerequisites

Before diving into the deployment, ensure you have the following:

  1. Kubernetes Cluster: A running Kubernetes cluster (e.g., Minikube, Azure Kubernetes Service, Amazon EKS).
  2. kubectl: The Kubernetes command-line tool, installed and configured.
  3. Docker: Installed for container image management.

🏗️ Step-by-Step Deployment

1. Create a Namespace

Namespaces in Kubernetes help organize your resources. Let’s create one for SQL Server:

kubectl create namespace sqlserver

2. Persistent Storage Setup

SQL Server requires persistent storage for data. We’ll use Persistent Volume (PV) and Persistent Volume Claim (PVC).

Persistent Volume (PV) Definition:

apiVersion: v1
kind: PersistentVolume
metadata:
  name: sql-pv
  namespace: sqlserver
spec:
  capacity:
    storage: 20Gi
  accessModes:
    - ReadWriteOnce
  hostPath:
    path: /mnt/sqlserver

Persistent Volume Claim (PVC) Definition:

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: sql-pvc
  namespace: sqlserver
spec:
  accessModes:
    - ReadWriteOnce
  resources:
    requests:
      storage: 20Gi

Apply these configurations:

kubectl apply -f sql-pv.yaml
kubectl apply -f sql-pvc.yaml

3. Deploying SQL Server 2022

Create a Deployment manifest for SQL Server:

Deployment YAML:

apiVersion: apps/v1
kind: Deployment
metadata:
  name: sqlserver-deployment
  namespace: sqlserver
spec:
  replicas: 1
  selector:
    matchLabels:
      app: sqlserver
  template:
    metadata:
      labels:
        app: sqlserver
    spec:
      containers:
      - name: sqlserver
        image: mcr.microsoft.com/mssql/server:2022-latest
        ports:
        - containerPort: 1433
        env:
        - name: ACCEPT_EULA
          value: "Y"
        - name: MSSQL_SA_PASSWORD
          value: "YourStrongPassword!"
        volumeMounts:
        - name: mssql-data
          mountPath: /var/opt/mssql
      volumes:
      - name: mssql-data
        persistentVolumeClaim:
          claimName: sql-pvc

Apply the deployment:

kubectl apply -f sqlserver-deployment.yaml

4. Exposing SQL Server

To access SQL Server externally, create a Service:

Service YAML:

apiVersion: v1
kind: Service
metadata:
  name: sqlserver-service
  namespace: sqlserver
spec:
  type: LoadBalancer
  ports:
  - port: 1433
    targetPort: 1433
  selector:
    app: sqlserver

Apply the service configuration:

kubectl apply -f sqlserver-service.yaml

🔍 Managing SQL Server on Kubernetes

1. Scaling

To scale SQL Server instances, modify the replicas field in the Deployment YAML:

spec:
  replicas: 3

Apply the changes:

kubectl apply -f sqlserver-deployment.yaml

2. Monitoring

Monitor the SQL Server pods and services using kubectl:

kubectl get pods -n sqlserver
kubectl get svc -n sqlserver

For detailed logs:

kubectl logs <pod-name> -n sqlserver

3. Updating SQL Server Image

To update the SQL Server container image, modify the image field in the Deployment YAML and apply the changes:

image: mcr.microsoft.com/mssql/server:2022-latest
kubectl apply -f sqlserver-deployment.yaml

4. Backup and Restore

Backup: Use the sqlcmd tool or any SQL Server Management tool to perform a backup.

Restore: Similarly, use sqlcmd or another tool to restore from a backup.

Example backup command:

BACKUP DATABASE [YourDatabase] TO DISK = '/var/opt/mssql/backup/YourDatabase.bak'

🏁 Conclusion

Deploying and managing SQL Server 2022 on Kubernetes provides flexibility and scalability for your containerized environments. By following the steps outlined in this guide, you can set up SQL Server, scale it, monitor performance, and perform backups and updates with ease.

Kubernetes and SQL Server 2022 together form a powerful combination for modern cloud-native applications. If you have any questions or run into issues, feel free to explore the official documentation or community forums. Happy deploying! 🚀

For more tutorials and tips on SQL Server, including performance tuning and database management, be sure to check out our JBSWiki YouTube channel.

Thank You,
Vivek Janakiraman

Disclaimer:
The views expressed on this blog are mine alone and do not reflect the views of my company or anyone else. All postings on this blog are provided “AS IS” with no warranties, and confers no rights.