Role overview

Job Details

Job Overview

Title: Data and DevOps Engineer Technical Specialist

Resume Due Date: September 2nd, 2026 (5:00PM EST)

Number of Vacancies: 1

Level: MP5, $90 - $100/hr INC

Duration: 12 Months

Hours of work: 35 Hours

Location: CHQ – 1908 Colonel Sam Dr.(Hybrid – 3 days remote)

We are seeking an experienced Azure & Databricks DevOps Engineer to design, automate, secure, and support cloud-based data platforms and DevOps capabilities across Microsoft Azure and Databricks. This role will be responsible for building scalable infrastructure, implementing CI/CD pipelines, managing platform reliability, and enabling data engineering teams to deliver high-quality analytics and data products efficiently.

The ideal candidate has strong hands-on experience with Azure cloud services, Azure DevOps or GitHub Actions, Terraform, Databricks workspace administration, Unity Catalog, CI/CD automation, security controls, monitoring, and production support.

• Design, deploy, and manage cloud infrastructure on Microsoft Azure using Infrastructure as Code.

• Build and maintain CI/CD pipelines for data engineering, analytics, and platform services.

• Administer and support Azure Databricks workspaces, clusters, jobs, repos, workflows, and permissions.

• Implement and manage Databricks Unity Catalog, including catalogs, schemas, external locations, storage credentials, and access controls.

• Automate deployment of Databricks notebooks, jobs, workflows, libraries, clusters, policies, and workspace configurations.

• Develop reusable DevOps frameworks and deployment templates for data platform teams.

• Manage Azure services such as:

• Azure Data Lake Storage Gen2

• Azure Key Vault

• Azure Synapse Analytics

• Azure Data Factory

• Azure Monitor / Log Analytics

• Azure Functions

• Implement security best practices including RBAC, managed identities, service principals, secrets management, private endpoints, network security, and least-privilege access.

• Support production operations, incident response, troubleshooting, monitoring, alerting, and performance optimization.

• Collaborate with data engineers, architects, security teams, product owners, and application teams.

• Manage environment promotion across development, UAT, and production environments.

• Support cost monitoring and optimization for Azure and Databricks workloads.

• Create and maintain technical documentation, runbooks, deployment guides, and operational procedures.

Key Accountabilities

Qualifications

Proven experience as a DevOps Engineer, Cloud Engineer, Data Platform Engineer.
Strong hands-on experience with Microsoft Azure cloud services.
Understanding of cloud identity and access management, including Azure AD / Microsoft Entra ID, RBAC, service principals, managed identities, and group-based access control
Experience with monitoring and logging tools such as Azure Monitor, Log Analytics, Application Insights, or Databricks system tables.
Familiarity with Git branching strategies, pull requests, code reviews, and release management.
Strong troubleshooting, communication, and documentation skills.
Hands-on experience with Azure Databricks administration and deployment automation.
Experience building CI/CD pipelines using one or more of:

o Azure DevOps Pipelines
o GitHub Actions
o Jenkins
o Strong Infrastructure as Code experience using:
o Terraform
o Experience with Databricks platform components, including:
o Workspaces
o Clusters
o Jobs / Workflows
o Repos
o Libraries
o Secret scopes
o Cluster policies
o Unity Catalog
o Strong scripting or programming skills using:
o Python
o PowerShell
o Bash
o SQL