Ir para o conteúdo
Portuguêspt
Portuguêspt

Databricks Data Engineer / Developer

  • Remote
    • Toronto, Ontario, Canada

Job description

Location: Remote within Canada

Client: Consulting Client
Contract Duration: 6 months contract

MUST HAVE atleast 3+ years of hands-on Databricks development experience.

Overview

Our consulting client is seeking a Databricks Data Engineer / Developer to support a strategic Enterprise Data Platform (EDP) transformation initiative. The organization is modernizing its enterprise data landscape and building a next-generation data platform leveraging Databricks and modern cloud-based architecture. This role will play a key part in designing, developing, and implementing scalable data solutions that support enterprise reporting, analytics, AI initiatives, and future data-driven capabilities.

The ideal candidate will possess strong data engineering expertise, hands-on Databricks development experience, and a solid understanding of ETL/ELT processes, data integration, and modern data architecture. This individual will work closely with data architects, project managers, analysts, and business stakeholders to deliver high-quality data solutions within a rapidly evolving environment.

Key Responsibilities

  • Design, develop, and maintain data pipelines within the Enterprise Data Platform (EDP).

  • Build and optimize ETL/ELT processes to support data ingestion, transformation, and integration requirements.

  • Make use of an Agentic approach to development and ensure that output matches development standards.

  • Develop scalable and reusable data solutions using Databricks and cloud-based data technologies.

  • Support migration and modernization activities from HANA environments to a modern data platform.

  • Collaborate with Data Architects to implement scalable data models and platform solutions.

  • Develop data transformation logic and workflows to support business and analytics requirements.

  • Ensure data quality, integrity, consistency, and performance across platform solutions.

  • Troubleshoot and resolve data-related issues, bottlenecks, and performance concerns.

  • Participate in code reviews, testing, deployment, and release activities.

  • Work closely with business and analytics teams to understand data requirements and deliver fit-for-purpose solutions.

  • Contribute to platform best practices, documentation, and continuous improvement initiatives.

Job requirements

MUST HAVE atleast 3+ years of hands-on Databricks development experience.

Required Qualifications

  • 3+ years of hands-on Databricks development experience.

  • 4+ years of overall Data Engineering, ETL, or Data Integration experience.

  • Strong experience building ETL/ELT data pipelines and transformation processes.

  • Proven experience working with large and complex datasets.

  • Experience with Agentic frameworks and AI-assisted coding is a value add.

  • Experience developing data solutions within cloud-based platforms.

  • Solid understanding of data warehousing, data lake, and lakehouse concepts.

  • Experience working in Agile delivery environments.

  • Strong problem-solving and analytical skills.

  • Excellent communication and collaboration abilities.

Preferred Qualifications

  • Experience supporting large data platform initiatives.

  • Experience in significant data migration efforts.

  • Experience with Azure Data Services and Databricks Lakehouse architecture.

  • Experience with modern data engineering frameworks and best practices.

  • Exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives.

  • Experience working in large enterprise or consulting environments.

  • Knowledge of data governance, metadata management, and data quality frameworks.


Technical Knowledge

Required

  • Databricks

  • ETL / ELT Development

  • Data Engineering

  • Data Integration

  • SQL

  • Python

  • Data Pipeline Development

  • Data Transformation

  • Data Warehousing Concepts

  • Agile Delivery

Preferred

  • Azure Data Factory

  • Delta Lake

  • Spark / PySpark

  • Azure Synapse

  • Data Lake Architecture

  • Cloud Data Platforms

  • Data Governance & Data Quality

  • CI/CD for Data Solutions


Key Skills & Experience

  • Databricks Development

  • Data Engineering

  • ETL/ELT Design & Development

  • Enterprise Data Platforms

  • Data Modernization

  • Data Migration

  • Data Warehousing

  • Cloud Data Platforms

  • SQL & Python Development

  • Data Quality & Validation

  • Agile Delivery

  • Stakeholder Collaboration


Ideal Candidate Profile

We are seeking a developer who:

✅ Has hands-on Databricks experience and can contribute immediately

✅ Understands enterprise data concepts and platform modernization initiatives

✅ Has strong ETL/ELT and data engineering experience

✅ Can partner effectively with architects, project managers, and business teams

✅ Is comfortable working in a fast-paced, highly visible enterprise transformation program

✅ Can help build a scalable lakehouse architecture supporting reporting, analytics, and future AI capabilities

or