Lead Data Engineer

Job Title: Lead Data Engineer

Key Skills: DBT, Python, SQL, Snowflake, Databricks

Location: Brazil

Mode: Remote

We at Coforge are hiring Lead Data Engineer with the following skill set.

Key Responsibilities

Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and promoting engineering excellence.

Own the end-to-end architecture and design of the data platform, ensuring scalability, reliability, and alignment with business needs.

Take full ownership of implementation delivery, from design through deployment, ensuring high-quality, production-ready solutions.

Define and drive the data migration strategy from Snowflake / SSIS to Azure Databricks and DBT, including architecture decisions and execution oversight.

Collaborate closely with cross-functional stakeholders (data, product, architecture, and business teams) to translate requirements into robust technical designs.

Design and oversee the development of scalable data pipelines and data models, ensuring best practices in performance and maintainability.

Lead the implementation of infrastructure-as-code using Terraform, enforcing consistency and automation across environments.

Establish and enforce architectural standards, design patterns, and engineering best practices across the data ecosystem.

Ensure reliable and efficient data integration between Legacy system and Azure environments, with strong focus on data quality and observability.

Drive CI/CD adoption and oversee release processes for data pipelines and platform components.

Act as the primary technical owner for troubleshooting complex issues and ensuring long-term stability of the platform.

Maintain comprehensive documentation of architecture, design decisions, and implementation standards.

Required Skills & Qualifications

Proven experience owning system design and leading implementations of large-scale data platforms.

Strong hands-on expertise with Snowflake, Azure Databricks, and DBT with strong Python.

Will have worked on large scale data transformations comprising of thousands of DBT models and data pipelines handling terabytes of data daily

Deep understanding of data architecture, data modelling, and distributed data systems.

Extensive experience with Terraform and infrastructure-as-code principles.

Demonstrated experience leading cloud-to-cloud data migration projects (AWS to Azure preferred).

Strong experience with CI/CD pipelines and Git-based version control.

Advanced SQL skills and deep knowledge of ETL/ELT frameworks.

Strong problem-solving skills with the ability to make architectural trade-offs and decisions.

Excellent communication skills, with the ability to influence both technical and non-technical stakeholders.

Ability to thrive in a fast-paced, ownership-driven environment.

Previous experience in the insurance or financial sector industry, with strong understanding of core domains such as claims, policies, underwriting, and risk.

Will have manged teams with a level of maturity and able to demonstrate key success outcomes with these teams.

Will have managed low, mid and top performers within the team to get the best from them via mentoring, development and training needs where needed.

Preferred Skills:

Experience implementing data governance, observability, and quality frameworks.

Strong knowledge of security and compliance standards in insurance or financial services.

Experience with real-time and streaming data technologies (Kafka, Event Hubs, Delta Live Tables).

Familiarity with lakehouse architecture and cost/performance optimization strategies.

Experience operating in multi-cloud or hybrid cloud environments.

Posted On: 14-07-2026

At Coforge, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.