Lead Data Engineering Services
NewselaJob Summary
We are seeking a Lead Data Engineer (Contractor) based in Brazil or Argentina. In this role, you will collaborate with app developers and data stakeholders to implement data system changes and address data inquiries. You will lead initiatives from problem definition through scoping, design, and planning using epics and blueprints. With your expertise, you will develop documentation, deliver technical presentations, conduct discussions, and review incidents. Key responsibilities include building and maintaining data pipelines and DAG tooling, establishing a data catalog with business-related metadata, optimizing SQL query performance, implementing data testing strategies, and leveraging DBT orchestration. Experience with cloud-based infrastructure (AWS, GCP) using Terraform is a plus. This contract role does not offer company-sponsored benefits.
Skills
Company Benefits
- ✓No company-sponsored benefits available
Seeking to hire a Contractor based out of Brazil or Argentina for Lead-Level Data Engineering Services.
Scope of Services:
As a Contractor you will work alongside app developers and data stakeholders to create data system changes and to respond to data inquires
You will Lead initiatives and problem definition scoping, design, and planning through epics and blueprints.
With your deep domain knowledge and radiation of that knowledge you will develop documentation, technical presentation, discussion, and incident reviews.
You will build and maintain data pipelines and DAG tooling
You will establish and maintain a data catalog with business-related metadata
Skills & Experience:
Mastered proficiency in SQL, Python, and relational datastores (columnar and row databases)
Proficiency in building and maintaining data pipelines and DAG tooling (Dagster, Airflow, etc)
Advanced experience with event-based pipelines and CDC tooling
Advanced experience in managing large-scale data migrations in relational datastores
Advanced experience in optimizing SQL query performance
Advanced experience with data testing strategies to ensure resulting datastores are aligned with expected business logic
Experience with DBT orchestration and best practices
Experience with enabling monitoring, health checks and alerting on data systems and pipelines
Experience establishing and maintaining a data catalog with business-related metadata
Experience building tools and automation to run data infrastructure
Experience with writing and maintaining cloud-based infrastructure for data pipelines (AWS, GCP and Terraform) is a plus
Experience in document, graph or schema-less datastores is a plus
Please note that given the nature of the contract, this role will not be eligible to participate in company-sponsored benefits.
