
Databricks, Senior Data Engineer
ZencorePosted 3/3/2025

Databricks, Senior Data Engineer
Zencore
Job Location
Job Summary
Zencore is seeking an experienced Senior Data Engineer with expertise in Google Cloud and Databricks. The ideal candidate will have 5+ years of experience in data engineering, 2+ years of experience working with Databricks, and a strong understanding of the Databricks tech stack. They should be proficient in Python, PySpark, Spark SQL, Delta Lake technology, and Spark Structured Streaming. As a trusted advisor to customers, they will work on large-scale projects, leveraging Databricks to accelerate timelines and remove risk. With a focus on collaboration, empathy, and proactive practices, Zencore aims to provide exceptional customer experiences. The company values trust, unbiased opinions, and a drive to improve. By joining the team, you'll have opportunities for growth, flexible remote work options, and $4,000/year travel stipends.
Job Description
Who we need...
- 5+ years of experience serving in a data engineering capacity
- 2+ years of experience working with Databricks
- Preferred candidates will have the Databricks’ Data Engineer Associate or Data Engineer Professional certification
- Familiarity with the Databricks tech stack related to data engineering: notebooks, clusters, jobs, workflows, serverless sql, unity catalog, repos, dashboards, DLT, etc.
- Experience developing production Spark applications
- Strong skills with Python, PySpark and Spark SQL
- Strong understanding of Delta Lake technology and best practices to apply its capabilities during the data pipeline development lifecycle
- Experience with Spark Structured Streaming and Databricks Delta Live Tables (DLT)
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Understanding of incremental update patterns and technologies available on Databricks such as CDC, SCD#2, autoloader, change data feed (CDF), DLT, Delta Lake ACID, etc.
Why work here...
- We are professionals you can Trust. Our people have the extensive experience to get the job done
- We share unbiased opinions and are comfortable with the hard truths. You are the subject matter experts for our customers.
- We are the Missing Link. You will connect our customers to Google and move quickly when others can’t
- We remove uncertainty and risk by clearly outlining the process of cloud migration for our customers
- We accelerate timelines and do not dwell on a challenge. You’ll move faster and expose “unknown unknowns” for our customers
- We show empathy. Our customers believe in us because we can relate to their complexities.
How to succeed...
- First rule at Zencore - Be Kind
- Own the process - own your customer’s success by proactive practices
- Work hard to reach the destination, but make sure to enjoy the journey
- Champion a consistent collaborative culture
- Be receptive to Feedback
- Challenge the Status Quo