Databricks Data Engineer

About the role

Accenture is seeking a Databricks Data Engineer with strong Python expertise to design, build, secure, and maintain scalable data pipelines on cloud platforms. You will transform heterogeneous data sources into reliable, well‑documented datasets that power analytics and business reporting.

Key responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks and Python.
• Create ingestion, transformation, and processing workflows from diverse data sources.
• Work with Azure and/or AWS data services, data lakes, and enterprise data ecosystems.
• Ensure pipelines are secure, performant, and highly available.
• Implement monitoring, alerting, and incident‑analysis processes.
• Support data‑quality activities such as validation, cleansing, and consistency checks.
• Contribute to data modeling and transformation to meet business needs.
• Document data flows, technical designs, and operational procedures.
• Collaborate with business, analytics, architecture, and operations teams in an Agile environment.

Required profile

• Minimum 4 years of experience in data engineering or data manipulation projects.
• Hands‑on experience with Databricks and Python programming.
• Proven ability to design and build ETL/ELT pipelines.
• Strong understanding of data lakes, cloud data platforms, and modern data architectures.
• Experience with Azure and/or AWS cloud environments.
• Knowledge of data transformation methodologies and data‑modeling concepts.
• Ability to write clean, maintainable, and well‑documented code.

Required skills

• Databricks
• Python
• Azure Data Factory
• Azure cloud services
• AWS data services
• DataOps practices
• FinOps dashboards or cost‑optimization reporting
• Power BI or similar reporting tools