Azure Databricks Platform Engineer

Tas Daimler

Bengaluru, KA, IndiaYesterday

Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.

Key details

Location
Bengaluru, KA, India
Work style
Onsite
Level
Senior
Experience
5–8 yrs
Function
DevOps / Infrastructure
Focus area
Infrastructure / Cloud
Posted
Yesterday

Skills

azureci/cdcloud securitydata architecturedata engineeringdata governancedata modelingdata pipelinesdata qualitydatabricksetlgitgithubinfrastructure as codellmmlopspower bipysparkpytestpythonregression testingsparksqlstakeholder managementvault

About the role

Role: Azure Databricks Platform Engineer

Role Description

Support the Platform Team in designing, implementing, and scaling Azure and Databricks-based data and platform solutions. The role combines hands-on engineering with platform ownership, automation, team collaboration, and continuous improvement.

Key Responsibilities

Design, build, and maintain scalable Azure services and Azure Databricks solutions.

Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.

Support GitHub, CI/CD, IAM, security, monitoring, and platform configurations.

Drive platform automation, standardization, reusability, and optimization.

Explore AI, LLMs, and emerging technologies to build and scale solutions and present relevant ideas to the team.

Collaborate with cross-functional teams and guide team members on technical topics.

Role: Azure Databricks Platform Engineer

Role Description

Support the Platform Team in designing, implementing, and scaling Azure and Databricks-based data and platform solutions. The role combines hands-on engineering with platform ownership, automation, team collaboration, and continuous improvement.

Key Responsibilities

Design, build, and maintain scalable Azure services and Azure Databricks solutions.

Develop and optimize ETL/ELT pipelines using Python, PySpark, and SQL.

Support GitHub, CI/CD, IAM, security, monitoring, and platform configurations.

Drive platform automation, standardization, reusability, and optimization.

Explore AI, LLMs, and emerging technologies to build and scale solutions and present relevant ideas to the team.

Collaborate with cross-functional teams and guide team members on technical topics.

Required Skills

5+ years of experience in Data Engineering, Platform Engineering, or a similar role.

Strong hands-on experience with Azure Services and Azure Databricks.

Experience in solution/component design and development, including participation in or leading technical design reviews.

Strong proficiency in Python, PySpark, and SQL.

Strong understanding of ETL/ELT, data pipelines, data modeling, and data architecture.

Good knowledge of Git, GitHub, CI/CD, and automated deployment practices.

Experience with Python package management and release processes, including building and deploying Wheel packages.

Hands-on experience with Pytest and automated unit, integration, and regression testing.

Experience with IAM, cloud security, Key Vault, Storage, and monitoring.

Understanding of Data Governance, Data Quality, and Databricks Unity Catalog.

Knowledge of AI and LLMs and their application in building and scaling solutions.

Strong problem-solving, communication, collaboration, stakeholder management, and team coordination skills.

Good to Have

  • Experience with Azure Web Apps / App Services.
  • Knowledge of Infrastructure as Code (IaC) and Declarative Asset Bundles.
  • Exposure to streaming technologies, MLOps, and Power BI/Fabric.

Required Skills

5+ years of experience in Data Engineering, Platform Engineering, or a similar role.

Strong hands-on experience with Azure Services and Azure Databricks.

Experience in solution/component design and development, including participation in or leading technical design reviews.

Strong proficiency in Python, PySpark, and SQL.

Strong understanding of ETL/ELT, data pipelines, data modeling, and data architecture.

Good knowledge of Git, GitHub, CI/CD, and automated deployment practices.

Experience with Python package management and release processes, including building and deploying Wheel packages.

Hands-on experience with Pytest and automated unit, integration, and regression testing.

Experience with IAM, cloud security, Key Vault, Storage, and monitoring.

Understanding of Data Governance, Data Quality, and Databricks Unity Catalog.

Knowledge of AI and LLMs and their application in building and scaling solutions.

Strong problem-solving, communication, collaboration, stakeholder management, and team coordination skills.

Good to Have

  • Experience with Azure Web Apps / App Services.
  • Knowledge of Infrastructure as Code (IaC) and Declarative Asset Bundles.
  • Exposure to streaming technologies, MLOps, and Power BI/Fabric.

Mercedes-Benz Research & Development India, Embassy Crest (IN560066B)
'Embassy Crest' Plot No 5,
EPIP Zone, Phase 1, , 560 066

Get jobs like this as soon as they're posted

JobSuited checks company career sites all day and ranks every opening against your profile. Free to join.

Create a free account