Role: Databricks Engineer

Location: Hyderabad

Exo Required: 5-10 years

Tech Stack: Databricks, Data factory, Python, Pyspark

Responsibilities:

Design, build, and maintain scalable and reliable data pipelines for batch and real-time processing.

• Develop and manage data infrastructure using cloud platforms (e.g., Azure, AWS, GCP).
• Implement CI/CD pipelines for data workflows and analytics applications.
• Monitor and optimize data systems for performance, reliability, and cost-efficiency.
• Automate deployment, testing, and monitoring of data services and infrastructure.
• Collaborate with data scientists, analysts, and business teams to ensure data availability and quality.
• Manage data versioning, lineage, and metadata for governance and traceability.
• Ensure high availability and disaster recovery for critical data platforms and services.
• Apply DevOps and DataOps best practices to streamline development and operations.
• Troubleshoot and resolve issues in production environments with a focus on root cause analysis and continuous improvement