Databricks / ADF / Python / Pyspark

FULL_TIME 3 weeks ago
Employment Information

Role & responsibilities


Must Have:

  • Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark
  • Proficient with Databricks & Python
  • Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities
  • Senior SME with SQL Server required.
  • Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT.
  • Proficiency with Azure Cloud data environments highly desired.
  • Excellent verbal communication skills. Good problem-solving skills. Attention to detail.
  • Proficiency with Data Warehousing principals and design

Nice to have:

  • Familiarity with oData Services/Kafka/ Azure Data Factory
  • Familiarity with Terraform, Unity Catalog
  • Familiarity with other database technology such as Mongo, Cosmos, MySQL or Oracle a plus