Lead Azure Databricks , Pyspark, Python : Onsite/Hybrid any location in Canada

Position : Lead Azure Databricks , Pyspark, Python : Only Canada Location : Canada any client location (Onsite / Hybrid : 2-3 days/ week) Type of Job : Contract : 12 Months Experience : 10+ Mandatory Skills Azure Databricks, Pyspark, Python Job description Total IT experience: 10+ years Azure cloud technologies: 5+ years Core Technical Skills • Strong experience in: o Azure Databricks o PySpark / Apache Spark o Python & SQL Expertise in: o ETL/ELT pipelines and orchestration o Data warehousing & data modeling o Optimization o Work Force Management experience Data Engineering Concepts • Data pipelines, ingestion frameworks • Delta Lake, Parquet formats • Batch & streaming processing Soft skills • Good communication skills • Stakeholder management Problem solving skills

The role involves leading projects utilizing Azure Databricks, PySpark, and Python to develop data solutions. The candidate will be responsible for managing data pipelines and ensuring efficient data processing.

Candidates must have over 10 years of IT experience, with at least 5 years in Azure cloud technologies. Strong technical skills in Azure Databricks, PySpark, and Python are mandatory.

Identified from the job description. Confirm important requirements above.

• Azure Databricks
• Pyspark
• Python
• SQL
• ETL
• ELT
• Data Warehousing
• Data Modeling
• Optimization
• Work Force Management
• Data Pipelines
• Ingestion Frameworks
• Delta Lake
• Parquet
• Batch Processing
• Streaming Processing

Minimum experience

10+ years