Temporaryjobs Logo
Insight Global logo

Data Engineer

Canada
Senior Level
CONTRACTOR

About the role

Required Skills & Experience Experience leading multi-skilled agile teams as a Sr Data Engineer. Proven, hands-on experience designing, building and productionizing modern data-intensive applications, including orchestration and operation. Deep, hands-on Snowflake expertise: warehouse design, SQL/Snowpark, dbt, dynamic tables, data sharing, cost/performance optimization. Strong Apache NiFi / Snowflake Openflow skills: designing, deploying and monitoring flow-based pipelines, custom processors, and CDC/streaming ingestion at scale. Broad knowledge of the full spectrum of data technologies (ingestion, transformation, storage, presentation, consumption) and the ability to integrate them into successful solutions. Strategic design-thinking experience: problem conceptualization, roadmap definition, architecture realization, and risk management. Strong Proficiency in SQL and Python, with a solid understanding of ETL/ELT patterns, data modelling (star/snowflake schema, SCD), and CI/CD for data (Git, testing, orchestration).

Job Description Design and hands-on build of end-to-end data solutions on Snowflake, owning functional and non-functional designs from concept through to production. Develop ingestion and integration pipelines using Snowflake Openflow (Apache NiFi 2.0-based): building visual, low-code flow definitions to ingest multi-source data (CDC from SQL Server/Oracle, REST APIs, event streams, files, SharePoint) into Snowflake without managing separate ETL infrastructure. Configure NiFi processors, controller services, and parameter groups for structured, semi-structured, streaming and unstructured data movement in both batch and streaming modes, applying secure OAuth2/TLS authentication and RBAC. Work closely with Ops and Infrastructure architects to productionize robust, resilient, and maintainable solutions, and with customer architects to agree functional and non-functional designs, advising, questioning, and guiding sound design outcomes. Build Snowflake-native transformations (dbt, Snowpark, Notebooks, tasks/streams, dynamic tables) and medallion (Bronze/Silver/Gold) architectures with automated, metadata-driven pipelines and robust error handling. Develop policy and standards, share knowledge, and mentor, coach and develop a small number of staff.

We may use artificial intelligence tools to assist with the screening, assessment, or selection of potential applicants for this position.

About Insight Global

Staffing and Recruiting