| Description |
Intermediate Data Engineer Our Client is seeking an Intermediate Data Engineer to design and build high-impact, scalable data pipelines and platforms that drive evidence-based decision-making and regulatory excellence. Be part of a meaningful mission where your expertise ensures data is trusted, accessible, and ready for the future—helping shape policies that matter most.
Responsibilities- Design and implement secure, scalable data architecture on Microsoft Azure supporting cloud-native and hybrid needs.
- Develop data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics.
- Manage data lakes and structured storage with Azure Data Lake Storage Gen2, ensuring quick and governed access.
- Integrate data from diverse sources including ServiceNow and geospatial systems using APIs and custom scripting.
- Build and optimize data models and semantic layers for analytics, reporting, and machine learning.
- Develop secure data APIs with Azure API Management for seamless data sharing.
- Enforce data governance, metadata management, and compliance standards, including privacy regulations.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Leverage AI tools and automation to streamline workflows and improve code quality.
Qualifications- Post-secondary degree, diploma, or certificate in Computer Science or related field.
- Proven experience building scalable data pipelines with Azure Databricks, Delta Lake, and related tools.
- Strong knowledge of Python (including PySpark), SQL, and ETL/ELT workflows in a large-scale cloud environment.
- Familiarity with Azure services like Storage, SQL, Synapse, networking, and authentication methods.
- Experience with data governance, security, and metadata management.
- Hands-on experience with version control tools like Github or Git.
Nice to Have Skills- Business requirements analysis related to data manipulation and cleansing.
- Strong technical knowledge of Microsoft SQL Server.
- Experience extending solutions to Synapse Analytics and Microsoft Fabric.
- Experience with government cloud environments, Talend, RESTful APIs, and message queuing technologies.
- Familiarity with ServiceNow and enterprise data management platforms.
Seize this opportunity to shape the future of data systems and contribute to a meaningful cause. Apply today and become a vital part of a project that makes a difference!
At Aplin — together with our brands CompuStaff, Impact Recruitment, and Vantix Systems — we connect great people with great organizations across North America. We believe diverse teams build stronger companies, and we welcome applicants from all backgrounds, experiences, and perspectives. We use AI tools to assist in a fair and efficient matching process, helping our recruiters connect the right people with the right opportunities. To be considered, applicants must be legally entitled to work in Canada, including holding any required permits. Our recruitment services are always free for job seekers. |