103 Emplois pour Data Engineer - Canada
Data Engineer
Toronto, Ontario
Envision Financial
Aujourd'hui
Emploi consulté
Description De L'emploi
We are currently seeking a Data Engineer to join our team.The Data Engineer is responsible for designing, building, and managing assets and pipelines for data collection, storage, and analysis within Microsoft and Oracle environments. This role involves integrating large datasets from multiple sources to ensure that data is accessible, consistent, and of high quality for reporting/dashboards, insights, and analytics. Experience is required with Microsoft Azure cloud services, SQL Server, Oracle Database, and Oracle Cloud Infrastructure to develop scalable data solutions. Additionally, responsibilities include ensuring our data pipelines are robust and secure, supporting data-driven decision-making across the organization.
We are open to filling this role across Canada, however, please note preference will be given to those that are located in BC due to the proximity of our office locations. To be considered for this role, when applying, you must be eligible to work in Canada.
Here’s what would be included as a part of your typical day Design and Develop Data Pipelines: Creates scalable data pipelines and ETL processes to extract, transform, and load (ETL) data from Microsoft and Oracle systems into centralized repositories. Use Fabric, Azure Data Factory and Oracle Data Integrator for efficient data extraction and transformation. Data Storage & Management: Create and manage databases, data warehouses, and data lakes on Microsoft SQL Server/Azure and Oracle. Ensure high performance and reliability by designing, indexing, and partitioning relational databases. Monitor and tune database health to meet business needs. Ensure Data Quality, Security, and Governance: Implement data quality controls, validation rules, and cleansing processes to maintain the integrity and accuracy of data within pipelines. Adhere to data governance standards and security protocols across both platforms, incorporating data masking or encryption where necessary, to ensure compliance with industry regulations and corporate policies. Develop and Optimize Data Models: Design efficient data models and schemas for analytics and reporting on Azure and Oracle. Structure databases and data warehouses to support querying and BI reporting, and update architecture as needed. Data Insights Support: Work with analytics teams to ensure that data is available and appropriately structured for BI tools. Provide curated datasets or views for reporting and assist in the creation of dashboards and reports, particularly with Microsoft Power BI, to convert raw data into actionable insights. Performance Monitoring & Troubleshooting: Monitor data pipeline and database performance and quickly resolve any issues. Use monitoring tools and logs to identify anomalies or bottlenecks. Optimize SQL queries, ETL jobs, and storage designs to improve throughput and reduce latency or cost. Reporting and Dashboarding: Design and develop efficient reports and dashboards in Power Bi-Microsoft Fabric and Oracle Analytics Cloud Platforms Required Skills, Experience & Qualifications Bachelor’s degree in computer science, Information Systems, or a related field required. 5 years of professional experience in data engineering, data platform management or related roles, or a combination of education and experience Exceptional problem-solving and analytical skills to troubleshoot complex data issues and devise efficient solutions. Excellent communication skills, with the ability to translate complex technical information into business terms for non-technical stakeholders. Ability to work under pressure and manage multiple projects and deadlines efficiently. Meticulous attention to detail and a commitment to data accuracy and quality. A growth mindset and eagerness to stay updated with new technologies and industry best practices. Expertise in data engineering, data management and data integration tools and technology stack Expertise in data modeling, database design, and data integration. Proficiency in SQL, Python, and other relevant programming languages. Displays an understanding of risk and risk ownership by being able to demonstrate adherence to policies and procedures.
We are open to filling this role across Canada, however, please note preference will be given to those that are located in BC due to the proximity of our office locations. To be considered for this role, when applying, you must be eligible to work in Canada.
Here’s what would be included as a part of your typical day Design and Develop Data Pipelines: Creates scalable data pipelines and ETL processes to extract, transform, and load (ETL) data from Microsoft and Oracle systems into centralized repositories. Use Fabric, Azure Data Factory and Oracle Data Integrator for efficient data extraction and transformation. Data Storage & Management: Create and manage databases, data warehouses, and data lakes on Microsoft SQL Server/Azure and Oracle. Ensure high performance and reliability by designing, indexing, and partitioning relational databases. Monitor and tune database health to meet business needs. Ensure Data Quality, Security, and Governance: Implement data quality controls, validation rules, and cleansing processes to maintain the integrity and accuracy of data within pipelines. Adhere to data governance standards and security protocols across both platforms, incorporating data masking or encryption where necessary, to ensure compliance with industry regulations and corporate policies. Develop and Optimize Data Models: Design efficient data models and schemas for analytics and reporting on Azure and Oracle. Structure databases and data warehouses to support querying and BI reporting, and update architecture as needed. Data Insights Support: Work with analytics teams to ensure that data is available and appropriately structured for BI tools. Provide curated datasets or views for reporting and assist in the creation of dashboards and reports, particularly with Microsoft Power BI, to convert raw data into actionable insights. Performance Monitoring & Troubleshooting: Monitor data pipeline and database performance and quickly resolve any issues. Use monitoring tools and logs to identify anomalies or bottlenecks. Optimize SQL queries, ETL jobs, and storage designs to improve throughput and reduce latency or cost. Reporting and Dashboarding: Design and develop efficient reports and dashboards in Power Bi-Microsoft Fabric and Oracle Analytics Cloud Platforms Required Skills, Experience & Qualifications Bachelor’s degree in computer science, Information Systems, or a related field required. 5 years of professional experience in data engineering, data platform management or related roles, or a combination of education and experience Exceptional problem-solving and analytical skills to troubleshoot complex data issues and devise efficient solutions. Excellent communication skills, with the ability to translate complex technical information into business terms for non-technical stakeholders. Ability to work under pressure and manage multiple projects and deadlines efficiently. Meticulous attention to detail and a commitment to data accuracy and quality. A growth mindset and eagerness to stay updated with new technologies and industry best practices. Expertise in data engineering, data management and data integration tools and technology stack Expertise in data modeling, database design, and data integration. Proficiency in SQL, Python, and other relevant programming languages. Displays an understanding of risk and risk ownership by being able to demonstrate adherence to policies and procedures.
Désolé, cet emploi n'est pas disponible dans votre région
0
Data Engineer
Toronto, Ontario
ICONMA
Aujourd'hui
Emploi consulté
Description De L'emploi
Our Client, a Banking company, is looking for a Data Engineer for their Toronto, ON/Hybrid location.
Requirements: Positive attitude, can take ownership of tasks. Ability to drive initiatives for the team. Guide team when needed, jump on fires when needed. Azure Data Factory – Data ingestion, transformation & ADLS integration Databricks & PySpark – Complex transformations & performance tuning Azure DevOps – CI/CD pipeline expertise SQL – Advanced querying & optimization Problem-Solver – Strong debugging and troubleshooting skills Understanding pro’s/cons of the solution they are recommending
Why Should You Apply? Excellent growth and advancement opportunities
Requirements: Positive attitude, can take ownership of tasks. Ability to drive initiatives for the team. Guide team when needed, jump on fires when needed. Azure Data Factory – Data ingestion, transformation & ADLS integration Databricks & PySpark – Complex transformations & performance tuning Azure DevOps – CI/CD pipeline expertise SQL – Advanced querying & optimization Problem-Solver – Strong debugging and troubleshooting skills Understanding pro’s/cons of the solution they are recommending
Why Should You Apply? Excellent growth and advancement opportunities
Désolé, cet emploi n'est pas disponible dans votre région
Soyez le premier informé
À propos du dernier Data engineer Emplois dans Canada !
1