Data Engineer

Data Engineer

09-09-21
N/A Id: 16010 - Contract

IT/IQ Tech Recruiters is seeking a Data Engineer to join our client Richmond, BC (Remote).

Why work with our client?

  • Competitive rates
  • Centrally located
  • Transit accessible

Responsibilities

System Design:
 

  • Design reliable architected streaming data pipelines
  • Design complex tabular models for Power BI reporting
  • Perform process/product/component evaluations and make recommendations on implementation details when not specified by existing standards/architecture
  • Conduct reviews of processes, code, and database objects
  • Document data flows/processes and systems
  • Maintain and manage the data strategy and governance for curated/shared data models (datasets)
  • Attain and apply understanding of business needs and technical factors to design data architectures that are aligned to strategy and standards
  • Support a culture of data stewardship and management
  • Collaborate and align practices with Enterprise Architecture
  • Continually examine internal process and how Power Platform objects are being utilized and recommend and implement improvements

 

System Implementation:

 

  • Construct robust and highly performant streaming data pipelines using Python and Spark
  • Construct robust and highly performant data flows using Azure Data Factory
  • Construct and deploy Tabular models in Azure Analysis Services and Power BI
  • Manage and develop data models for reporting in Azure Synapse, MSSQL, and ADLS Data Lake
  • Maintain/ensure data dictionary and lineage are kept current
  • Employ GIT for tracking code changes in Azure DevOps
  • Collaborate with team members to estimate and plan sprints
  • Serve as technical expert for challenging issues regarding data
  • Contribute to project conceptual and logical designs when no reference architecture exists

 

Ad-Hoc & Other:
 

  • Generate ad-hoc data analysis utilizing Power BI, R, Python, Excel, and/or other tools.
  • Report status and progress to Reporting Manager and Scrum Master
  • Conduct training and mentoring of junior BI engineers/developers
  • Stay up-to-date on all new Power BI features and functionalities and find ways to introduce them to the organization
  • Other duties as assigned

 

Top Skills Required

  • Must have a technical degree/diploma in a related field of study or equivalent relevant work experience
  • Must have strong written and verbal communication skills
  • Have at least 5 years of experience in business intelligence as a developer/data engineer/data architect
  • Deep understanding of Azure Databricks, Azure Data Factory, Synapse, Analysis Services Tabular modeling and PowerBI reporting
  • Demonstrated ability to perform dimensional and relational modelling
  • High degree of expertise in writing DAX expressions
  • Experience building ETL pipelines using Azure Data Factory
  • Proficient in Python/PySpark and Spark workloads
  • Experience using GIT source control and branching for development and automated deployments
     

Preferred Qualifications (Desired Skills/Experience)
 

  • Experience creating rich visuals using PowerBI or Tableau
  • Demonstrated knowledge of Microsoft BI stack
  • Demonstrated knowledge of ETL best practices (Performance by design, Delta loads, Control files, parallel bulk loading, etc.)
  • Programming experience in C#
  • Understanding of M Query (Power Query)
  • Experience using XMLA
  • Have significant experience in working with very large data sets(>1TB)
  • Have experience working within Agile/Lean frameworks

 

Why work with us?

  • Build a long-term relationship with an experienced recruitment expert
  • Access to the ‘hidden’ job market – opportunities across Canada that aren’t posted on job boards
  • Get a high-level understanding of market dynamics affecting your industry
  • Gain insight into the culture of the company you’re applying for before submitting your profile

About Us

IT/IQ Tech Recruiters provides contract and permanent IT recruitment services to employers across Canada. We have a specialized approach to recruiting, segmenting our recruitment teams into specialty practice areas focusing on Development, PMO, Infrastructure and BI/CRM/ERP skill sets.

This approach enables our recruiters to become specialists; they know the market and work hard to understand each candidates’ capabilities, goals, career ambitions and quickly present them with the best possible opportunities.  We are committed to helping candidates develop their careers and to helping our clients grow their business and complete important projects successfully.

We create opportunities for IT Professionals to empower business.