This job board retrieves part of its jobs from: Emploi Étudiant | Toronto Jobs | Work From Home

Tech jobs every day in Canada!

To post a job, login or create an account |  Post a Job

   Canadian Tech jobs   

Website updated every day with fresh jobs in the IT industry

Slide 1
Slide 2
Slide 3
previous arrow
next arrow

Data Engineer

Project X Ltd.

This is a Contract position in Oliver, ia posted July 23, 2021.

About Project X The heart of what we do is drive for unique and innovative solutions that solve our customers problems.

We are trusted advisors who create data and analytics solutions for complex client problems.

We do this through collaboration, creativity and an innate need to solve tough data problems.

Data runs deep in our veins and is what makes up who we are, individually and as a team, allows us to do the work we’re passionate We think differently.

You are all about Being that Data Engineer who receives detailed and high-level requirements & specifications from the client for implementation.

You will analyze, design, develop, optimize, test, and document Data programs and solutions to meet our clients’ needs.

You will work with Architects, Designers, Business Analysts, and other Developers to provide quality development deliverables.

This position does not have any direct reports.

What you need to Bring Experience in Designing and implementing technical enhancements of Data Warehouse, Big Data or Business Intelligence as required.

A proven understanding and track record in one of AWS, Azure, GCP, or other open-source stacks.

Object oriented programming, API integration and understanding of the modern data engineering stack.

Ability to build high quality code in Python for data integration.

Strong ability and understanding of RDBMS and SQL data structures.

Utilize scripting, library and other external programming languages to complement and enhance the functionality the data integration tools provide.

Apply scheduling, automation and innovation on new and existing data platforms for those development projects aligned to the client’s business or organizational strategies.

Participate in the requirements gathering, analysis and solutions design.

Conduct unit & integration tests, assisting in test preparations to ensure data integrity, data quality, and program functional completeness & correctness.

Create detailed technical documentation for all programs and other deliverables.

Implement processes aligned to data management best practices (as defined or adopted by the client – like DevOps, Agile) and standards, ensure data quality and process performance within all system development deliverables.

Own the responsibility to meet deadlines and strive to complete work in accordance with project plans.

Participate in the development of project plans to establish appropriate workload expectations and schedules.

Demonstrate collegial teamwork internally and with clients, by communicating clearly with all project team members to identify and resolve issues for delivery success.

Contribute to lessons learned and process improvements.

Apply new technologies to improve work efforts when available through R&D and POCs.

Maintain an up-to-date knowledge of, and adopt, relevant market trends and practices.

Over 2 years of Required Skills, Knowledge and Experience Working on technical projects as a Data Pipeline Developer/Engineer providing technical solutions through the use of Big Data Tools.

Detailed, practical working knowledge in Big Data pipeline, data query/ ingestion tools like Glue, Hive, Sqoop, Spark, Kafka, Impala.

Hadoop, Oozie, Etc.

Proven experience using Restful Webservices and JSON.

Working Knowledge in Scripting languages like Python, Java, Shell, Bash, SQL Programming, creating/optimize complex queries, tables, view, and procedures Scheduling Tools – Airflow, Luigi, Oozie, Cron Cloud and on-premise technology from infrastructure through the technology stack like AWS, GCP or Azure General knowledge in Data modeling, Working knowledge of data modelling and data modelling concepts such as logical/physical modelling.

Data warehousing, including data mapping and transformations, data dependencies, data source analysis and profiling Above average skills in communication, solution-based approaches to solving problems, level-headed decision making, time management, prioritizing effectively while delivering high quality work, as well as collaborating with internal teams (Project X ltd.), external teams (non-Project X 3rdparties), and client team members Demonstrated skills in leadership and integrity and working independently Proven ability to meet deadlines and commitments, adaptive and flexible and approach situations with a consultative mindset Agile delivery methodology, DevOps, Continuous Integration/Continuous Deployment concepts and method.

Testing automation and Other related or emerging technologies is an asset Education and Experience Bachelor’s degree, preferably in Software or Computer Science/Engineering Fields or have related industry experience or acumen 2 years of proven Data Engineering experience on AWS, Azure, GCP or other Open-Source platforms.

Work Environment We are currently a virtual working organization.

In the future we may move back to where our work takes place in office environments, either at Project X HQ or on various client sites.

In our commitment to promote fair and equitable treatment of all employees and applicants, Project X Ltd.

provides equal employment opportunities for all individuals regardless of age, sex, disability, race, ethnic origin, citizenship, creed, sexual orientation, marital status or any other ground as described in the Ontario Human Rights Code.

In addition, accommodation will be provided during the hiring process.

 Due to the current COVID-19 pandemic: Interview will be conducted online Project X Ltd.

Staff currently work from home