Data Engineer Job at I-cube Software Llc, Canada

ZE9NZFVrUjhnbFdvMVJ5dVFmOWJqclZhTFE9PQ==
  • I-cube Software Llc
  • Canada

Job Description

Job Description

Job Description

Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases.

Design, build, and maintain Big Data workflows/pipelines to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.


Demonstrated work experience in the following with Big Data and distributed programming models and technologies
Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL).
Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines
Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive
Understanding of Map Reduce and other Data Query and Processing and aggregation models
Understanding of challenges of transforming data across distributed clustered environment
Experience with techniques for consuming, holding, and aging out continuous data streams
Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs

Preferred:

Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running
Building and managing high-availability environments for databases and HDFS systems
Familiarity with transaction recovery techniques and DB Backup

Skills and Attributes:

Ability to have effective working relationships with all functional units of the organization
Excellent written, verbal, and presentation skills
Excellent interpersonal skills
Ability to work as part of a cross-cultural team
Self-starter and Self-motivated
Ability to work without lots of supervision
Works under pressure and is able to manage competing priorities.

Hide

Job Tags

Work experience placement,

Similar Jobs

Thermo Fisher Scientific

CTD Financial Planning and Analysis Sr Mgr Job at Thermo Fisher Scientific

CTD Financial Planning and Analysis Sr MgrJoin to apply for the CTD Financial Planning and Analysis Sr Mgr role at Thermo Fisher ScientificWork Schedule: Standard (Mon-Fri)Environmental Conditions: OfficeThermo Fisher Scientific Inc. is the world leader in serving... 

Technical Professionals Group

Acid Unloader Job at Technical Professionals Group

 ...Job Description Job Description POSITION OVERVIEW To support the Operations in safely unloading acid for storage and delivery to other customers and the Mine for their leaching operations. Upon successful completion of training, the candidate will be able to solely... 

Lakeland Media

Sports Director & KWLM Morning Show Host Job at Lakeland Media

Overview We are seeking a dynamic and versatile Sports Director & KWLM Morning Show Host to join our team. This unique role combines...  ..., disability, or veteran status.Job Details Seniority level: Entry levelEmployment type: Full-timeJob function: OtherIndustries... 

Walt Disney Company

Housekeeping Room Attendant - Full & Part Time, $31.23/Hour Job at Walt Disney Company

 ...responsible for cleaning and maintaining all hotel property Guest rooms which includes...  ...and bathrooms on specified days Perform nightly turndown duties for VIP level and specified...  ...alone in guest rooms for most of the shift Preferred Qualifications: Enjoys... 

Santa Clara University

On-Call Liturgical Musician Job at Santa Clara University

 ...role, and internal equity. Pay Frequency: Hourly POSITION PURPOSE The Liturgical Musician is responsible for providing music for the Sunday masses in the Mission Church. This is a part-time, 5-10 hours per week position reporting to the Director of Liturgy...