Data Engineer Job at Diagonal Matrix Ltd, Remote

UENDVEozQ1VpbEFBanNhNHNQWmljQ3FZNlE9PQ==
  • Diagonal Matrix Ltd
  • Remote

Job Description

Data Engineer Location Remote :

A Data Engineer is responsible for designing, building, and maintaining systems and infrastructure for collecting, storing, and analyzing data. Their role bridges the gap between raw data and actionable insights, enabling organizations to make data-driven decisions. Here's a comprehensive :

Job Title : Data Engineer

Job Summary : The Data Engineer will design, develop, and optimize data pipelines, ensuring the availability, reliability, and quality of data for analysis and reporting. This role involves collaborating with data scientists, analysts, and other stakeholders to build scalable solutions and manage large datasets effectively.

Key Responsibilities :

  • Data Pipeline Development :
  • Design, build, and maintain scalable ETL (Extract, Transform, Load) pipelines.
  • Automate workflows to transform raw data into structured formats for analysis.
  • Database and Data Warehousing :
  • Develop and manage relational and NoSQL databases.
  • Implement and maintain data warehouses like Snowflake, Redshift, or BigQuery.
  • Data Quality and Governance :
  • Ensure data accuracy, completeness, and reliability.
  • Implement data validation techniques and governance frameworks.
  • Performance Optimization :
  • Optimize data architectures and queries for maximum efficiency.
  • Monitor and improve data pipeline performance and reliability.
  • Collaboration and Documentation :
  • Work closely with data scientists, analysts, and business teams to understand data requirements.
  • Document data architecture, processes, and workflows.
  • Technology and Tools :
  • Leverage tools and technologies such as Apache Spark, Hadoop, Kafka, and Python/Java for data processing.
  • Utilize cloud platforms (AWS, Azure, Google Cloud) for data storage and compute needs.

Skills and Qualifications :

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong experience with SQL and database management.
  • Proficiency in programming languages like Python, Scala, or Java.
  • Hands-on experience with big data tools (e.g., Hadoop, Spark, Kafka).
  • Familiarity with data warehousing concepts and platforms (e.g., Snowflake, Redshift).
  • Experience with cloud services (AWS, Azure, Google Cloud).
  • Knowledge of data modeling and data integration techniques.
  • Excellent problem-solving and communication skills.

Nice to Have :

  • Master's degree in a related field.
  • Experience with machine learning workflows and data preparation.
  • Certifications in relevant tools or platforms (e.g., AWS Certified Data Analytics, Google Professional Data Engineer).

Career Path :

Data Engineers often progress into roles like Senior Data Engineer , Data Architect , or Machine Learning Engineer , depending on their skill set and interests.

Job Types: Full-time, Contract

Pay: $140,028.00 - $180,580.00 per year

Benefits:

  • 401(k)
  • Dental insurance
  • Health insurance

Schedule:

  • Monday to Friday

Work Location: Remote

Job Tags

Full time, Contract work, Remote work, Monday to Friday,

Similar Jobs

Energy Transfer

Sr Account Manager Job at Energy Transfer

 ...driven to inspire our employees to create superior value for our customers, our investors, asustainable futureandgiving backto the...  ...developing new projects and negotiating terms and conditions for services Interacts with external customers, including producers, producer... 

BJ's Wholesale Club

Liquor & Lottery Clerk - Fast, Friendly Service Job at BJ's Wholesale Club

A leading wholesale retail company in Woodstock, Georgia is seeking a dedicated team member to process member purchases and provide exceptional customer service. You'll be responsible for scanning merchandise, handling cash payments, and maintaining a clean and organized...

Probitas Technology, Inc.

Mobile Crane Operator Job at Probitas Technology, Inc.

 ...A leading manufacturer and coater of steel line pipe for the oil and gas industry, is seeking a skilled and certified Mobile Crane Operator. The ideal candidate will be responsible for operating mobile cranes to safely and efficiently move, lift, and position heavy materials... 

Buckhead Meat and Seafood

Supervisor, Production - (Meat Processing) Job at Buckhead Meat and Seafood

 ...the material handling area for both direct and indirect labor. Manage employee performance through motivation, delegation, development...  ...and its employees. This job description supersedes prior job descriptions. #LI-GR1 #LI-ONSITE Buckhead Meat and Seafood

Cooper & Company

Head of Marketing Job at Cooper & Company

 ...aligned with the companys growth goals. Oversee all brand content: photography, social media, print, and website. Manage project...  ...-end residential architecture and construction. Excellent writing and communication skills. Organized, self-driven, and able to...