Data Engineer - Snowflake Job at Tiger Analytics Inc., Chicago, IL

UGkyV0lIR1FpRkVFaGNDNHNmWmtlaTJkN1E9PQ==
  • Tiger Analytics Inc.
  • Chicago, IL

Job Description

Job Description

Job Description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best global analytics consulting team in the world.

The Data Engineer will be responsible for architecting, designing, and implementing advanced analytics capabilities. The right candidate will have broad skills in database design, be comfortable dealing with large and complex data sets, have experience building self-service dashboards, be comfortable using visualization tools, and be able to apply your skills to generate insights that help solve business challenges.We are looking for someone who can bring their vision to the table and implement positive change in taking the company's data analytics to the next level.

Requirements

Key Responsibilities:

Data Integration:

Implement and maintain data synchronization between on-premises Oracle databases and Snowflake using Kafka and CDC tools.

Support Data Modeling:

Assist in developing and optimizing the data model for Snowflake, ensuring it supports our analytics and reporting requirements.

Data Pipeline Development:

Design, build, and manage data pipelines for the ETL process, using Airflow for orchestration and Python for scripting, to transform raw data into a format suitable for our new Snowflake data model.

Reporting Support:

Collaborate with data architect to ensure the data within Snowflake is structured in a way that supports efficient and insightful reporting.

Technical Documentation:

Create and maintain comprehensive documentation of data pipelines, ETL processes, and data models to ensure best practices are followed and knowledge is shared within the team.

Tools and Skillsets:

Data engineering: proven track record of developing and maintaining data pipelines and data integration projects

Databases: Strong experience with Oracle, Snowflake, and Databricks.

Data Integration Tools: Proficiency in using Kafka and CDC tools for data ingestion and synchronization.

Orchestration Tools: Expertise in Airflow for managing data pipeline workflows.

Programming: Advanced proficiency in Python and SQL for data processing tasks.

Data Modeling: Understanding of data modeling principles and experience with data warehousing solutions.

Cloud Platforms: Knowledge of cloud infrastructure and services, preferably Azure, as it relates to Snowflake and Databricks integration.

Collaboration Tools: Experience with version control systems (like Git) and collaboration platforms.

CI/CD Implementation: Utilize CI/CD tools to automate the deployment of data pipelines and infrastructure changes, ensuring high-quality data processing with minimal manual intervention.

Communication: Excellent communication and teamwork skills, with a detail-oriented mindset. Strong analytical skills, with the ability to work independently and solve complex problems.

Requirements

  • 8+ years of overall industry experience specifically in data engineering
  • 5+ years of experience building and deploying large-scale data processing pipelines in a production environment.
  • Strong experience in Python, SQL, and PySpark
  • Creating and optimizing complex data processing and data transformation pipelines using python
  • Experience with “Snowflake Cloud Data warehouse” and DBT tool
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Understanding of Datawarehouse (DWH) systems, and migration from DWH to data lakes/Snowflake
  • Understanding of ELT and ETL patterns and when to use each. Understanding of data models and transforming data into the models
  • Strong analytic skills related to working with unstructured datasets
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management

Benefits

This position offers an excellent opportunity for significant career development in a fast-growing and challenging entrepreneurial environment with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.

Job Tags

Local area,

Similar Jobs

Domino's Franchise

Delivery Driver - 111-A W. Sunrise Hwy Job at Domino's Franchise

 ...about having fun? Then this is the job for you! Job Types: Full-time, Part-time So how do you make the dough?You are paid the minimum wage while clocked in. Your goal is to make at least 2 deliveries per hour. Tips for each delivery will vary. On average, you may get... 

LongHorn Steakhouse

Server Job at LongHorn Steakhouse

 ...position, pay will be variable by location - plus tips. Our Servers CANT FAKE our energetic, team-oriented culture. They create...  ...and Christmas Discounts both inside and outside of Darden Restaurant walls* cellphones, hotels and more! See full list here... 

We Are Legal Revolution

Litigation Associate Attorney | Strong Reputation | High profile clients- Sports & Entertainment | High rates up to $1.2k but flexible to build your book | Up to $400k | LA/OC- Hybrid /Remote Job at We Are Legal Revolution

 ...but flexible to build your book | Up to $400k | LA/OC- Hybrid /Remote &##127775; Highlights: Representing high-profile clients,...  ...entertainment sectors. Join a powerhouse firm known for its exceptional legal talent and high-calibre work. Multiple attorneys recognized... 

Back to Basics Learning Dynamics

Spanish Interpreter - In Person Job at Back to Basics Learning Dynamics

 ...Job Description Job Description Languageneeded: Spanish - Immediate need Location: Dover, DE area - IN-PERSON Overview Back to Basics Learning Dynamics is looking for Spanish interpreters in the Wilmington, DE area. As a member of our network of Independently... 

Dutech Systems, inc

Quality Assurance Analyst Job at Dutech Systems, inc

 ...industry practices, and standards Job Summary We are seeking a Quality Assurance Analyst to join our team in South San Francisco. This role...  ...(preferred). Additional Information Location: Remote role, reporting to South San Francisco office. Contract Duration...