Lead Data Engineer Job at Egen, Naperville, IL

VFFJNjZyN0dNdFhpd2lJWFRCazhkSzh3RUE9PQ==
  • Egen
  • Naperville, IL

Job Description

\n

Job Description:
  • Responsible for designing and building data pipelines.
  • Designing and implementing solutions and developing applications utilizing airflow, dataflow, Apache beam, snowflake or GCP components.
  • Reading, extracting, transforming, staging, and loading data to multiple targets, using Hadoop, Hive, Snowflake, BigQuery, and Cloud Storage.
  • Migrating existing data processing from standalone or legacy technology scripts to distributed framework processing.
  • Working with gigabytes/terabytes of data and dealing with the challenges of transforming and enriching such large datasets.
  • Utilizing Google Cloud Platform and strong big data technology foundation 
  • Designing and Architecting data model to modernize legacy data warehouses.
  • Writing ELT jobs using DBT to maintain data lineage and data auditability.
  • Designing architecture of CI/CD pipelines to perform continuous build and isolate multiple environments.

Experience/Qualifications
  • Master’s or foreign academic equivalent in Business Analytics, Computer Science, Statistics, Data Science or any related field plus one (1) year of experience. Location: Northridge, CA, telecommuting permitted, HQ in Naperville, IL. Approx. 25% domestic travel required. Travel Expenses to be paid by employer. One year of experience with Hadoop, Spark, Pig, Hive, Snowflake, BigQuery, Kubernetes, and Dataflow required.

\n

SALARY: $116,334 per year

BENEFITS: Medical Insurance, Dental, Life Insurance, Paid Time Off, 401(k)

WHERE TO APPLY: SpringML, Inc. dba Egen Solutions, 40 Shuman Blvd, Suite 204, Naperville, IL;

Email:  hr@egen.ai

EEO and Accommodations:

Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.

Job Tags

Full time, Local area, Remote work,

Similar Jobs

Scagtask, LLC.

Experienced Landscaper Job at Scagtask, LLC.

Must have previous or present landscaping experience. Looking for a landscaper to join our team and provide excellent service to a private family on an estate property. * Planting and Cultivation: Deciding the kinds of flowers, trees, and shrubs to plant and where... 

Healthpro Heritage, LLC

Licensed Physical Therapy Assistant (LPTA) Job at Healthpro Heritage, LLC

 ...Licensed Physical Therapy Assistant (LPTA) at Healthpro Heritage, LLC summary: Licensed Physical Therapist Assistants (LPTAs) support physical therapists in delivering rehabilitative care by implementing treatment plans, conducting therapeutic exercises, and educating... 

Appcast

Class-A CDL Dedicated Company Driver Job at Appcast

 ...Class-A CDL Dedicated Company Driver LOUISVILLE, KY Responsibilities Requirements:~ CDL-A with Tanker and Hazmat Endorsements~ HAVE TWIC Card or Must Be Willing to Obtain a TWIC Card ~1 Year of Tractor Trailer Experience, Tanker Experience Preferred... 

Hana Group

Franchise Business Partner (Area Manager) Job at Hana Group

 ...you're passionate about food, thrive in dynamic environments, and want to be part of a company thats growing across the U.S., Hana...  ...excellent communication and customer service skills to build strong business relationships with clients and employees; enforcing programs,... 

T3 Recruiters, LLC

Forklift Mechanic Job at T3 Recruiters, LLC

Looking for experienced diesel and/orpropanemechanics to fill a role at a mom and pop Forklift Dealership in the E. Houston/Baytown, TX area. Must have at least 4 years of experience directly related to the Diesel engine industry and experience with maintainingforklift...