Posted on 
Jun 25, 2024

Data Engineer, Senior Manager

Roseland
Mid-Senior ICs
Engineering, Data Science + Analytics
CoreWeave
CoreWeave
CoreWeave
Private
101-250
Software, Security & Developer Tools

CoreWeave is a specialized cloud provider focused on GPU accelerated use cases including VFX, AI/ML, Batch Processing and Real Time Experiences. We support countless AI/ML services in the text to image, NLP and broader AI/ML space, reducing client’s infrastructure management requirements with our Kubernetes based serverless GPU cloud offerings.

Job Description

About the Role:

The Data Engineering Manager will oversee the design, development, and maintenance of our data lake, as well as manage our BIE team. This role requires a leader with a strong technical background, a proven track record in data engineering, and people management experience. The ideal candidate will have over 10 years of experience in the field, with a deep understanding of data architectures, ETL processes, documentation processes, data warehousing, and people management.

Key Responsibilities:

  • Design and implement robust, scalable, and efficient data pipelines and workflows.
  • Collaborate with Data Scientists, Business Intelligence Engineers, Data Engineers, and other stakeholders to understand data needs and deliver high-quality data solutions.
  • Ensure data quality, integrity, and security across all data systems.
  • Develop and maintain documentation related to data architecture, processes, and standards.
  • Stay current with industry trends and best practices, and integrate new technologies and methodologies as appropriate.
  • Oversee the deployment and management of data warehousing solutions.
  • Implement and manage ETL processes, ensuring optimal performance and reliability.
  • Drive continuous improvement in data engineering practices, tools, and processes.
  • Manage project timelines and resources effectively.
  • Communicate effectively with technical and non-technical stakeholders, translating complex technical concepts into business terms.
  • People management.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • 10+ years of experience in data engineering, with at least 3 years at a manager level.
  • Proven experience with data architecture, data modeling, and database design.
  • Strong proficiency in SQL, Python, and other programming languages relevant to data engineering.
  • Extensive experience with ETL tools (e.g., Apache Airflow, Talend, Informatica).
  • In-depth knowledge of data warehousing solutions (e.g., Postgres, Snowflake, Redshift, BigQuery).
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and related services.
  • Excellent problem-solving skills and attention to detail.
  • Strong project management skills and the ability to manage multiple priorities in the face of ambiguity
  • Excellent communication and interpersonal skills.
  • Experience with big data technologies (e.g., Hadoop, Spark) is a plus.

Preferred Qualifications:

  • Experience in the Cloud Computing industry.
  • Knowledge of data governance and compliance requirements.
  • Certification in cloud platforms or data engineering.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $170,000-$210,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

Hybrid Workplace

Successful candidates will be expected to attend onboarding training at our NJ Headquarters within their first several weeks of employment, with subsequent quarterly travel requirements of 1 week duration.

If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.

About the Role:

The Data Engineering Manager will oversee the design, development, and maintenance of our data lake, as well as manage our BIE team. This role requires a leader with a strong technical background, a proven track record in data engineering, and people management experience. The ideal candidate will have over 10 years of experience in the field, with a deep understanding of data architectures, ETL processes, documentation processes, data warehousing, and people management.

Key Responsibilities:

  • Design and implement robust, scalable, and efficient data pipelines and workflows.
  • Collaborate with Data Scientists, Business Intelligence Engineers, Data Engineers, and other stakeholders to understand data needs and deliver high-quality data solutions.
  • Ensure data quality, integrity, and security across all data systems.
  • Develop and maintain documentation related to data architecture, processes, and standards.
  • Stay current with industry trends and best practices, and integrate new technologies and methodologies as appropriate.
  • Oversee the deployment and management of data warehousing solutions.
  • Implement and manage ETL processes, ensuring optimal performance and reliability.
  • Drive continuous improvement in data engineering practices, tools, and processes.
  • Manage project timelines and resources effectively.
  • Communicate effectively with technical and non-technical stakeholders, translating complex technical concepts into business terms.
  • People management.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • 10+ years of experience in data engineering, with at least 3 years at a manager level.
  • Proven experience with data architecture, data modeling, and database design.
  • Strong proficiency in SQL, Python, and other programming languages relevant to data engineering.
  • Extensive experience with ETL tools (e.g., Apache Airflow, Talend, Informatica).
  • In-depth knowledge of data warehousing solutions (e.g., Postgres, Snowflake, Redshift, BigQuery).
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and related services.
  • Excellent problem-solving skills and attention to detail.
  • Strong project management skills and the ability to manage multiple priorities in the face of ambiguity
  • Excellent communication and interpersonal skills.
  • Experience with big data technologies (e.g., Hadoop, Spark) is a plus.

Preferred Qualifications:

  • Experience in the Cloud Computing industry.
  • Knowledge of data governance and compliance requirements.
  • Certification in cloud platforms or data engineering.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $170,000-$210,000. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.

Hybrid Workplace

Successful candidates will be expected to attend onboarding training at our NJ Headquarters within their first several weeks of employment, with subsequent quarterly travel requirements of 1 week duration.

If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.

Receive Tech Ladies'
newest jobs in your inbox,
every week.

Join Tech Ladies for full-access to the job board, member-only events, and more!

If you're already a member, we haven't forgotten you. We promise. It's a new system. If you fill out the form once, it'll remember you going forward. Apologies for the inconvenience.

Roseland
Roseland
No items found.
Engineering
Engineering
Data Science + Analytics
Data Science + Analytics
Hybrid
Hybrid