Engineer, Data Platforms
CoreWeave is a specialized cloud provider focused on GPU accelerated use cases including VFX, AI/ML, Batch Processing and Real Time Experiences. We support countless AI/ML services in the text to image, NLP and broader AI/ML space, reducing client’s infrastructure management requirements with our Kubernetes based serverless GPU cloud offerings.
Job Description
About the role:
The Data Platforms Team serves as the experts on data ingestion, data flow and retrieval for CoreWeave. This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure.
We are seeking an engineer with specialization in data platforms and stream processing who can help us fulfill the goal of our multi-regional datastore strategy and establish communication models for our data flow. This individual will work with a team of 6-8 mixed skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment. As a member of the Data Platforms Team you will have the opportunity to:
- Identify and develop applications for the organization's data. This involves understanding business needs and creating solutions that leverage data effectively.
- Implement the platform to deliver data to teams with a focus on providing managed solutions.
- Participate in operations and scaling of relational data platforms.
- Develop a stream processing architecture and solve for scalability and reliability.
- Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
- Establish guidelines, guard rails for data access and storage for stakeholder teams.
- Ensure compliance with standards for data protection regulation.
- Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself.
Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk.
- You have two or more years of experience in a software or infrastructure engineering industry.
- You enjoy helping your colleagues achieve more with less effort.
- You have experience operating services in production and at scale and are versed in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
- You understand data consistency and concurrency models.
- You’re familiar with distributed datastores such as Cockroachdb, TiDB, Cassandra and/or stream processing tools such as NATS or Kafka.
- You have experience in managing and operating services in a Kubernetes centric environment and are interested in using it for event-driven and/or stateful orchestration using a pattern like the operator pattern.
- You know your way around a Linux distro, shell scripting, and/or the Linux storage and networking stacks.
- You’re excited about being part of a team of diverse perspectives and backgrounds that believe in tackling challenges, growing hand in hand, and winning together.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $160,000 - $185,000 annually. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
Hybrid Workplace
If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.
CoreWeave is a specialized cloud provider, delivering a massive scale of GPU compute resources on top of the industry’s fastest and most flexible infrastructure. CoreWeave builds cloud solutions for compute intensive use cases — VFX and rendering, machine learning and AI, batch processing, and Pixel Streaming — that are up to 35 times faster and 80% less expensive than the large, generalized public clouds. Learn more at www.coreweave.com.
About the role:
The Data Platforms Team serves as the experts on data ingestion, data flow and retrieval for CoreWeave. This team is responsible for the development of use cases, discovery of innovative solutions, automation and operations of our data platform infrastructure.
We are seeking an engineer with specialization in data platforms and stream processing who can help us fulfill the goal of our multi-regional datastore strategy and establish communication models for our data flow. This individual will work with a team of 6-8 mixed skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment. As a member of the Data Platforms Team you will have the opportunity to:
- Identify and develop applications for the organization's data. This involves understanding business needs and creating solutions that leverage data effectively.
- Implement the platform to deliver data to teams with a focus on providing managed solutions.
- Participate in operations and scaling of relational data platforms.
- Develop a stream processing architecture and solve for scalability and reliability.
- Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
- Establish guidelines, guard rails for data access and storage for stakeholder teams.
- Ensure compliance with standards for data protection regulation.
- Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself.
Wondering if you’re a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are some qualities we’ve found compatible with our team. If a portion of this resonates with you, we’d love to talk.
- You have two or more years of experience in a software or infrastructure engineering industry.
- You enjoy helping your colleagues achieve more with less effort.
- You have experience operating services in production and at scale and are versed in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design.
- You understand data consistency and concurrency models.
- You’re familiar with distributed datastores such as Cockroachdb, TiDB, Cassandra and/or stream processing tools such as NATS or Kafka.
- You have experience in managing and operating services in a Kubernetes centric environment and are interested in using it for event-driven and/or stateful orchestration using a pattern like the operator pattern.
- You know your way around a Linux distro, shell scripting, and/or the Linux storage and networking stacks.
- You’re excited about being part of a team of diverse perspectives and backgrounds that believe in tackling challenges, growing hand in hand, and winning together.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $160,000 - $185,000 annually. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
Hybrid Workplace
If you reside within a 30-mile radius of our New Jersey, New York, or Philadelphia offices, we're excited for you to join us at the office at least three times a week, recognizing the significance we place on fostering connections, collaboration, and creativity within our office culture. Our commitment to operating as a hybrid workplace underscores our dedication to enabling our employees to tailor their work-life balance to their individual preferences.
