HPC Network Engineer
CoreWeave is a specialized cloud provider focused on GPU accelerated use cases including VFX, AI/ML, Batch Processing and Real Time Experiences. We support countless AI/ML services in the text to image, NLP and broader AI/ML space, reducing client’s infrastructure management requirements with our Kubernetes based serverless GPU cloud offerings.
Job Description
This role can be fully remote, with the option to work at one of our offices in Roseland, NJ or Brooklyn, NY.
CoreWeave is seeking a highly skilled and motivated HPC Network Engineer to join our fast growing team. In this role, you will play a crucial part in the development, support, and optimization of our HPC networking performance. As a member of the HPC Networking Team, some of the responsibilities you will have in this opportunity include:
- Monitoring: Consistently monitoring the performance and overall health of InfiniBand fabrics, which includes network switches, host adapters, and nodes. This responsibility entails utilizing existing monitoring tools and potentially developing new ones to ensure comprehensive visibility and timely detection of any issues or abnormalities
- Troubleshooting: Skillfully investigating and resolving various issues that may arise within InfiniBand fabrics. This involves diagnosing network connectivity problems, identifying and resolving performance bottlenecks, and effectively addressing any errors or failures within the fabric components.
- Support: Provide assistance and collaboration to other teams involved in the management and operation of HPC clusters utilizing InfiniBand technology. This includes offering expertise, guidance, and troubleshooting support to ensure the smooth functioning and optimal performance of the clusters.
Required Skills:
- Proficient in InfiniBand configuration and management.
- Solid understanding of network architectures, topologies, best practices, and techniques for high performance and availability.
- Familiarity with optical networking hardware.
- Experience in Linux system administration.
- Proficiency in at least one scripting language.
- Team player with effective collaboration skills.
- Ability to manage multiple tasks and projects concurrently.
Preferred Skills:
- Hands-on experience with Nvidia UFM.
- Familiarity working with SLURM job scheduler.
- Experience or familiarity with Grafana for monitoring and visualization.
- Insight into HPC systems architecture and operational workflows.
- Familiarity with various MPI implementations.
- Experience with automation and configuration management tools.
- Acquaintance with open-source technologies pertinent to HPC administration, including resource management, storage systems, monitoring infrastructure, software deployment, and continuous integration.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $165,000/year in our lowest geographic market up to $210,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
This role can be fully remote, with the option to work at one of our offices in Roseland, NJ or Brooklyn, NY.
CoreWeave is seeking a highly skilled and motivated HPC Network Engineer to join our fast growing team. In this role, you will play a crucial part in the development, support, and optimization of our HPC networking performance. As a member of the HPC Networking Team, some of the responsibilities you will have in this opportunity include:
- Monitoring: Consistently monitoring the performance and overall health of InfiniBand fabrics, which includes network switches, host adapters, and nodes. This responsibility entails utilizing existing monitoring tools and potentially developing new ones to ensure comprehensive visibility and timely detection of any issues or abnormalities
- Troubleshooting: Skillfully investigating and resolving various issues that may arise within InfiniBand fabrics. This involves diagnosing network connectivity problems, identifying and resolving performance bottlenecks, and effectively addressing any errors or failures within the fabric components.
- Support: Provide assistance and collaboration to other teams involved in the management and operation of HPC clusters utilizing InfiniBand technology. This includes offering expertise, guidance, and troubleshooting support to ensure the smooth functioning and optimal performance of the clusters.
Required Skills:
- Proficient in InfiniBand configuration and management.
- Solid understanding of network architectures, topologies, best practices, and techniques for high performance and availability.
- Familiarity with optical networking hardware.
- Experience in Linux system administration.
- Proficiency in at least one scripting language.
- Team player with effective collaboration skills.
- Ability to manage multiple tasks and projects concurrently.
Preferred Skills:
- Hands-on experience with Nvidia UFM.
- Familiarity working with SLURM job scheduler.
- Experience or familiarity with Grafana for monitoring and visualization.
- Insight into HPC systems architecture and operational workflows.
- Familiarity with various MPI implementations.
- Experience with automation and configuration management tools.
- Acquaintance with open-source technologies pertinent to HPC administration, including resource management, storage systems, monitoring infrastructure, software deployment, and continuous integration.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $165,000/year in our lowest geographic market up to $210,000/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience.
