Systems/GPU Programmer - Vast.ai

At Vast.ai , we value creativity, energy, drive and teamwork. We are looking for talented people who share these values to join as we grow our team. Our vision is to widely distribute AI computing to reshape our future for the good of humanity. Come join us. If witnessing the birth of AGI excites you, we can't wait to hear from you!

Vast.ai is a market based cloud computing platform focused on reducing the cost and friction of compute-intensive workloads, enabling anyone to easily leverage large-scale GPU liquidity. Vast.ai is the market leader for low cost GPU rentals. Our GPU marketplace powers AI projects and businesses all over the world.

NOTE: Currently hiring for on-site work in Westwood, Los Angeles.

As a systems/GPU programmer you will play a crucial role in developing new matrix multiplication kernels and algorithms that can improve inference for AI models. You will help develop new high performance tensor libraries and auto optimization tools. Working closely with the technical CEO and founder, you will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems. Your ability to research and stay on top of cutting edge papers will be vital in staying up-to-date with the latest advancements in AI model inference and GPU programming techniques.

• Implement new high performance sparse matrix multiplication kernels
• Create highly parallel GPU code graph translation and optimization systems
• Develop or extend parallel generic GPU libraries for approximate sorting, k-max, hashtables, etc
• Help design and deploy new market based resource management systems for our host daemon
• Quickly investigate and summarize options for new system architectures

• Deeply comfortable in C++, template meta-programming, CUDA, GPGPU, linux
• Capable and willing to quickly investigate and learn new frameworks and tools
• A fan of occasional remote pair programming
• Passionate about pushing the envelope in neural network performance and tooling
• Excited about the potential of AI

• Full-Time, Monday - Friday.
• Onsite at the Vast.ai HQ in Westwood, Los Angeles.
• Health, dental, vision and life insurance coverage.
• Matching 401K.
• Generous equity.
• Opportunity to grow into other technical or management roles.
• Join early into a fast growing, ambitious startup environment.