Welcome to Spare Cores!

We are a team of cloud and data enthusiast professionals dedicated to demystifying cloud server options with the goal of optimizing cost-efficiency and performance for data science and engineering workloads.

Motivation

Through our experience in designing, implementing, and maintaining infrastructure for data science teams worldwide, we've identified a common challenge: navigating the vast array of cloud server options and tools, especially given the diverse compute needs in the data space: for example, training a hierarchical model with TiBs of memory, performing time-series forecasting with hundreds of CPUs, or training neural networks with multiple GPUs.

Standard tools like Kubernetes often fall short in the data space: not only presenting a steep learning curve, but also bin-packing not being well-suited for the diverse compute needs. This led us to develop custom solutions — again and again.

Our Mission

We launched the Spare Cores open-source ecosystem to share our expertise and data, empowering others to optimize their cloud usage.

Discover more in our feature on The Pragmatic Engineer — the leading tech Substack — where Gergely Orosz provides an in-depth overview of our mission and approach.

Funding

We are proudly self-funded and bootstrapped, with partial support from the EU (NGI Search granted 150k EUR for the Spare Cores project in 2024). We are part of the NVIDIA Inception Program and have received support and compute credits from Amazon Web Services, Google Cloud, Microsoft Azure, Hetzner, and UpCloud.

If you like our work and wish to support us in any way, reach out!

Spare Cores Resources

We maintain a suite of open-source Python tools and projects at our GitHub organization. Our blog features regular articles with insights into cloud computing and data infrastructure. Visit our conference talks page for video recordings, presentation materials, and information on upcoming events where we'd love to connect in person!

Get in touch

For inquiries or to learn more about our work, please contact us. We're eager to discuss cloud infrastructure challenges and solutions. You can also schedule a demo to see our tools in action and explore how they can benefit your organization.