Spot Instance — Technology Wiki

Overview

Direct Answer

A spot instance is a cloud computing service that offers access to spare server capacity at discounted rates, typically 70–90% below on-demand pricing, in exchange for the possibility of termination when capacity is reclaimed. Cloud providers allocate these instances from unused infrastructure, making them ideal for workloads that tolerate interruption.

How It Works

Cloud providers maintain a pool of underutilised compute resources and offer them at auction-like pricing that fluctuates based on real-time supply and demand. When an organisation's bid price falls below the current market rate or when capacity is needed for higher-priority workloads, instances are terminated with minimal notice—typically two minutes. Users specify bid prices and interruption tolerance profiles to manage deployment risk.

Why It Matters

Organisations pursuing aggressive cost optimisation can reduce compute expenses substantially whilst maintaining performance for non-critical workloads. This addresses budget constraints in data processing, testing environments, and batch jobs where fault tolerance is inherent to the application architecture.

Common Applications

Typical use cases include machine learning model training, big data analytics processing, batch rendering for media production, and development-stage testing environments. Financial services firms use them for risk simulation, whilst research institutions leverage them for computationally intensive scientific modelling.

Key Considerations

Sudden interruptions require robust retry logic and state persistence mechanisms; unsuitable for stateful applications or time-sensitive transactional workloads. Cost savings must be weighed against engineering complexity required to handle interruption gracefully.

Cross-References(1)

Cloud Computing

Related in Service Models

Cloud Computing

The delivery of computing services — servers, storage, databases, networking, software — over the internet on demand.

Infrastructure as a Service

Cloud computing model providing virtualised computing resources like servers, storage, and networking over the internet.

Platform as a Service

Cloud computing model that provides a platform for developers to build, deploy, and manage applications without managing infrastructure.

Software as a Service

Cloud computing model that delivers software applications over the internet on a subscription basis.

Function as a Service

A serverless cloud computing model where individual functions are executed in response to events.

Serverless Computing

A cloud execution model where the provider dynamically allocates resources, charging only for actual compute time used.

Cloud-Native

An approach to building applications that fully exploit cloud computing advantages like elasticity, resilience, and automation.

Private Cloud

Cloud computing resources used exclusively by a single organisation, either on-premises or hosted by a third party.

Public Cloud

Cloud computing resources shared among multiple organisations and available to the general public over the internet.

Managed Service

A cloud service where the provider handles infrastructure management, maintenance, updates, and monitoring.

Cloud Cost Optimisation

Strategies and practices for minimising cloud computing expenses while maintaining performance and functionality.

Cloud Orchestration

The automated arrangement, coordination, and management of complex cloud computing systems and services.

More in Cloud Computing

Hybrid Cloud

Strategy & Economics

An IT architecture combining on-premises infrastructure with public and private cloud services.

Cloud Security

Strategy & Economics

The set of policies, technologies, and controls deployed to protect cloud-based systems, data, and infrastructure.

Microservices

Architecture Patterns

An architectural style structuring an application as a collection of loosely coupled, independently deployable services.

REST API

Architecture Patterns

An API architectural style using HTTP methods and stateless communication for web service interaction.

Auto-Scaling

Infrastructure

Automatically adjusting compute resources based on current demand to maintain performance and optimise costs.

Spot Instances

Service Models

Spare cloud computing capacity offered at steep discounts compared to on-demand pricing, available when the provider has excess resources but subject to interruption.

Cloud Migration

Deployment & Operations

The process of moving data, applications, and workloads from on-premises infrastructure to cloud environments.

Hypervisor

Infrastructure

Software that creates and manages virtual machines, allowing multiple operating systems to share a single hardware host.