autospotting

README

AutoSpotting

A simple and easy to use tool designed to significantly lower your Amazon AWS costs by automating the use of spot instances.

How does it work?

When installed and enabled on an existing on-demand AutoScaling group, AutoSpotting clones one of your on-demand instances from the group with a spot instance that is cheaper, at least as large (automatically considering memory, CPU cores and disk volumes) and configured identically to it. Once the new spot instance is ready, it is attached to the group and an on-demand instance is detached and terminated, to keep the group at constant capacity.

It continuously applies this process, across all enabled groups from all regions, gradually replacing your on-demand instances with much cheaper spot instances. For your peace of mind, you can also configure it to keep running a configurable number of on-demand instances, given as percentage or absolute number.

Your groups will then monitor and use these spot instances just like they would do with your on-demand instances. They will automatically join your load balancer and start receiving traffic once passing the health checks.

The installation takes just a few minutes and the existing groups can be enabled and configured individually by using a few additional tags.

This can be seen in action below, you can click to expand the animation:

Read here for more information and implementation details.

Frequently asked questions about the project are answered in the FAQ, please read this first before asking for support.

If you have additional questions not covered there, they can be easily added to the crowdsourced source of the FAQ and we'll do our best to answer them either there or on Gitter.

Getting Started

Just like in the above animation, it's as easy as launching a CloudFormation (or Terraform) stack and setting the spot-enabled tag on the AutoScaling groups where you want it enabled to true.

For more detailed information you can read this document

Compiling and Installing

Even though you should normally be fine with the provided binaries, for local development or in case you have some special needs it's relatively easy to build and run your customized binaries.

More details are available here

Contributing

This project was developed by volunteers in their own spare time. If you find it useful please consider contributing to its development, any help would be greatly appreciated.

You can do it by trying it out and giving feedback, reporting bugs, writing code, improving the documentation, assigning someone to work on it for a few hours a week, spreading the word or simply contacting us and telling about your setup.

Non-trivial code should be submitted according to the contribution guidelines

Support

Community support is available on the gitter chat room on a best effort basis.

The main author also offers enterprise-grade support, feature development as well as AWS-related consulting for a fee. For more information feel free to get in touch on gitter.

Users

Autospotting is already used by hundreds of individuals and companies around the world, such as:

• www.cycloid.io
• www.fractalanalytics.com
• www.here.com
• www.ibibogroup.com
• www.icap.com
• www.news.co.uk
• www.parkassist.com
• www.qualcomm.com
• www.quantiphi.com
• www.realestate.co.nz
• www.roames.com
• www.spscommerce.com
• www.taitradio.com

Uninstall

You just need to remove the AutoSpotting CloudFormation or Terraform stack.

The groups will eventually revert to the original state once the spot market price fluctuations terminate all the spot instances. In some cases this may take months, so you can also terminate them sooner yourself.

Fine-grained control on a per group level can be achieved by removing or setting the spot-enabled tag to any other value. AutoSpotting only touches groups where this tag is set to true.

License

This software is distributed under the terms of the MIT license.