spotty

library1.3.3pypypiunverified

Spotty is a tool for training deep learning models on AWS and GCP spot/preemptible instances. It manages cloud instance lifecycle, Docker container environment, and file syncing. Current version 1.3.3 (December 2023), with irregular releases approximately every 3-6 months.

aws gcp ai-ml devops

pip install spotty

github ↗package ↗homepage ↗

INSTALL

IMPORT

SIG · SPOTTY

spotty

awspythonv1.3.3

harness data pending

Install & Compatibility

Where this runs

No compatibility data collected yet for this library.

Code

Verified usage

Verified import paths — ran on the pinned version, not inferred.

AwsInstance

✓ from spotty import AwsInstance

✗ from spotty.providers.aws.instance import AwsInstance

Initialize a Spotty project, start a cloud instance, and run training scripts.

cd my_project spotty init --provider aws spotty start # starts EC2 instance spotty sh # SSH into instance spotty stop # stops instance (retains volumes by default) spotty run "python train.py" # syncs project and runs command

spotty --version

Debug

Known issues

breakingSpotty v1.3.0 changed default instance type from spot to on-demand. Set `spotInstance: true` in YAML config for AWS or `preemptibleInstance: true` for GCP.

fix

Add `spotInstance: true` (AWS) or `preemptibleInstance: true` (GCP) to your .spotty/config.yaml under the instance parameters.

affects: >=1.3.0

breakingVolumes/disks are now retained by default when an instance is stopped. In v1.2.x and earlier, volumes were deleted on stop unless explicitly configured.

fix

To delete volumes on stop, set deletion policy to 'delete' in your config. For AWS EBS: `deletionPolicy: delete`. For GCP: not yet implemented per v1.2.3 changelog.

affects: >=1.3.0

gotchaThe `spotty run` command now syncs the project before running by default, opposite of previous behavior. The `-S/--sync` flag is replaced with `--no-sync` flag.

fix

To skip syncing, use `spotty run --no-sync "command"`.

affects: >=1.3.0

gotchaConfiguration format changed in v1.2.0: container parameters are now separate from instance parameters, and the config file describes a list of instances instead of a single one.

fix

Refer to the new YAML format at https://github.com/spotty-cloud/spotty#configuration. Old configs will not work.

affects: >=1.2.0

Upgrade

Version history

1.3.3latest on PyPI · released May 19, 2022

Audit

Dependencies

No dependency data recorded yet.

Agent activity

42 hits · last 30 days

node

Amazon

OpenAI (training)

Resources

githubhttps://github.com/spotty-cloud/spotty ↗

packagehttps://pypi.org/project/spotty/ ↗

homepagehttps://spotty.cloud ↗