Ray Train Examples

Below are examples for using Ray Train with a variety of models, frameworks, and use cases. You can filter these examples by the following categories:

Distributed Training Examples using Ray Train

PyTorch Fashion MNIST Training Example

Transformers with PyTorch Training Example

TensorFlow MNIST Training Example

End-to-end Horovod Training Example

End-to-end PyTorch Lightning Training Example

Use LightningTrainer with Ray Data and Batch Predictor

Fine-tune LLM with AIR LightningTrainer and FSDP

Fine-tune vicuna-13b-v1.3 with Deepspeed and LightningTrainer

Ray Train Examples Using Loggers & Callbacks

Logging Training Runs with MLflow

Using Experiment Tracking Tools in LightningTrainer

Ray Train & Tune Integration Examples

End-to-end Example for Tuning a TensorFlow Model

End-to-end Example for Tuning a PyTorch Model with PBT

Ray Train Benchmarks

Benchmark example for the PyTorch data transfer auto pipeline