add gradient checkpointing #20
Description
Running flux-schnell currently requires 40 GB of VRAM (thus, an A100 or higher is needed). Gradient checkpointing could enable inference on smaller GPUs.
{{ message }}
Running flux-schnell currently requires 40 GB of VRAM (thus, an A100 or higher is needed). Gradient checkpointing could enable inference on smaller GPUs.