Question about GPU hours

[William-WANG2]

Hi,

Thanks so much for this excellent work! May I kindly check how many GPU hours does the training cost?

[DrChiZhang]

FYI
" We train models at two different resolutions, 224 × 224 and 280 × 518.
The 224 × 224 model is trained on 16 GH200 GPUs for 150k steps with a batch size of 2 for each,
while the 280 × 518 model is initialized from the pretrained 224 × 224 weights and further trained
on 32 GH200 GPUs for another 150k steps with a batch size of 1"

[William-WANG2]

Oh, thank you so much for your prompt reply! 😊
Would you mind sharing roughly how long it took, if you still remember? :)