Re: Large file downloads (~2TB) from CephFS drop at ~100 GB

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Indeed, Ceph FS and RBD serves Cloudstack which in turn uses Ceph FS via NFS for "Secondary Storage". Cloudstack provides a download URL where I can download a raw file via browser or wget. What is odd to me is that the download rate shrinks rapidly around 100GB and it maintains for a few minutes around 140 kbit/s before the connection is completely lost. It is also visible in Ceph when the FS pool read ops per seconds drops to zero.

After I tried other approaches in Cloudstack, I see that other types of large downloads do not show this behaviour, so I do not think that Ceph is doing any throttling..


Am 24.08.2025 um 21:02 schrieb Janne Johansson:
Is it possible that the software serving the content has a limit you run
into?


May the most significant bit of your life be positive.

Den sön 24 aug. 2025 13:08Mevludin Blazevic <mejdibl@xxxxxxxxx> skrev:

Hello all,

I am experiencing a strange issue with downloads from a CephFS-backed
environment and would like to ask if anyone has seen similar behavior.

When downloading large files (via wget or even directly through
Firefox), the transfer speed is fine until the file size reaches roughly
100 GB. At that point, the session gets disconnected. This happens
consistently, independent of the bandwidth available (e.g., whether the
link runs at ~80 Mbit/s or ~230 Mbit/s). The only difference is how
quickly the 100 GB “border” is reached.

After the disconnect, the download can usually be resumed, but the
cutoff is very repeatable. Is there a configuration that needs to be
done on the ceph site?

Best, Mevludin

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx

_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux