Re: nodes with high density of OSDs

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi,

> On 11 Apr 2025, at 10:53, Alex from North <service.plant@xxxxx> wrote:
> 
> Hello Tim! First of all, thanks for the detailed answer!
> Yes, probably in set up of 4 nodes by 116 OSD it looks a bit overloaded, but what if I have 10 nodes? Yes, nodes itself are still heavy but in a row it seems to be not that dramatic, no?
> 
> However, in a docu I see that it is quite common for systemd to fail on boot and even showed a way to escape.

Currently we don't have 116 OSD chassis, but operate the 60 OSD chassis without any issues with LVM activation. We use Ceph Pacific (16.2.15)




Welcome to CentOS Stream 8 4.18.0-553.6.1.el8.x86_64
Platform:	Supermicro Super Server (X12DPi-N6)
BIOS:		1.9 (American Megatrends International, LLC. 02/07/2024)
CPU:		Intel(R) Xeon(R) Silver 4314 CPU @ 2.40GHz [2P/32C]
RAM:		382Gi free / 628Gi total
LoadAvg:	2.94 2.87 3.27
up 10 weeks, 2 hours, 36 minutes

[operator@host:/]$ scsis
Device /dev/sda [TOSHIBA MG10ACA2: <cut>]: 0:0:0:0
Device /dev/sdb [TOSHIBA MG10ACA2: <cut>]: 0:0:1:0
Device /dev/sdc [TOSHIBA MG10ACA2: <cut>]: 0:0:2:0
Device /dev/sdd [TOSHIBA MG10ACA2: <cut>]: 0:0:3:0
Device /dev/sde [TOSHIBA MG10ACA2: <cut>]: 0:0:4:0
Device /dev/sdf [TOSHIBA MG10ACA2: <cut>]: 0:0:5:0
Device /dev/sdg [TOSHIBA MG10ACA2: <cut>]: 0:0:6:0
Device /dev/sdh [TOSHIBA MG10ACA2: <cut>]: 0:0:7:0
Device /dev/sdi [TOSHIBA MG10ACA2: <cut>]: 0:0:8:0
Device /dev/sdj [TOSHIBA MG10ACA2: <cut>]: 0:0:9:0
Device /dev/sdk [TOSHIBA MG10ACA2: <cut>]: 0:0:10:0
Device /dev/sdl [TOSHIBA MG10ACA2: <cut>]: 0:0:11:0
Device /dev/sdm [TOSHIBA MG10ACA2: <cut>]: 0:0:12:0
Device /dev/sdn [TOSHIBA MG10ACA2: <cut>]: 0:0:13:0
Device /dev/sdo [TOSHIBA MG10ACA2: <cut>]: 0:0:14:0
Device /dev/sdp [TOSHIBA MG10ACA2: <cut>]: 0:0:15:0
Device /dev/sdq [TOSHIBA MG10ACA2: <cut>]: 0:0:16:0
Device /dev/sdr [TOSHIBA MG10ACA2: <cut>]: 0:0:17:0
Device /dev/sds [TOSHIBA MG10ACA2: <cut>]: 0:0:18:0
Device /dev/sdt [TOSHIBA MG10ACA2: <cut>]: 0:0:19:0
Device /dev/sdu [TOSHIBA MG10ACA2: <cut>]: 0:0:21:0
Device /dev/sdv [TOSHIBA MG10ACA2: <cut>]: 0:0:22:0
Device /dev/sdw [TOSHIBA MG10ACA2: <cut>]: 0:0:23:0
Device /dev/sdx [TOSHIBA MG10ACA2: <cut>]: 0:0:24:0
Device /dev/sdy [TOSHIBA MG10ACA2: <cut>]: 0:0:25:0
Device /dev/sdz [TOSHIBA MG10ACA2: <cut>]: 0:0:26:0
Device /dev/sdaa [TOSHIBA MG10ACA2: <cut>]: 0:0:27:0
Device /dev/sdab [TOSHIBA MG10ACA2: <cut>]: 0:0:28:0
Device /dev/sdac [TOSHIBA MG10ACA2: <cut>]: 0:0:29:0
Device /dev/sdad [TOSHIBA MG10ACA2: <cut>]: 0:0:30:0
Device /dev/sdae [TOSHIBA MG10ACA2: <cut>]: 0:0:31:0
Device /dev/sdaf [TOSHIBA MG10ACA2: <cut>]: 0:0:32:0
Device /dev/sdag [TOSHIBA MG10ACA2: <cut>]: 0:0:33:0
Device /dev/sdah [TOSHIBA MG10ACA2: <cut>]: 0:0:34:0
Device /dev/sdai [TOSHIBA MG10ACA2: <cut>]: 0:0:35:0
Device /dev/sdaj [TOSHIBA MG10ACA2: <cut>]: 0:0:36:0
Device /dev/sdak [TOSHIBA MG10ACA2: <cut>]: 0:0:37:0
Device /dev/sdal [TOSHIBA MG10ACA2: <cut>]: 0:0:38:0
Device /dev/sdam [TOSHIBA MG10ACA2: <cut>]: 0:0:39:0
Device /dev/sdan [TOSHIBA MG10ACA2: <cut>]: 0:0:40:0
Device /dev/sdao [TOSHIBA MG10ACA2: <cut>]: 0:0:42:0
Device /dev/sdap [TOSHIBA MG10ACA2: <cut>]: 0:0:43:0
Device /dev/sdaq [TOSHIBA MG10ACA2: <cut>]: 0:0:44:0
Device /dev/sdar [TOSHIBA MG10ACA2: <cut>]: 0:0:45:0
Device /dev/sdas [TOSHIBA MG10ACA2: <cut>]: 0:0:46:0
Device /dev/sdat [TOSHIBA MG10ACA2: <cut>]: 0:0:47:0
Device /dev/sdau [TOSHIBA MG10ACA2: <cut>]: 0:0:48:0
Device /dev/sdav [TOSHIBA MG10ACA2: <cut>]: 0:0:49:0
Device /dev/sdaw [TOSHIBA MG10ACA2: <cut>]: 0:0:50:0
Device /dev/sdax [TOSHIBA MG10ACA2: <cut>]: 0:0:51:0
Device /dev/sday [TOSHIBA MG10ACA2: <cut>]: 0:0:52:0
Device /dev/sdaz [TOSHIBA MG10ACA2: <cut>]: 0:0:53:0
Device /dev/sdba [TOSHIBA MG10ACA2: <cut>]: 0:0:54:0
Device /dev/sdbb [TOSHIBA MG10ACA2: <cut>]: 0:0:55:0
Device /dev/sdbc [TOSHIBA MG10ACA2: <cut>]: 0:0:56:0
Device /dev/sdbd [TOSHIBA MG10ACA2: <cut>]: 0:0:57:0
Device /dev/sdbe [TOSHIBA MG10ACA2: <cut>]: 0:0:58:0
Device /dev/sdbf [TOSHIBA MG10ACA2: <cut>]: 0:0:59:0
Device /dev/sdbg [TOSHIBA MG10ACA2: <cut>]: 0:0:60:0
Device /dev/sdbh [TOSHIBA MG10ACA2: <cut>]: 0:0:61:0

Inspected 60 SCSI devices


Good luck,
k
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux