On 3/31/25 8:55 AM, Lionel Cons wrote: > On Wed, 26 Mar 2025 at 17:59, Tom Talpey <tom@xxxxxxxxxx> wrote: >> >> On 3/25/2025 3:12 PM, Chuck Lever wrote: >>> On 3/25/25 2:53 PM, Lionel Cons wrote: >>>> Does Linux have some kind of RDMA emulation for "normal" network cards >>>> (e.. not IB, not 10000baseT) which could be used for Linux >>>> NFSv4.1/RDMA testing? >>> >>> Linux has a software iWARP emulation that works with standard Ethernet >>> devices. I use this with NFS/RDMA in test scenarios all the time. The >>> driver name is "siw". >>> >>> Linux also has a software RoCE emulation, same deal, but I don't use it. >>> The driver name is "rxe". >> >> For the record, both siw and rxe are not emulations, they're the >> real thing and they interoperate with either software and hardware >> implementations across the wire. They actually work well! Both a full-fledged verbs providers, true. But the RDMA itself is an emulation -- host data copy, not offloaded. > 1. Do they work in QEMU *and* VMware Workstation? I use siw with VMware Fusion (the MacOS equivalent to VMware Workstation) and in my nightly QA runs, which is with a virtio net device under qemu. > 2. Are there setup instructions? The only snag here might be that your distribution doesn't enable and build the kernel drivers. I use it under CentOS Stream 9 and recent Fedora. Here is some sample documentation: https://docs.redhat.com/en/documentation/red_hat_enterprise_linux/8/html/configuring_infiniband_and_rdma_networks/configuring-soft-iwarp_configuring-infiniband-and-rdma-networks#overview-of-iwarp-and-soft-iwarp_configuring-soft-iwarp -- Chuck Lever
