Before making definitions of each host in ThinkSystem System Manager, you must discover the target controller ports from the host, and then establish NVMe connections.
nvme discover -t rdma -a target_ip_address
In this command, target_ip_address is the IP address of the target port.
nvme discover
command discovers all controller ports in
the subsystem, regardless of host access.# nvme discover -t rdma -a 192.168.1.77
Discovery Log Number of Records 2, Generation counter 0
=====Discovery Log Entry 0======
trtype: rdma
adrfam: ipv4
subtype: nvme subsystem
treq: not specified
portid: 0
trsvcid: 4420
subnqn: nqn.1992-08.com.netapp:5700.600a098000a527a7000000005ab3af94
traddr: 192.168.1.77
rdma_prtype: roce
rdma_qptype: connected
rdma_cms: rdma-cm
rdma_pkey: 0x0000
=====Discovery Log Entry 1======
trtype: rdma
adrfam: ipv4
subtype: nvme subsystem
treq: not specified
portid: 1
trsvcid: 4420
subnqn: nqn.1992-08.com.netapp:5700.600a098000a527a7000000005ab3af94
traddr: 192.168.2.77
rdma_prtype: roce
rdma_qptype: connected
rdma_cms: rdma-cm
rdma_pkey: 0x0000
nvme connect -t rdma -n
discovered_sub_nqn -a
target_ip_address -Q
queue_depth_setting -l
controller_loss_timeout_period
nvme connect -t rdma -n discovered_sub_nqn -a target_ip_address -Q
queue_depth_setting -l controller_loss_timeout_period
command
does not persist through reboot. The NVMe connect command will need
to executed after each reboot to re-establish the NVMe connections.-Q 1024
command line option, as shown in the following example.-l 3600
command line option,
as shown in the following example.# nvme connect -t rdma -a 192.168.1.77 -n nqn.1992-08.com.netapp:5700.
600a098000a527a7000000005ab3af94 -Q 1024 -l 3600
# nvme connect -t rdma -a 192.168.2.77 -n nqn.1992-08.com.netapp:5700.
600a098000a527a7000000005ab3af94 -Q 1024 -l 3600
[Unit]
Description=Connect NVMe-oF subsystems automatically during boot
ConditionPathExists=/etc/nvme/discovery.conf
After=network.target
Before=remote-fs-pre.target
[Service]
Type=oneshot
ExecStart=/usr/sbin/nvme connect-all
[Install]
WantedBy=default.target