On a node using 25Gb/s ethernet and infiniband HDR100, the "ibsat" command show 3 interfaces.
- irdma0 and irdma1 with "Link layer: Ethernet"
- mlx5_0 with "Link layer: InfiniBand"
OpenSM select irdma0 (alphabetical order ?) as the default interface and fails with this GUID as it is Ethernet. May be a more optimized interface selection also based on the "Link layer: InfiniBand" property could improve OpenSM.
Of course GUID can be set in opensm.conf but doing this with ansible for an automatic deployement is a little bit hard and when default setup works all is so simple.
Thanks
On a node using 25Gb/s ethernet and infiniband HDR100, the "ibsat" command show 3 interfaces.
OpenSM select irdma0 (alphabetical order ?) as the default interface and fails with this GUID as it is Ethernet. May be a more optimized interface selection also based on the "Link layer: InfiniBand" property could improve OpenSM.
Of course GUID can be set in opensm.conf but doing this with ansible for an automatic deployement is a little bit hard and when default setup works all is so simple.
Thanks