Highly Efficient Data Access with RoCE on IBM Elastic Storage Systems and IBM Spectrum ScaleWith Remote Direct Memory Access (RDMA), you can make a subset of a host’s memory directly available to a remote host. RDMA is available on standard Ethernet-based networks by using the RDMA over Converged Ethernet (RoCE) interface. The RoCE network protocol is an industry-standard initiative by the InfiniBand Trade Association. This IBM® Redpaper publication describes how to set up RoCE to use within an IBM Spectrum® Scale cluster and IBM Elastic Storage® Systems (ESSs). This book is targeted at technical professionals (consultants, technical support staff, IT Architects, and IT Specialists) who are responsible for delivering cost-effective storage solutions with IBM Spectrum Scale and IBM ESSs. |
Common terms and phrases
adapter add type bandwidth bond0 bytes config configuration Converged Ethernet RoCE default Differentiated Services Direct Memory Access DSCP Dual-port Elastic Storage System ess5kio2 fabric forever preferred_lft forever Functional verification global noprefixroute enp1s0f0 grep inet Hadoop I/O servers ib_read_bw ibdev2netdev mlx5_0 port IBM Elastic Storage IBM Redbooks IBM Spectrum Scale icmp_seq=1 ttl=64 ifdown ifname ifup InfiniBand interface mlag-port-channel IP address IP interface IPv4 ipv4.routes IPv6 Link Aggregation Linux Maximum Transmission Unit MB/sec Mellanox switch Mellanox Technologies Memory Access RDMA mestore-sw100-3 ess5k-sharky MLAG mmdsh mmfsd IP address mod enp1s0f0 network topology nmcli con mod nmcli con modify nmcli utility Number OpenFabrics Enterprise Distribution POWER8 proto static metric RDMA over Converged Remote Direct Memory RHEL root@ess5-ems1 nsdperf root@ess5kiol routing entries RUN+="/sbin/ethtool RUN+="/sbin/ip link set scope global noprefixroute scope link src set k txqueuelen shown in Example subnet sysctl TCP/IP trademarks traffic usr/lpp/mmfs/samples/net/nsdperf valid_lft forever preferred_lft VERBS programming