Summary
In computing the SCSI RDMA Protocol (SRP) is a protocol that allows one computer to access SCSI devices attached to another computer via remote direct memory access (RDMA).[1][2] The SRP protocol is also known as the SCSI Remote Protocol. The use of RDMA makes higher throughput and lower latency possible than what is generally available through e.g. the TCP/IP communication protocol.
Though the SRP protocol has been designed to use RDMA networks efficiently, it is also possible to implement the SRP protocol over networks that do not support RDMA.
History edit
SRP was published as an ANSI standard (ANSI INCITS 365-2002) in 2002 and renewed in 2007 and 2019.[3][4]
Related Protocols edit
As with the ISCSI Extensions for RDMA (iSER) communication protocol, there is the notion of a target (a system that stores the data) and an initiator (a client accessing the target) with the target initiating data transfers. In other words, when an initiator writes data to a target, the target executes an RDMA read to fetch the data from the initiator and when a user issues a SCSI read command, the target sends an RDMA write to the initiator.
While the SRP protocol is easier to implement than the iSER protocol, iSER offers more management functionality, e.g. the target discovery infrastructure enabled by the iSCSI protocol.
Performance edit
Bandwidth and latency of storage targets supporting the SRP or the iSER protocol should be similar. On Linux, there are two SRP and two iSER storage target implementations available that run inside the kernel (SCST[5] and LIO) and an iSER storage target implementation that runs in user space (STGT). Measurements have shown that the SCST SRP target has a lower latency and a higher bandwidth than the STGT iSER target. This is probably because the RDMA communication overhead is lower for a component implemented in the Linux kernel than for a user space Linux process, and not because of protocol differences.[6]
Implementations edit
In order to use the SRP protocol, an SRP initiator implementation, an SRP target implementation and networking hardware supported by the initiator and target are needed. The following software SRP initiator implementations exist:
- Linux SRP initiator, available since November 2005 (kernel version 2.6.15).
- Windows SRP initiator, available through the winOFED InfiniBand stack.[7]
- VMWare SRP initiator, available since January 2008 through Mellanox' OFED Drivers for VMware Infrastructure 3 and vSphere 4.[8]
- Solaris 10 SRP initiator, available through Sun's download page.[9]
- Solaris 11 and OpenSolaris SRP initiator, integrated as a component of project COMSTAR.[10]
- The IBM POWER virtual SCSI client driver for Linux (ibmvscsi), available since January 2008 (kernel version 2.6.24[11]). Virtual SCSI allows client logical partitions to access I/O devices (disk, CD, and tape) that are owned by another logical partition.[12][13]
The following SRP target implementations exist:
- The SCST SRP target implementation.[5] This is a mature SRP target implementation available since 2008 via both SCST and OFED.[14]
- Linux LIO SRP target,[15] available since January 2012 (kernel version 3.3[16]), based on the SCST SRP target.
- The IBM POWER virtual SCSI target driver (ibmvstgt), available since January 2008 (kernel version 2.6.24[11]).[12][13]
- DataDirect Network's (DDN) disk subsystems such as the S2A9900 and SFA10000, which use the SRP target implementation in the disk subsystem's controllers to present LUNs to servers (the servers act as SRP initiators).[17][18]
- IBM's FlashSystem.[19]
- The Solaris COMSTAR target, available since early 2009 in OpenSolaris and Solaris 11.[20]
See also edit
- iSCSI Extensions for RDMA (iSER)
- "SRP Update and Directions". openfabrics.org. 27 Mar 2012.
References edit
- ^ ANSI T10 SRPr16a, www.t10.org.
- ^ ANSI T10 SRPr16a, web.archive.org
- ^ ANSI webstore for purchasing standards - ANSI INCITS 365-2002
- ^ "SCSI RDMA Protocol - 2 (SRP-2)" (PDF). ANSI T10. 7 May 2019.
- ^ a b The SCST Project, an open source SCSI target implementation for Linux that includes an SRP target implementation.
- ^ Performance of SCST versus STGT.
- ^ OpenFabrics Enterprise Distribution for Windows.
- ^ Mellanox OFED Drivers for VMware Infrastructure 3 and vSphere 4.
- ^ Sun's download page.
- ^ "Configuring SRP Devices With COMSTAR". Retrieved 4 February 2013.
- ^ a b Linux kernel version 2.6.24 change log.
- ^ a b D. Boutcher and D. Engebretsen, Linux Virtualization on IBM POWER5 Systems, Proceedings of the Linux Symposium, Vol. 1, July 2004, pp. 113-120.
- ^ a b IBM Systems Hardware Information Center, Virtual SCSI.
- ^ OFED 1.5.4.1 Release Notes, OpenFabrics website, January 2012.
- ^ "SCSI RDMA Protocol". linux-iscsi.org.
- ^ Linus Torvalds (2012-01-18). "InfiniBand/SRP merge". lkml.org.
- ^ "DDN SFA10000 User Guide" (PDF). ddn.com. 2012-01-18.
- ^ "DDN Corporate Overview, IB Storage 101 section" (PDF). ddn.com. 2012-01-18.
- ^ IBM (10 March 2014). "IBM FlashSystem Integration Guide".
- ^ Moellenkamp, Joerg. "PSARC/2009/111: SRP Target in Comstar". Retrieved 4 February 2013.