How to use DMA or RDMA in java?

C

6

8

"DMA" here means: Direct memory access, and "RDMA" is: remote direct memory access.

I used Java to created an application to transfer stock data, but I found the latency is bigger than I expected. I heard someone developed same type application used "DMA/RDMA", which has good performance, so I wonder if I can use "DMA/RDMA" in Java?

If not, what language should I use, and if there are any good libraries to use?

Clone answered 19/10, 2011 at 10:49 Comment(0)

P

6

This article from IBM developers work give a great overview of how DMA access can be achieved using java

Papyrology answered 19/10, 2011 at 11:19 Comment(3)

The article shows how to allow other parts of the OS to do DMA on Java-created data and achieve zero-copy data transfers. (Cool, if you ask me.) – Homosexuality 19/10, 2011 at 11:36

@LordDoskias, thank you, zerocopy is a good advice, I will try it later – Clone 19/10, 2011 at 11:40

Well in order to achieve DMA access of any kind you HAVE to rely on the underlying OS. So each JVM version has platform-specific code which exposes this capability through means of filechannels. So in a sense you are getting all the goodies that come from using DMA – Papyrology 19/10, 2011 at 11:42

V

3

You have two options (that I know of):

Java SDP -- has been deprecated
JXIO [1], a high-performance messaging library built on RDMA and supported by Mellanox

[1] https://github.com/accelio/JXIO

Voluminous answered 24/2, 2016 at 5:29 Comment(1)

Also JSOR from IBM: ibm.com/support/knowledgecenter/en/SSYKE2_7.1.0/… – Puling 19/9, 2019 at 9:12

B

2

There is DiSNI, a new library to program RDMA in Java. DiSNI is the open source variant of IBM's jVerbs. There are some performance numbers here that illustrate how RDMA with Java compares to sockets in C and Java, and also to RDMA in C.

Benita answered 9/8, 2016 at 8:27 Comment(0)

D

1

RDMA as I know it is a property of the networking infrastructure (along with the relevant kernel modules etc), not of the application-level programming language.

In other words, you'd have to get specialized kit to make use of RDMA to reduce network latency. Here is an example of a 10GbE network card that supports RDMA: link.

Diocesan answered 19/10, 2011 at 10:52 Comment(0)

I

0

Java applications are capable of mmaping files via nio packages. Those mmaped files can be accesses by multiple programs - I affraid this is closes thing to DMA available in java

Integer answered 19/10, 2011 at 10:54 Comment(0)

C

0

Java 7 supports SDP protocol on Solaris and Linux (with OpenFabrics.org drivers). Unfortunately SDP protocol has been deprecated in the 2.x version of OFED. People resort to JNI wrappers like jVerbs.

Colver answered 5/3, 2015 at 2:0 Comment(0)

Recommended topics

Hot tags