Calling Python in Java?

Question

I am wondering if it is possible to call Python functions from Java code using Jython, or is it only for calling Java code from Python?

Schoolfellow

Please take a look on similar question and read the answer. bytes.com/topic/python/answers/… – Inaccurate

Answer 1

Jython: Python for the Java Platform - http://www.jython.org/index.html

You can easily call python functions from Java code with Jython. That is as long as your python code itself runs under jython, i.e. doesn't use some c-extensions that aren't supported.

If that works for you, it's certainly the simplest solution you can get. Otherwise you can use org.python.util.PythonInterpreter from the new Java6 interpreter support.

A simple example from the top of my head - but should work I hope: (no error checking done for brevity)

PythonInterpreter interpreter = new PythonInterpreter();
interpreter.exec("import sys\nsys.path.append('pathToModules if they are not there by default')\nimport yourModule");
// execute a function that takes a string and returns a string
PyObject someFunc = interpreter.get("funcName");
PyObject result = someFunc.__call__(new PyString("Test!"));
String realResult = (String) result.__tojava__(String.class);

As of 2021, Jython does not support Python 3.x

Locklear

I've installed JYthon, or i assume i did, and I keep trying to run the code that you outlined but it highlighted as a mistake. Does the installion of Jython need to go to a specific folder, either in the python or java folders? – Schoolfellow

There aren't any error, i'm just having a hard time integrating Jython into Netbeans – Schoolfellow

If there's no error it would work, so that's obviously not the case ;) "Error" does not mean runtime error, could be a compile error as well. – Locklear

My bad, it was a poor use of the word. I was trying to add the jython.jar to my project and netbeans. I figured it out though – Schoolfellow

@Locklear I imported jython.jar as a external library. but I got an error: Could not find class 'org.python.util.PythonInterpreter' – Agent

@Locklear I installed jpython on Ub14.04 and after adding a bunch of required jar files, I stranded at java.lang.IncompatibleClassChangeError: Implementing class. My Main is doing PythonInterpreter i = new PythonInterpreter(); i.exec("print \"hello world\""); Any idea what might be wrong? – Nepotism

@Locklear Nvm, I found the error. Looks like I needed to add asm3 instead of asm4 – Nepotism

Is the Python interpreter used by org.python.util.PythonInterpreter Jython or CPython? – Overhand

This works! But I have another question, PyObject obj = interpreter.compile("..."); // a piece of code that contains two functions, myFunc1 and myFunc2, how to call a specified functioin, for example myFunc1 – Cholula

further info in regards to invoking an actual Python API through PythonInterpreter would be appreciated. – Highchair

Python 2 end of Life is 1.1.2020 and Jython only supports Python 2.7. so no Jython is basically dead. Best (simplest) Option is the Jep lib – Williamsen

jython is long long dormant [/dead]. That's too bad. – Aesthetically

Answer 2

I think there are some important things to consider first with how strong you wish to have the linking between Java and Python.

Firstly Do you only want to call functions or do you actually want Python code to change the data in your java objects? This is very important. If you only want to call some Python code with or without arguments, then that is not very difficult. If your arguments are primitives it makes it even more easy. However, if you want to have Java class implement member functions in Python, which change the data of the Java object, then this is not so easy or straight forward.

Secondly are we talking CPython, or will Jython do? I would say CPython is where its at! I would advocate this is why Python is so kool! Having such high abstractions however access to C or C++ when needed. Imagine if you could have that in Java. This question is not even worth asking if Jython is ok because then it is easy anyway.

So I have played with the following methods, and listed them from easy to difficult:

Java to Jython

Advantages: Trivially easy. Have actual references to Java objects

Disadvantages: No CPython, Extremely Slow!

Jython from Java is so easy, and if this is really enough then great. However it is very slow and no CPython! Is life worth living without CPython? I don't think so! You can easily have Python code implementing your member functions for you Java objects.

Java to Jython to CPython via Pyro

Pyro is the remote object module for Python. You have some object on a CPython interpreter, and you can send it objects which are transferred via serialization and it can also return objects via this method. Note that if you send a serialized Python object from Jython and then call some functions which change the data in its members, then you will not see those changes in Java. You just need to remember to send back the data which you want from Pyro. This, I believe, is the easiest way to get to CPython! You do not need any JNI or JNA or SWIG or .... You don't need to know any C, or C++. Kool huh?

Advantages:

• Access to CPython
• Not as difficult as following methods

Disadvantages:

• Cannot change the member data of Java objects directly from Python
• Is somewhat indirect (Jython is middle man)

Java to C/C++ via JNI/JNA/SWIG to Python via Embedded interpreter (maybe using BOOST Libraries?)

OMG this method is not for the faint of heart. And I can tell you it has taken me very long to achieve this in with a decent method. Main reason you would want to do this is so that you can run CPython code which as full rein over you java object. There are major things to consider before deciding to try and breed Java (which is like a chimp) with Python (which is like a horse). Firstly if you crash the interpreter, that's lights out for you program! And don't get me started on concurrency issues! In addition, there is a lot of boiler, I believe I have found the best configuration to minimize this boiler but it is still a lot! So how to go about this: Consider that C++ is your middle man, your objects are actually C++ objects! Good that you know that now. Just write your object as if your program is in C++ and not Java, with the data you want to access from both worlds. Then you can use the wrapper generator called SWIG to make this accessible to java and compile a dll which you call (System.load(dllNameHere)) in Java. Get this working first, then move on to the hard part! To get to Python you need to embed an interpreter. Firstly I suggest doing some hello interpreter programs or this tutorial Embedding Python in C/C. Once you have that working, its time to make the horse and the monkey dance! You can send you C++ object to Python via [boost][3] . I know I have not given you the fish, merely told you where to find the fish. Some pointers to note for this when compiling.

When you compile boost you will need to compile a shared library. And you need to include and link to the stuff you need from jdk, ie jawt.lib, jvm.lib, (you will also need the client jvm.dll in your path when launching the application) As well as the python27.lib or whatever and the boost_python-vc100-mt-1_55.lib. Then include Python/include, jdk/include, boost and only use shared libraries (dlls) otherwise boost has a teary. And yeah full on I know. There are so many ways in which this can go sour. So make sure you get each thing done block by block. Then put them together.

Quarters

Here a library that lets you write your python scripts once and decide which integration method (Jython, CPython via Jep and Py4j) to use at runtime: github.com/subes/invesdwin-context-python Since each method has its own benefits/drawbacks – Jaquelin

@Jaquelin that project looks awesome I wrote this a while ago. I encourage you to write an answer I would upvote it. I dislike the top answer haha because I don't think it provides much useful information outside of a google search. – Quarters

I created a separate answer – Jaquelin

does this answer smell to "this should be the accepted answer" or is it just me ? ;-) – Inoculation

Answer 3

It's not smart to have python code inside java. Wrap your python code with flask or another web framework to make it a microservice. This makes your java program able to call this microservice (e.g. via REST).

This approach is simple and it will save you tons of issues. And the codes are loosely coupled so they are scalable.

Updated on Mar 24th 2020: According to @stx's comment, the above approach is not suitable for massive data transfer between client and server. Here is another approach I recommended: Connecting Python and Java with Rust(C/C++ also ok). https://medium.com/@shmulikamar/https-medium-com-shmulikamar-connecting-python-and-java-with-rust-11c256a1dfb0

Evie

+1 , but what about the additional performance and communication overhead of creating and parsing back and forth messages on both ends? – Anasarca

yes, this needs to define an api interface with minimum input/output required. It is not smart to have a lot of data transfter between client/server on the network. If you cannot define such an interface, then this design approach doesn't suits. – Evie

Answer 4

Several of the answers mention that you can use JNI or JNA to access cpython but I would not recommend starting from scratch because there are already open source libraries for accessing cpython from java. For example:

• JEP
• JPY

Gunmaker

Answer 5

GraalVM is a good choice. I've done Java+Javascript combination with GraalVM for microservice design (Java with Javascript reflection). They recently added support for python, I'd give it a try especially with how big its community has grown over the years.

UPDATE June 2021

https://www.graalvm.org/reference-manual/python/ says

GraalVM provides a Python 3.8 compliant runtime. A primary goal of the GraalVM Python runtime is to support SciPy and its constituent libraries, as well as to work with other data science and machine learning libraries from the rich Python ecosystem. At this point, the Python runtime is made available for experimentation and curious end-users.

Unstrung

Answer 6

Here a library that lets you write your python scripts once and decide which integration method (Jython, CPython/PyPy via Jep and Py4j) to use at runtime:

https://github.com/subes/invesdwin-context-python

Since each method has its own benefits/drawbacks as explained in the link.
(3 modules: jep, Py4J, jython )

Jaquelin

This project doesn't have any release. – Erotic

@ChristianSchlichtherle invesdwin-context-python version 1.0.0 is not available; thanks to this little gem: github.com/loewenfels/dep-graph-releaser – Jaquelin

Project release are now available, see github.com/invesdwin/invesdwin-context-python/issues/1 , however one should consider number of dependencies this project brings, see github.com/invesdwin/invesdwin-context-python/issues/4 – Pfeiffer

Answer 7

It depends on what do you mean by python functions? if they were written in cpython you can not directly call them you will have to use JNI, but if they were written in Jython you can easily call them from java, as jython ultimately generates java byte code.

Now when I say written in cpython or jython it doesn't make much sense because python is python and most code will run on both implementations unless you are using specific libraries which relies on cpython or java.

see here how to use Python interpreter in Java.

Fanchan

Answer 8

Depending on your requirements, options like XML-RPC could be useful, which can be used to remotely call functions virtually in any language supporting the protocol.

Trifoliate

I used that for a project 15 years ago and it was murderously complicated. At least use JSON.. – Aesthetically

Answer 9

Jython has some limitations:

There are a number of differences. First, Jython programs cannot use CPython extension modules written in C. These modules usually have files with the extension .so, .pyd or .dll. If you want to use such a module, you should look for an equivalent written in pure Python or Java. Although it is technically feasible to support such extensions - IronPython does so - there are no plans to do so in Jython.

Distributing my Python scripts as JAR files with Jython?

you can simply call python scripts (or bash or Perl scripts) from Java using Runtime or ProcessBuilder and pass output back to Java:

Running a bash shell script in java

Running Command Line in Java

java runtime.getruntime() getting output from executing a command line program

Blackpool

Answer 10

You can call any language from java using Java Native Interface

Garnett

Any language that itself can be called from c that is. Well ok python can, but Jython is a much simpler solution there really (or using the PyInterpreter in j6+). It's not that trivial to write the code to call python functions from c. – Locklear

Answer 11

This gives a pretty good overview over the current options. Some of which are named in other answers. Jython is not usable until they decide to not implement Python 3. Many of the other projects are coming from the python side and want to access java. But there are a few options still, to name something which has not been named yet: gRPC

Williamsen

This answers #67821180 . Thanks – Pfeiffer

Answer 12

I have similar requirement, I think best solution is thrift for me(also a rpc solution), just run test passed successfully right now, and can use thrift-generator to gen thrift file from java interface, then gen python files and java client files from the thrift file

Brimful

Answer 13

In in terms of data exchange from python to Java we can make it a rest services and exchange the data in the XML or Json format but sometimes we need to call automated script is easily created with python to called in java file.

Goldbrick