Mapping PostgreSQL JSON column to a Hibernate entity property
Asked Answered
L

12

94

I have a table with a column of type JSON in my PostgreSQL DB (9.2). I have a hard time to map this column to a JPA2 Entity field type.

I tried to use String but when I save the entity I get an exception that it can't convert character varying to JSON.

What is the correct value type to use when dealing with a JSON column?

@Entity
public class MyEntity {

    private String jsonPayload; // this maps to a json column

    public MyEntity() {
    }
}

A simple workaround would be to define a text column.

Lingonberry answered 12/4, 2013 at 14:50 Comment(2)
I know this is a bit old, but have a look at my answer https://mcmap.net/q/225389/-are-jpa-eclipselink-custom-types-possible for the similar questionLashundalasker
vladmihalcea.com/… this tutorial is pretty straightforwardSober
T
40

See PgJDBC bug #265.

PostgreSQL is excessively, annoyingly strict about data type conversions. It won't implicitly cast text even to text-like values such as xml and json.

The strictly correct way to solve this problem is to write a custom Hibernate mapping type that uses the JDBC setObject method. This can be a fair bit of hassle, so you might just want to make PostgreSQL less strict by creating a weaker cast.

As noted by @markdsievers in the comments and this blog post, the original solution in this answer bypasses JSON validation. So it's not really what you want. It's safer to write:

CREATE OR REPLACE FUNCTION json_intext(text) RETURNS json AS $$
SELECT json_in($1::cstring); 
$$ LANGUAGE SQL IMMUTABLE;

CREATE CAST (text AS json) WITH FUNCTION json_intext(text) AS IMPLICIT;

AS IMPLICIT tells PostgreSQL it can convert without being explicitly told to, allowing things like this to work:

regress=# CREATE TABLE jsontext(x json);
CREATE TABLE
regress=# PREPARE test(text) AS INSERT INTO jsontext(x) VALUES ($1);
PREPARE
regress=# EXECUTE test('{}')
INSERT 0 1

Thanks to @markdsievers for pointing out the issue.

Transcendental answered 13/4, 2013 at 2:3 Comment(6)
Worth reading the resulting blog post of this answer. Inparticular the comment section highlights the dangers of this (allows invalid json) and the alternative / superior solution.Capapie
@Capapie Thankyou. I've updated the post with a corrected solution.Transcendental
@CraigRinger No problem. Thank you for your prolific PG / JPA / JDBC contributions, many have been of great assistance to me.Capapie
@CraigRinger Since you're going through the cstring conversion anyway, couldn't you simply use CREATE CAST (text AS json) WITH INOUT?Jervis
@NickBarnes that solution also worked perfectly for me (and from what I had seen, it fails on invalid JSON, as it should). Thanks!Papillon
@NickBarnes you should have answered. That would have been a valuable contribution -- here it is though https://mcmap.net/q/223515/-mapping-postgresql-json-column-to-a-hibernate-entity-propertyLejeune
D
89

If you're interested, here are a few code snippets to get the Hibernate custom user type in place. First extend the PostgreSQL dialect to tell it about the json type, thanks to Craig Ringer for the JAVA_OBJECT pointer:

import org.hibernate.dialect.PostgreSQL9Dialect;

import java.sql.Types;

/**
 * Wrap default PostgreSQL9Dialect with 'json' type.
 *
 * @author timfulmer
 */
public class JsonPostgreSQLDialect extends PostgreSQL9Dialect {

    public JsonPostgreSQLDialect() {

        super();

        this.registerColumnType(Types.JAVA_OBJECT, "json");
    }
}

Next implement org.hibernate.usertype.UserType. The implementation below maps String values to the json database type, and vice-versa. Remember Strings are immutable in Java. A more complex implementation could be used to map custom Java beans to JSON stored in the database as well.

package foo;

import org.hibernate.HibernateException;
import org.hibernate.engine.spi.SessionImplementor;
import org.hibernate.usertype.UserType;

import java.io.Serializable;
import java.sql.PreparedStatement;
import java.sql.ResultSet;
import java.sql.SQLException;
import java.sql.Types;

/**
 * @author timfulmer
 */
public class StringJsonUserType implements UserType {

    /**
     * Return the SQL type codes for the columns mapped by this type. The
     * codes are defined on <tt>java.sql.Types</tt>.
     *
     * @return int[] the typecodes
     * @see java.sql.Types
     */
    @Override
    public int[] sqlTypes() {
        return new int[] { Types.JAVA_OBJECT};
    }

    /**
     * The class returned by <tt>nullSafeGet()</tt>.
     *
     * @return Class
     */
    @Override
    public Class returnedClass() {
        return String.class;
    }

    /**
     * Compare two instances of the class mapped by this type for persistence "equality".
     * Equality of the persistent state.
     *
     * @param x
     * @param y
     * @return boolean
     */
    @Override
    public boolean equals(Object x, Object y) throws HibernateException {

        if( x== null){

            return y== null;
        }

        return x.equals( y);
    }

    /**
     * Get a hashcode for the instance, consistent with persistence "equality"
     */
    @Override
    public int hashCode(Object x) throws HibernateException {

        return x.hashCode();
    }

    /**
     * Retrieve an instance of the mapped class from a JDBC resultset. Implementors
     * should handle possibility of null values.
     *
     * @param rs      a JDBC result set
     * @param names   the column names
     * @param session
     * @param owner   the containing entity  @return Object
     * @throws org.hibernate.HibernateException
     *
     * @throws java.sql.SQLException
     */
    @Override
    public Object nullSafeGet(ResultSet rs, String[] names, SessionImplementor session, Object owner) throws HibernateException, SQLException {
        if(rs.getString(names[0]) == null){
            return null;
        }
        return rs.getString(names[0]);
    }

    /**
     * Write an instance of the mapped class to a prepared statement. Implementors
     * should handle possibility of null values. A multi-column type should be written
     * to parameters starting from <tt>index</tt>.
     *
     * @param st      a JDBC prepared statement
     * @param value   the object to write
     * @param index   statement parameter index
     * @param session
     * @throws org.hibernate.HibernateException
     *
     * @throws java.sql.SQLException
     */
    @Override
    public void nullSafeSet(PreparedStatement st, Object value, int index, SessionImplementor session) throws HibernateException, SQLException {
        if (value == null) {
            st.setNull(index, Types.OTHER);
            return;
        }

        st.setObject(index, value, Types.OTHER);
    }

    /**
     * Return a deep copy of the persistent state, stopping at entities and at
     * collections. It is not necessary to copy immutable objects, or null
     * values, in which case it is safe to simply return the argument.
     *
     * @param value the object to be cloned, which may be null
     * @return Object a copy
     */
    @Override
    public Object deepCopy(Object value) throws HibernateException {

        return value;
    }

    /**
     * Are objects of this type mutable?
     *
     * @return boolean
     */
    @Override
    public boolean isMutable() {
        return true;
    }

    /**
     * Transform the object into its cacheable representation. At the very least this
     * method should perform a deep copy if the type is mutable. That may not be enough
     * for some implementations, however; for example, associations must be cached as
     * identifier values. (optional operation)
     *
     * @param value the object to be cached
     * @return a cachable representation of the object
     * @throws org.hibernate.HibernateException
     *
     */
    @Override
    public Serializable disassemble(Object value) throws HibernateException {
        return (String)this.deepCopy( value);
    }

    /**
     * Reconstruct an object from the cacheable representation. At the very least this
     * method should perform a deep copy if the type is mutable. (optional operation)
     *
     * @param cached the object to be cached
     * @param owner  the owner of the cached object
     * @return a reconstructed object from the cachable representation
     * @throws org.hibernate.HibernateException
     *
     */
    @Override
    public Object assemble(Serializable cached, Object owner) throws HibernateException {
        return this.deepCopy( cached);
    }

    /**
     * During merge, replace the existing (target) value in the entity we are merging to
     * with a new (original) value from the detached entity we are merging. For immutable
     * objects, or null values, it is safe to simply return the first parameter. For
     * mutable objects, it is safe to return a copy of the first parameter. For objects
     * with component values, it might make sense to recursively replace component values.
     *
     * @param original the value from the detached entity being merged
     * @param target   the value in the managed entity
     * @return the value to be merged
     */
    @Override
    public Object replace(Object original, Object target, Object owner) throws HibernateException {
        return original;
    }
}

Now all that's left is annotating the entities. Put something like this at the entity's class declaration:

@TypeDefs( {@TypeDef( name= "StringJsonObject", typeClass = StringJsonUserType.class)})

Then annotate the property:

@Type(type = "StringJsonObject")
public String getBar() {
    return bar;
}

Hibernate will take care of creating the column with json type for you, and handle the mapping back and forth. Inject additional libraries into the user type implementation for more advanced mapping.

Here's a quick sample GitHub project if anyone wants to play around with it:

https://github.com/timfulmer/hibernate-postgres-jsontype

Diet answered 16/4, 2013 at 23:45 Comment(16)
thanks for the thorough code examples! I am using a normal text field but I might take your approach in futurePope
Thanks for taking the time to write this. It intensely frustrates me that JPA doesn't define SPI hooks for user defined types to be written in a JPA-provider-independent way.Transcendental
No worries guys, I ended up with the code and this page in front of me and figured why not :) That might be the downside of the Java process. We get some pretty well thought through solutions to tough problems, but it's not easy to go in and add a good idea like generic SPI for new types. We're left with whatever the implementers, Hibernate in this case, put in place.Diet
there's a problem in your implementation code for nullSafeGet. Instead of of if(rs.wasNull()) you should do if(rs.getString(names[0]) == null). I'm not sure what rs.wasNull() does, but in my case it burned me by returning true, when the value I was looking for was in fact not null.Almagest
@Almagest Nice catch! Sorry you had to go through that. I've updated the code above.Diet
This solution worked nicely with Hibernate 4.2.7 except when retrieving null from json columns with the error 'No Dialect mapping for JDBC type: 1111'. However, adding the following line to the dialect class fixed it: this.registerHibernateType(Types.OTHER, "StringJsonUserType");Josh
@Josh I've updated the example above to work with latest Hibernate. Nice catch.Diet
JPA 2.1 has a converter annotation - but it only maps standard types (such as string) to your custom types (e.g. a java bean).Anette
don't forget to change your hibernate.properties replacing property "dialect" content with 'JsonPostgreSQLDialect'Cavalierly
I have tried this out and it works for reading/persisting the Entity. However if I need to run a query against Restrictions.sqlRestriction(sql, Object, Type) on the Jsonb column, the method has to take in a Type instead of UserType. It seems the only work around is to implement Type instead?Zoril
I am also looking for running a query. but show ' Unrecognized field' error for inner fields of json.Can you help me.Educt
I don't see any code on the linked github-project ;-) BTW: Wouldn't it be useful to have this code as a library for reuse?Blane
How does this solution differ for Hibernate 5?Dexedrine
Nice answer tyvm Tim !Eadith
Can you do this with returnedClass as a JSONObject or an Object?Overmantel
It's worth mentioning that starting from Postgre 9.2 the json column type register is already done.Orthotropous
T
40

See PgJDBC bug #265.

PostgreSQL is excessively, annoyingly strict about data type conversions. It won't implicitly cast text even to text-like values such as xml and json.

The strictly correct way to solve this problem is to write a custom Hibernate mapping type that uses the JDBC setObject method. This can be a fair bit of hassle, so you might just want to make PostgreSQL less strict by creating a weaker cast.

As noted by @markdsievers in the comments and this blog post, the original solution in this answer bypasses JSON validation. So it's not really what you want. It's safer to write:

CREATE OR REPLACE FUNCTION json_intext(text) RETURNS json AS $$
SELECT json_in($1::cstring); 
$$ LANGUAGE SQL IMMUTABLE;

CREATE CAST (text AS json) WITH FUNCTION json_intext(text) AS IMPLICIT;

AS IMPLICIT tells PostgreSQL it can convert without being explicitly told to, allowing things like this to work:

regress=# CREATE TABLE jsontext(x json);
CREATE TABLE
regress=# PREPARE test(text) AS INSERT INTO jsontext(x) VALUES ($1);
PREPARE
regress=# EXECUTE test('{}')
INSERT 0 1

Thanks to @markdsievers for pointing out the issue.

Transcendental answered 13/4, 2013 at 2:3 Comment(6)
Worth reading the resulting blog post of this answer. Inparticular the comment section highlights the dangers of this (allows invalid json) and the alternative / superior solution.Capapie
@Capapie Thankyou. I've updated the post with a corrected solution.Transcendental
@CraigRinger No problem. Thank you for your prolific PG / JPA / JDBC contributions, many have been of great assistance to me.Capapie
@CraigRinger Since you're going through the cstring conversion anyway, couldn't you simply use CREATE CAST (text AS json) WITH INOUT?Jervis
@NickBarnes that solution also worked perfectly for me (and from what I had seen, it fails on invalid JSON, as it should). Thanks!Papillon
@NickBarnes you should have answered. That would have been a valuable contribution -- here it is though https://mcmap.net/q/223515/-mapping-postgresql-json-column-to-a-hibernate-entity-propertyLejeune
G
33

Maven dependency

The first thing you need to do is to set up the following Hibernate Types Maven dependency in your project pom.xml configuration file:

<dependency>
    <groupId>com.vladmihalcea</groupId>
    <artifactId>hibernate-types-52</artifactId>
    <version>${hibernate-types.version}</version>
</dependency>

Domain model

Now, you need to declare the JsonType on either class level or in a package-info.java package-level descriptor, like this:

@TypeDef(name = "json", typeClass = JsonType.class)

And, the entity mapping will look like this:

@Type(type = "json")
@Column(columnDefinition = "jsonb")
private Location location;

If you're using Hibernate 5 or later, then the JSON type is registered automatically by the Postgre92Dialect.

Otherwise, you need to register it yourself:

public class PostgreSQLDialect extends PostgreSQL91Dialect {

    public PostgreSQL92Dialect() {
        super();
        this.registerColumnType( Types.JAVA_OBJECT, "jsonb" );
    }
}
Glover answered 21/6, 2016 at 13:58 Comment(10)
Nice example, but can this be used with some generic DAO, like Spring Data JPA repositories to query data without native queries like we can do with MongoDB? I didn't find any valid answer or solution to this case. Yes we can store the data, and we can retreive them by filtering columns in RDBMS, but I cannot filter by JSONB coluns so far. I wish I am wrong and there is such solution.Plait
Yes, you can. But you need to use nativ queries which are supported by Spring Data JPA too.Glover
I see, that was actually my questin, if we can go without native queries, but just via objects methods. Something like @Document annotation for MongoDB style. So I assume this is not so far in case of PostgreSQL and the only solution is native queries -> nasty :-), but thanks for confirmation.Plait
It would be good to see in future something like entity which really represents table and document annotation on fields type of json and I can use Spring repositories to do CRUD stuff on the fly. Think is that I am generating quite advanced REST API for databases with Spring. But with JSON in place I am facing quite unexpected overhead so I will need to process every single document with generate queries as well.Plait
You can use Hibernate OGM with MongoDB if JSON is your single store.Glover
I mention MongoDB just as example. My question is more about: Do you know about some JPA standard which could bring same functionalities regarding QUERYING data within PostgreSQL JSONB structures in same way as you can do with JPA (hibernate) with MongoDB?Plait
Is there JUnit support for JSONB in springboot projects?Overmantel
This solution worked for me only after changing the Java class of the json field to Jackson's JsonNode. It did not work for a pojo or a raw json string.Bookkeeper
The GitHub repository associated with the hibernate-types contains unit tests which show you how to map to a Pojo as well.Glover
Thanks for your work. Just one thing: you forgot to mention that the json class must implement Serializable. Struggled a few hours until I saw your GitHub...Oubre
W
16

In case someone is interested, you can use JPA 2.1 @Convert / @Converter functionality with Hibernate. You would have to use the pgjdbc-ng JDBC driver though. This way you don't have to use any proprietary extensions, dialects and custom types per field.

@javax.persistence.Converter
public static class MyCustomConverter implements AttributeConverter<MuCustomClass, String> {

    @Override
    @NotNull
    public String convertToDatabaseColumn(@NotNull MuCustomClass myCustomObject) {
        ...
    }

    @Override
    @NotNull
    public MuCustomClass convertToEntityAttribute(@NotNull String databaseDataAsJSONString) {
        ...
    }
}

...

@Convert(converter = MyCustomConverter.class)
private MyCustomClass attribute;
Willhite answered 4/5, 2015 at 5:27 Comment(5)
This sounds useful - what types should it convert between to be able to write JSON? Is it <MyCustomClass, String> or some other type?Drink
Thanks - just verified that it works for me (JPA 2.1, Hibernate 4.3.10, pgjdbc-ng 0.5, Postgres 9.3)Drink
Is it possible to make it work without specifing @Column(columnDefinition = "json") on the field? Hibernate is making a varchar(255) without this definition.Melia
Hibernate cannot possibly know what column type you want there, but you insist that it's Hibernate's responsibility to update the database schema. So I guess it picks the default one.Willhite
This works with Gson as the "custom" class, and you can return the resultant JsonElement as a JsonObject, JsonArray, JSonPrimitive, or JsonNull. No need for TypeDefs or anything else, just use columnDefinition = "jsonb" and it reads just fine. Very sexy, great answer!Conquistador
M
8

I tried many methods I found on the Internet, most of them are not working, some of them are too complex. The below one works for me and is much more simple if you don't have that strict requirements for PostgreSQL type validation.

Make PostgreSQL jdbc string type as unspecified, like <connection-url> jdbc:postgresql://localhost:test?stringtype=‌​unspecified </connect‌​ion-url>

Mozellemozes answered 7/12, 2016 at 17:12 Comment(1)
Thank you! I was using hibernate-types but this is way easier! FYI here are the docs about this param jdbc.postgresql.org/documentation/83/connect.htmlAllrud
C
3

I had a similar problem with Postgres (javax.persistence.PersistenceException: org.hibernate.MappingException: No Dialect mapping for JDBC type: 1111) when executing native queries (via EntityManager) that retrieved json fields in the projection although the Entity class has been annotated with TypeDefs. The same query translated in HQL was executed without any problem. To solve this I had to modify JsonPostgreSQLDialect this way:

public class JsonPostgreSQLDialect extends PostgreSQL9Dialect {

public JsonPostgreSQLDialect() {

    super();

    this.registerColumnType(Types.JAVA_OBJECT, "json");
    this.registerHibernateType(Types.OTHER, "myCustomType.StringJsonUserType");
}

Where myCustomType.StringJsonUserType is the class name of the class implementing the json type (from above, Tim Fulmer answer) .

Crosier answered 30/9, 2015 at 13:9 Comment(0)
L
2

There is an easier to to do this which doesn't involve creating a function by using WITH INOUT

CREATE TABLE jsontext(x json);

INSERT INTO jsontext VALUES ($${"a":1}$$::text);
ERROR:  column "x" is of type json but expression is of type text
LINE 1: INSERT INTO jsontext VALUES ($${"a":1}$$::text);

CREATE CAST (text AS json)
  WITH INOUT
  AS ASSIGNMENT;

INSERT INTO jsontext VALUES ($${"a":1}$$::text);
INSERT 0 1
Lejeune answered 3/2, 2017 at 20:5 Comment(1)
Thanks, used this to cast varchar to ltree, works perfectly.Shiism
P
1

All the above solution did not work for me. Finally I made use of native queries to insert the data.

Step -1 Create an abstract class AbstractEntity which will implements Persistable with annotation @MappedSuperclass (part of javax.persistence) Step -2 In this class create your sequence generator because you can not generate a sequencer with the native queries. @Id @GeneratedValues @Column private Long seqid;

Dont forget - Your entity class should extends your abstract class. (helping your sequence to work as well it may works on date as well(check for date i am not sure))

Step- 3 In repo interface write the native query.

value="INSERT INTO table(?,?)values(:?,:cast(:jsonString as json))",nativeQuery=true

Step - 4 This will convert your java string object to json and insert/store in database and also you will be able to increment the sequence on each insertion as well.

I got casting error when I worked using converter. Also type-52 personally I avoided to use that in my project. Please upvote my ans if it works for you guys.

Psychophysics answered 19/3, 2021 at 7:31 Comment(0)
S
1

I ran into this issue when I migrated my projects from MySQL 8.0.21 to Postgres 13. My project uses Spring boot with the Hibernate types dependency version 2.7.1. In my case the solution was simple. enter image description here

All I needed to do was change that and it worked.

Referenced from the Hibernate Types Documentation page.

Sternpost answered 19/5, 2021 at 5:59 Comment(0)
P
0

I was running into this and didn't want to enable stuff via connection string, and allow implicit conversions. At first I tried to use @Type, but because I'm using a custom converter to serialize/deserialize a Map to/from JSON, I couldn't apply a @Type annotation. Turns out I just needed to specify columnDefinition = "json" in my @Column annotation.

@Convert(converter = HashMapConverter.class)
@Column(name = "extra_fields", columnDefinition = "json")
private Map<String, String> extraFields;
Proposition answered 23/4, 2020 at 22:29 Comment(1)
Where have you defined this HashMapConverter class. How it look like.Clicker
S
0

I encountered the column "roles" is of type json but expression is of type character varying exception with the following entity with Postgres:

@Entity
@TypeDefs(@TypeDef(name = "json", typeClass = JsonBinaryType.class))
@Data
@AllArgsConstructor
@NoArgsConstructor
@Builder
@EqualsAndHashCode(of = "extId")
public class ManualTaskUser {

    @Id
    private String extId;

    @Type(type = "json")
    @Column(columnDefinition = "json")
    private Set<Role> roles;

}

It should be mentioned that Role is an enum and not a POJO.

In the generated SQL I could see that the Set was correctly serialized like this: ["SYSTEM","JOURNEY","ADMIN","OBJECTION","DEVOPS","ASSESSMENT"].

Changing the typeClass in the TypeDef annotation from JsonStringType to JsonBinaryType solved the problem! Thanks to Joseph Waweru for the hint!

Syrupy answered 30/11, 2022 at 14:26 Comment(0)
T
0

Use hibernate-specific annotations JdbcTypeCode and SqlType:

import org.hibername.annotations.JdbcTypeCode;
import org.hibername.type.SqlType;
import jakarta.persistence.Entity;

@Entity
public class MyEntity {

    @JdbcTypeCode(SqlTypes.JSON)
    private List<String> myJsonArray;

    @JdbcTypeCode(SqlTypes.JSON)
    private Map<String, String> myJsonObject;

    public MyEntity() {
    }
}
Table answered 5/10, 2023 at 15:45 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.