How do you do a limit query in JPQL or HQL?
Asked Answered
A

15

272

In Hibernate 3, is there a way to do the equivalent of the following MySQL limit in HQL?

select * from a_table order by a_table_column desc limit 0, 20;

I don't want to use setMaxResults if possible. This definitely was possible in the older version of Hibernate/HQL, but it seems to have disappeared.

Anatase answered 6/8, 2009 at 15:33 Comment(1)
I am using Hibernate-5.0.12. Is this still not available? It would be really heavy to get a million or so records and then apply the filter on it- setMaxResults over it as noticed by @Rachel in the answer by @skaffman.Poock
H
338

This was posted on the Hibernate forum a few years back when asked about why this worked in Hibernate 2 but not in Hibernate 3:

Limit was never a supported clause in HQL. You are meant to use setMaxResults().

So if it worked in Hibernate 2, it seems that was by coincidence, rather than by design. I think this was because the Hibernate 2 HQL parser would replace the bits of the query that it recognised as HQL, and leave the rest as it was, so you could sneak in some native SQL. Hibernate 3, however, has a proper AST HQL Parser, and it's a lot less forgiving.

I think Query.setMaxResults() really is your only option.

Heartfelt answered 6/8, 2009 at 15:37 Comment(11)
I was hoping somehow that they realized that that is annoying. Also, if you looked at the source code, they had implemented it for every database, and every database is different. Oh well, that's sad.Anatase
I would argue that Hibernate 3's approach is more correct. Your usage of Hibernate is meant to be database-agnostic, so you should have to do these sorts of things in an abstract manner.Emad
I agree, but it makes migration is royal pain in the ass when features are dropped like that.Heartfelt
but with setMaxResults, first query is run and then on the resultset you call setMaxResults which would take limited number of result rows from resultset and display it to the user, in my case i have 3 million records which are queried and then am calling setMaxResults to set 50 records but i do not want to do that, while query itself i want to query for 50 records, is there a way to do that?Stacte
Old post I know. I fully agree with Rachel. Using NHibernate (.Net port of Hibernate), I've recently upgraded from 2 to 3 and same thing, top X is now throwing a parser error. However, when I added setMaxResults on the query, it did generate a TOP X in the resulting SQL (using MsSql2008Dialect). This is good.Novel
@Stacte With setMaxResults hibernate will append the limit part to the query. It will not get all the results. You can check the query it produces by enabling: <property name="show_sql">true</property>Chadwell
It would only make sense that this feature is not supported by all databases. For example: Oracle's SQL does not have a limit or top keyword, it has a rownum though, but you can't use it in combination with sorting, unless you wrap it (i.e. use subqueries). But that makes it hard to combine it with a join. MySQL and Teradata use top and requires it to be right in front of the query, but mysql requires it to be all the way at the back using the limit keyword. I have no trouble believing that MySQL and SQL Server support it, but I would be surprised if Oracle did.Coiffure
I don't think it didn't work in hibernate 3. In jboss 5.1.0.GA which included Hibernate 3.3.1 limit was working fine.Toxophilite
@Chadwell when the query uses fetch joins, it appears that setMaxResults() does not add limit to the query (for Oracle DB), but loads all the records in memory and does the reduction of the number of records there. When you have millions of matching records, that means an OutOfMemoryError (or related error)Eisenstein
I am using Hibernate-5.0.12. Is this still not available? It would be really heavy to get a million or so records and then apply the filter it- setMaxResults over it as noticed by @Rachel.Poock
Take a look at this page which explains the rationale behind this decision: dzone.com/articles/hibernate-tuning-queries-using In particular, the LIMIT keyword is not database-agnostic, so setMaxResults is needed to convert the query to the appropriate keyword in your dialect. Second, if the query involves a FETCH JOIN, the LIMIT keyword will not make sense since it will apply to rows, not parent entities. Hence Hibernate does not include it. Getting a small piece of data from many large tables is still a problem, but hopefully this will shed light on Hibernate's limitations here.Turntable
A
160
 // SQL: SELECT * FROM table LIMIT start, maxRows;

Query q = session.createQuery("FROM table");
q.setFirstResult(start);
q.setMaxResults(maxRows);
Affined answered 14/2, 2011 at 9:28 Comment(1)
I like this one best because setFirstResult is actually mentioned in this answer whereas here and elsewhere they just say setMaxResults this and setMaxResults that without mentioning how to set the offset.Correa
T
21

If you don't want to use setMaxResults() on the Query object then you could always revert back to using normal SQL.

Terrenceterrene answered 6/8, 2009 at 15:36 Comment(5)
That's not really all that exciting.Anatase
I don't find HQL exciting either. Why not write a view on your DB server that applies the limit and then get HQL to look at that view :PTerrenceterrene
It's just one of those things, while SQL is much easier than HQL for each query, creating views and writing native SQL tends to be not so great for refactoring. I try to avoid it when I can. That actual real problem was the I wrote my MySQL query wrong anyways and thought setMaxResults was being weird. It wasn't.Anatase
and if you try to switch between different DBMS vendors, pain is waiting for you.Hypnosis
instead of using limit I used pageable to avoid the extra dataStrickman
S
15

The setFirstResult and setMaxResults Query methods

For a JPA and Hibernate Query, the setFirstResult method is the equivalent of OFFSET, and the setMaxResults method is the equivalent of LIMIT:

List<Post> posts = entityManager.createQuery("""
    select p
    from Post p
    order by p.createdOn
    """)
.setFirstResult(10)
.setMaxResults(10)
.getResultList();

The LimitHandler abstraction

The Hibernate LimitHandler defines the database-specific pagination logic, and as illustrated by the following diagram, Hibernate supports many database-specific pagination options:

LimitHandler implementations

Now, depending on the underlying relational database system you are using, the above JPQL query will use the proper pagination syntax.

MySQL

SELECT p.id AS id1_0_,
       p.created_on AS created_2_0_,
       p.title AS title3_0_
FROM post p
ORDER BY p.created_on
LIMIT ?, ?

PostgreSQL

SELECT p.id AS id1_0_,
       p.created_on AS created_2_0_,
       p.title AS title3_0_
FROM post p
ORDER BY p.created_on
LIMIT ?
OFFSET ?

SQL Server

SELECT p.id AS id1_0_,
       p.created_on AS created_on2_0_,
       p.title AS title3_0_
FROM post p
ORDER BY p.created_on
OFFSET ? ROWS 
FETCH NEXT ? ROWS ONLY

Oracle

SELECT *
FROM (
    SELECT 
        row_.*, rownum rownum_
    FROM (
        SELECT 
            p.id AS id1_0_,
            p.created_on AS created_on2_0_,
            p.title AS title3_0_
        FROM post p
        ORDER BY p.created_on
    ) row_
    WHERE rownum <= ?
)
WHERE rownum_ > ?

The advantage of using setFirstResult and setMaxResults is that Hibernate can generate the database-specific pagination syntax for any supported relational databases.

And, you are not limited to JPQL queries only. You can use the setFirstResult and setMaxResults method seven for native SQL queries.

Native SQL queries

You don't have to hardcode the database-specific pagination when using native SQL queries. Hibernate can add that to your queries.

So, if you're executing this SQL query on PostgreSQL:

List<Tuple> posts = entityManager.createNativeQuery(
    SELECT
       p.id AS id,
       p.title AS title
    from post p
    ORDER BY p.created_on
    """, Tuple.class)
.setFirstResult(10)
.setMaxResults(10)
.getResultList();

Hibernate will transform it as follows:

SELECT p.id AS id,
       p.title AS title
FROM post p
ORDER BY p.created_on
LIMIT ?
OFFSET ?

Cool, right?

Beyond SQL-based pagination

Pagination is good when you can index the filtering and sorting criteria. If your pagination requirements imply dynamic filtering, it's a much better approach to use an inverted-index solution, like ElasticSearch.

Slipover answered 25/2, 2020 at 7:35 Comment(1)
Using OpenJPA, I cannot make this work for native queries in DB2. setMaxResults and setFirstResult are ignored, only the native query I'm passing is sentGesticulation
O
7

You can easily use pagination for this.

    @QueryHints({ @QueryHint(name = "org.hibernate.cacheable", value = "true") })
    @Query("select * from a_table order by a_table_column desc")
    List<String> getStringValue(Pageable pageable);

you have to pass new PageRequest(0, 1)to fetch records and from the list fetch the first record.

Ohm answered 3/7, 2019 at 10:39 Comment(2)
According to the question "I don't want to use setMaxResults if possible" you give the better solution, just putting Pageable as a parameter in the method and calling it sending "new PageRequest(0, 20)" I'm getting the first 20 records. Thanks.Electromechanical
Just note that the original question was about Hibernate but this answer mentions the Pageable class from (probably) Spring Data. It internally maps again to setFirstResult and setMaxResults.Phosphate
R
5

If you don't want to use setMaxResults, you can also use Query.scroll instead of list, and fetch the rows you desire. Useful for paging for instance.

Riggs answered 8/12, 2009 at 18:10 Comment(7)
Thanks, the accepted answer did not solve the issue for me, because setMaxResults() loads first every record in memory and then creates a sublist, which when there are hundred thousands or more records crashes the server, because it is out of memory. I could however go from a JPA typed query to a Hibernate query through QueryImpl hibernateQuery = query.unwrap(QueryImpl.class) and then I could use the scroll() method as you suggested.Eisenstein
At least with Oracle dialect this is not true (Hibernate uses the ROWNUM virtual column). Maybe it depends on the driver. Other DBs have the TOP function.Riggs
My query is using a join fetch. This results in the Hibernate warning "firstResult/maxResults specified with collection fetch; applying in memory". So with a join fetch, Hibernate is loading the full collection in memory. Dropping the join is no option because of performance reasons. When I use ScrollableResults, I have more control about which records are loaded in memory. I cannot load all records with a single ScrollableResults, because this also results in out of memory. I am experimenting loading multiple pages with different ScrollableResults. If this does not work, I will go with SQL.Eisenstein
That's weird, I've never encountered that. Yes sometimes using straight JDBC is the way to go, specially for massive/batch processes.Riggs
The @OneToMany relations are causing my issues. If somehow I could execute the Oracle aggregate function LISTAGG in Hibernate to concatenate the multiple values to a single value, then I can drop the joins and replace them by a subquery.Eisenstein
I added some new fields to my entity that I annotated with @Formula. With the formula I call the Oracle LISTAGG function. Therefore, I do not need to join fetch the @OneToMany relations anymore. Without the join fetches, I can page my JPA query with setMaxResults().Eisenstein
If your app is Oracle only then fine.Riggs
C
3

You need to write a native query, refer this.

@Query(value =
    "SELECT * FROM user_metric UM WHERE UM.user_id = :userId AND UM.metric_id = :metricId LIMIT :limit", nativeQuery = true)
List<UserMetricValue> findTopNByUserIdAndMetricId(
    @Param("userId") String userId, @Param("metricId") Long metricId,
    @Param("limit") int limit);
Corliss answered 27/4, 2018 at 5:57 Comment(2)
Thanks for adding an interface-only solutionDainedainty
Do you understand what is HQL? the person asked about a solution using HQL, this is SQL anyone know how to do thisModestia
Z
1

String hql = "select userName from AccountInfo order by points desc 5";

This worked for me without using setmaxResults();

Just provide the max value in the last (in this case 5) without using the keyword limit. :P

Zaria answered 12/1, 2011 at 6:46 Comment(4)
Hm... not too sure about this, [citation needed] this may be an accident and could suddenly stop working in a new version of hibernate.Muggy
Please refer to official document.Pretence
This isn't working for me in Hibernate Version 5.2.12 FinalCompartment
It's Not working, Doesn't support hibernate 4.x also.Eliaseliason
G
1

Starting with Hibernate 6.0, HQL directly supports both [OFFSET x] LIMIT y and [OFFSET x ROWS] FETCH FIRST/NEXT y ROWS ONLY/WITH TIES, so you can e.g. do:

select e from SomeEntity e
offset 10 rows fetch next 20 rows only

JakartaEE has an open issue to also add it to the JPQL specification, but currently no-one is championing it.

Grace answered 1/2 at 13:15 Comment(0)
A
0

My observation is that even you have limit in the HQL (hibernate 3.x), it will be either causing parsing error or just ignored. (if you have order by + desc/asc before limit, it will be ignored, if you don't have desc/asc before limit, it will cause parsing error)

Anorthosite answered 27/7, 2010 at 6:11 Comment(0)
M
0

If can manage a limit in this mode

public List<ExampleModel> listExampleModel() {
    return listExampleModel(null, null);
}

public List<ExampleModel> listExampleModel(Integer first, Integer count) {
    Query tmp = getSession().createQuery("from ExampleModel");

    if (first != null)
        tmp.setFirstResult(first);
    if (count != null)
        tmp.setMaxResults(count);

    return (List<ExampleModel>)tmp.list();
}

This is a really simple code to handle a limit or a list.

Majestic answered 28/10, 2011 at 7:1 Comment(0)
D
0
Criteria criteria=curdSession.createCriteria(DTOCLASS.class).addOrder(Order.desc("feild_name"));
                criteria.setMaxResults(3);
                List<DTOCLASS> users = (List<DTOCLASS>) criteria.list();
for (DTOCLASS user : users) {
                System.out.println(user.getStart());
            }
Dodeca answered 16/7, 2016 at 10:36 Comment(0)
U
0

You can use below query

NativeQuery<Object[]> query = session.createNativeQuery("select * from employee limit ?");
query.setparameter(1,1);
Usherette answered 28/2, 2020 at 9:54 Comment(0)
T
0

Below snippet is used to perform limit query using HQL.

Query query = session.createQuery("....");
query.setFirstResult(startPosition);
query.setMaxResults(maxRows);

You can get demo application at this link.

Thracophrygian answered 17/3, 2020 at 8:47 Comment(0)
E
-4
@Query(nativeQuery = true,
       value = "select from otp u where u.email =:email order by u.dateTime desc limit 1")
public List<otp> findOtp(@Param("email") String email);
Earleenearlene answered 15/3, 2019 at 7:10 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.