Using Hive with Pig

Question

My hive query has multiple outer joins and takes very long to execute. I was wondering if it would make sense to break it into multiple smaller queries and use pig to work the transformations.

Is there a way I could query hive tables or read hive table data within a pig script?

Thanks

Clatter

Answer 1

The goal of the Howl project is to allow Pig and Hive to share a single metadata repository. Once Howl is mature, you'll be able to run PigLatin and HiveQL queries over the same tables. For now, you can try to work with the data as it is stored in HDFS.

Note that Howl has been renamed to HCatalog.

Outbuilding

Thanks, will wait for Howl :) – Clatter