xor
is a dangerous default function to use when hashing. It is better than and
and or
, but that doesn't say much.
xor
is symmetric, so the order of the elements is lost. So "bad"
will hash combine the same as "dab"
.
xor
maps pairwise identical values to zero, and you should avoid mapping "common" values to zero:
So (a,a)
gets mapped to 0, and (b,b)
also gets mapped to 0. As such pairs are almost always more common than randomness might imply, you end up with far to many collisions at zero than you should.
With these two problems, xor
ends up being a hash combiner that looks half decent on the surface, but not after further inspection.
On modern hardware, adding usually about as fast as xor
(it probably uses more power to pull this off, admittedly). Adding's truth table is similar to xor
on the bit in question, but it also sends a bit to the next bit over when both values are 1. This means it erases less information.
So hash(a) + hash(b)
is better than hash(a) xor hash(b)
in that if a==b
, the result is hash(a)<<1
instead of 0.
This remains symmetric; so the "bad"
and "dab"
getting the same result remains a problem. We can break this symmetry for a modest cost:
hash(a)<<1 + hash(a) + hash(b)
aka hash(a)*3 + hash(b)
. (calculating hash(a)
once and storing is advised if you use the shift solution). Any odd constant instead of 3
will bijectively map a "k
-bit" unsigned integer to itself, as map on unsigned integers is math modulo 2^k
for some k
, and any odd constant is relatively prime to 2^k
.
For an even fancier version, we can examine boost::hash_combine
, which is effectively:
size_t hash_combine( size_t lhs, size_t rhs ) {
lhs ^= rhs + 0x9e3779b9 + (lhs << 6) + (lhs >> 2);
return lhs;
}
here we add together some shifted versions of lhs
with a constant (which is basically random 0
s and 1
s – in particular it is the inverse of the golden ratio as a 32 bit fixed point fraction) with some addition and an xor. This breaks symmetry, and introduces some "noise" if the incoming hashed values are poor (ie, imagine every component hashes to 0 – the above handles it well, generating a smear of 1
and 0
s after each combine. My naive 3*hash(a)+hash(b)
simply outputs a 0
in that case).
Extending this to 64 bits (using the expansion of pi as our constant for 64 bits, as it is odd at 64 bits):
size_t hash_combine( size_t lhs, size_t rhs ) {
if constexpr (sizeof(size_t) >= 8) {
lhs ^= rhs + 0x517cc1b727220a95 + (lhs << 6) + (lhs >> 2);
} else {
lhs ^= rhs + 0x9e3779b9 + (lhs << 6) + (lhs >> 2);
}
return lhs;
}
(For those not familiar with C/C++, a size_t
is an unsigned integer value which is big enough to describe the size of any object in memory. On a 64 bit system, it is usually a 64 bit unsigned integer. On a 32 bit system, a 32 bit unsigned integer.)
H(concat(H(1), H(2)))
– Politics