UUHash

UUHash is a hash algorithm employed by clients on the FastTrack network. It is employed for its ability to hash very large files in a very short period of time, even on older computers. However, this is achieved by only hashing a fraction of the file. This weakness makes it trivial to create a hash collision, allowing large sections to be completely altered without altering the checksum.

This method is used by Kazaa. The weakness of UUHash is exploited by anti-p2p agencies to corrupt downloads.[1]

How it works

The UUHash is a 160-bit string that is usually Base64-encoded for presentation. It is a concatenation of an MD5 hash and a CRC32 sum of selected chunks of the file.[2][3]

The first 307,200 bytes (300 Kibibyte, one "chunk size") of the file are MD5-hashed (less if file is shorter). The 32 bit little endian integer value smallhash is initialized to 0.

If the file is strictly larger than one chunk size, a series of chunks at file offsets of 2n MiB (n ≥ 0) and one chunk right at the end of the file are hashed using a CRC32 (polynomial 0xEDB88320 reversed, 0x04C11DB7 normal). The last chunk of the power-of-two series ends strictly more than one chunk size before the end of the file, i.e. there is always at least one unread byte between the last two chunks (if there are that many chunks).[footnote 1] The end-of-file chunk may be shorter than one chunk size; it starts at or after one chunk size into the file. The CRC is initialized using smallhash and stored into smallhash.

So, for example:

offset 0 MiB, 300 KiB hashed with MD5
offset 1 MiB, 300 KiB hashed with CRC32
offset 2 MiB, 300 KiB hashed...
offset 4 MiB, 300 KiB hashed...
offset 8 MiB, 300 KiB hashed...
...
last 300 KiB of file hashed with CRC32

Finally, the bitwise complement of smallhash (still zero for files up to 300 KiB) is XORed together with the file size in bytes. The 160-bit UUHash is now the concatenation of the 128-bit MD5 hash and the final 32-bit smallhash value.

Test Vectors

Given are hashes (base64 and hex) for strings of various lengths containing only 0x00 or 0xFF bytes:

Length 0x00 0xFF
Base64 Hexadecimal Base64 Hexadecimal
01B2M2Y8AsgTpgAmY7PhCfv////8=D41D8CD98F00B204E9800998ECF8427E-FFFFFFFF1B2M2Y8AsgTpgAmY7PhCfv////8=D41D8CD98F00B204E9800998ECF8427E-FFFFFFFF
1k7iFrf4NoInN9jSQT9Wfcf7///8=93B885ADFE0DA089CDF634904FD59F71-FEFFFFFFAFlP1PQrpD/BygQnoFdilf7///8=00594FD4F42BA43FC1CA0427A0576295-FEFFFFFF
2xBA/Ei0nZ3ydsUTK4TlKZv3///8=C4103F122D27677C9DB144CAE1394A66-FDFFFFFFqyoNKN5rd//dbHKv6tCZq/3///8=AB2A0D28DE6B77FFDD6C72AFEAD099AB-FDFFFFFF
307199 (300 KiB - 1)YK6+Fj6S4MGzEC9H9Bn3gQBQ+/8=60AEBE163E92E0C1B3102F47F419F781-0050FBFFI+QujFtxa9pBOt5X6NMGsgBQ+/8=23E42E8C5B716BDA413ADE57E8D306B2-0050FBFF
307200 (300 KiB)kK7e2ZIs+JRup4WGNUk3JP9P+/8=90AEDED9922CF8946EA7858635493724-FF4FFBFFoBSYynx6vdDeUWtP5N4mAv9P+/8=A01498CA7C7ABDD0DE516B4FE4DE2602-FF4FFBFF
307201 (300 KiB + 1)kK7e2ZIs+JRup4WGNUk3JHOg+S0=90AEDED9922CF8946EA7858635493724-73A0F92DoBSYynx6vdDeUWtP5N4mAv5P+wA=A01498CA7C7ABDD0DE516B4FE4DE2602-FE4FFB00
614399 (600 KiB - 1)kK7e2ZIs+JRup4WGNUk3JHCHqBQ=90AEDED9922CF8946EA7858635493724-7087A814oBSYynx6vdDeUWtP5N4mAqgX6Xs=A01498CA7C7ABDD0DE516B4FE4DE2602-A817E97B
614400 (600 KiB)kK7e2ZIs+JRup4WGNUk3JGlfGn0=90AEDED9922CF8946EA7858635493724-695F1A7DoBSYynx6vdDeUWtP5N4mApKrf9g=A01498CA7C7ABDD0DE516B4FE4DE2602-92AB7FD8
614401 (600 KiB + 1)kK7e2ZIs+JRup4WGNUk3JGhfGn0=90AEDED9922CF8946EA7858635493724-685F1A7DoBSYynx6vdDeUWtP5N4mApOrf9g=A01498CA7C7ABDD0DE516B4FE4DE2602-93AB7FD8
614402 (600 KiB + 2)kK7e2ZIs+JRup4WGNUk3JGtfGn0=90AEDED9922CF8946EA7858635493724-6B5F1A7DoBSYynx6vdDeUWtP5N4mApCrf9g=A01498CA7C7ABDD0DE516B4FE4DE2602-90AB7FD8
16777216 (16 MiB)kK7e2ZIs+JRup4WGNUk3JN/b8qg=90AEDED9922CF8946EA7858635493724-DFDBF2A8oBSYynx6vdDeUWtP5N4mAt0YF2Y=A01498CA7C7ABDD0DE516B4FE4DE2602-DD181766
17084416 (16 MiB + 300 KiB)kK7e2ZIs+JRup4WGNUk3JN9r9qg=90AEDED9922CF8946EA7858635493724-DF6BF6A8oBSYynx6vdDeUWtP5N4mAt2oE2Y=A01498CA7C7ABDD0DE516B4FE4DE2602-DDA81366
17084417 (16 MiB + 300 KiB + 1)kK7e2ZIs+JRup4WGNUk3JN5r9qg=90AEDED9922CF8946EA7858635493724-DE6BF6A8oBSYynx6vdDeUWtP5N4mAtyoE2Y=A01498CA7C7ABDD0DE516B4FE4DE2602-DCA81366
17391616 (16 MiB + 600 KiB)kK7e2ZIs+JRup4WGNUk3JN+7+6g=90AEDED9922CF8946EA7858635493724-DFBBFBA8oBSYynx6vdDeUWtP5N4mAt14HmY=A01498CA7C7ABDD0DE516B4FE4DE2602-DD781E66
17391617 (16 MiB + 600 KiB + 1)kK7e2ZIs+JRup4WGNUk3JNzVMqw=90AEDED9922CF8946EA7858635493724-DCD532ACoBSYynx6vdDeUWtP5N4mAgS1uWk=A01498CA7C7ABDD0DE516B4FE4DE2602-04B5B969
17391618 (16 MiB + 600 KiB + 2)kK7e2ZIs+JRup4WGNUk3JN/VMqw=90AEDED9922CF8946EA7858635493724-DFD532ACoBSYynx6vdDeUWtP5N4mAge1uWk=A01498CA7C7ABDD0DE516B4FE4DE2602-07B5B969

Notice that all strings that have a complete MD5 chunk have the same 128-bit prefix. For files that have the same number of chunks the CRC part differs only because of the included file length (all chunks are identical, or this weren't the case). For files up to 300 KiB, the file length can be extracted from the last four bytes of the hash; smallhash is ~0.

Sig2Dat

The name UUHash derives from the sig2dat utility which creates URIs referencing files on Kazaa. These URIs are of the form:

sig2dat://|File: surprise.mp3|Length:5845871Bytes|UUHash:=1LDYkHDl65OprVz37xN1VSo9b00=

Not considering the fact that this URI format is not RFC compliant, UUHash refers to the Base64-encoding of the hash and not the hash itself.

Notes
  1. BitCollider/0.4.0 implemented this unfaithfully
  1. Thomas Mennecke. How Overpeer was able to corrupt data on the FastTrack network. 2005.
  2. MLDonkey source code, file src/utils/lib/fst_hash.c, retrieved 2014-08-20
  3. sig2dat source code, file sig2dat.c, function GetHashWin32, retrieved 2014-08-20
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.