By Jon Berryhill If you’
A hash value is a common feature used in forensic analysis as well as the cryptographic world. The best definition I’ve seen is that a hash is a function that can be used to map data of an arbitrary size onto data of a fixed size. The word “function” is used in its truest form from mathematics. The hash value is the result of the function. Standard hash algorithms are sets of complex but public mathematical steps. There is nothing secret about them.
Some people equate a hash value to a fingerprint. It provides a way of identifying and verifying a chunk of digital data. You can have a hash value for a single file, groups of files, or even an entire hard drive. A hash value is a harmless looking string of hexadecimal values, generally 32 to 64 characters long, depending on the hash algorithm used. There is absolutely nothing in a hash value that will tell you anything about what was hashed or how big it was. The way the algorithms work, the length of the hash value is always the same no matter the quantity of the data processed.
So what do they look like?
f5fbace98ed8829dc705191f18321d18 C:\TEMP\file-110738171218L001.pdf
935a569281046198ec9256da83b5fcd4 C:\TEMP\file-110739171218L001.pdf
d852a07c1a3065d42be9b119fd92091e C:\TEMP\file-110751171218L002.pdf
eac04333af784bc2094d55bd0b233173 C:\TEMP\file-110766171218L001.pdf
76f5af6dc1a97facc1f830d7a66cfd35 C:\TEMP\file-144727171111L001 (1).pdf
76f5af6dc1a97facc1f830d7a66cfd35 C:\TEMP\file-144727171111L001 (2).pdf
76f5af6dc1a97facc1f830d7a66cfd35 C:\TEMP\file-144727171111L001.pdf
Above are the computed hashvalues for 7 files. Note that the last 3 files have different names but the hash values match. The content of these 3 files is exactly the same. In this case the hash values were computed with a standard algorithm called MD5 (the “MD” is short for MessageDigest, the “5” is a version number).
The same files can be processed with the SHA256 algorithm and the results look like this.
a23e46b2e341d2b9f9bf291a67c9e207c70d796d70d0c6973cf46b0c2156f5ee C:\temp\file-110738171218L001.pdf
285aea0e4e4605f28c89ea20253456e98c5fb999d3988084b8ad1ed82f36fb2e C:\temp\file-110739171218L001.pdf
62e0c4e16b9ed0d23354a9973783958bb93fd3d93524fa5f49ee88663d086ba2 C:\temp\file-110751171218L002.pdf
4985619b30c4ef8dd100cc76810d50dbed9e2ee568281a843b49f75812730420 C:\temp\file-110766171218L001.pdf
95df48581de075511e44aceb2417a0cc125c593dfbc904fcb9ceaa3fefbd30c5 C:\temp\file-144727171111L001 (1).pdf
95df48581de075511e44aceb2417a0cc125c593dfbc904fcb9ceaa3fefbd30c5 C:\temp\file-144727171111L001 (2).pdf
95df48581de075511e44aceb2417a0cc125c593dfbc904fcb9ceaa3fefbd30c5 C:\temp\file-144727171111L001.pdf
The hash value has nothing to do with the name of a file and different hash algorithms produce different hash values even when processing the same files. Just a hash value by itself is useless without identifying which hash algorithm was used to create it.
Howare hash values used?
In the forensic analysis community, if I provide a copy of a forensic image file set to another examiner, I also provide the hash value associated withit. The other examiner can compute the hash value for what they received and compare that to the provided hash value. If they match,we know that we are both looking at exactly the same thing. If the hash values don’t match,we knowthat something is different. The hash value provides no clues as to what is different.
In the security and cryptographic community, a system does not store your password. It stores a computed hash value of your password. If someone is trying to break into your account,it is exceedingly complex for someone to come up with a password that results in the same hash value as your password. The hash values of passwords don’t really need the same level of protection as the actual passwords. In real terms you simply cannot reverse engineer a password from a given hash value.
All that being said, some hash algorithms are more secure than others. In a lab setting, the MD5 hash has been “cracked.”It is possible,with a modest amount of computing power, to create two files that are different that result in the same MD5 hash value. This is what is called a hash collision. I know of no instance of a hash collision in the “wild.”That’s not to say the MD5 algorithm is useless. You simply have to understand its appropriate uses and limitations.
One of the common uses of hash values in the forensics andlaw enforcement communitiesis in child p*rnography cases. Law enforcement maintains a database of hash values of known child p*rnography. This way they can share the hash values without having to share, transport or otherwise handle actual contraband material. An examiner can use tools to search seized evidence for files that have matching hash values. If there is a match the examiner can further examine the highlighted file. The benefit is that an examiner can automate much of the otherwise very tedious and time-consuming process of reviewing what could be millions of pictures or videos on a computer when searching for contraband. It’s not a perfect solution. It can miss contraband items,but it does save a lot of time and resources. There isn’t a danger of someone being arrested for a false positive because no case is made on just a matching hash value. Someone still has to look at any matches and decide if it is a valid hit or not. It’s just a tool.
Similarly, there are hash value sets of known files that can be used to filter out otherwise known or uninteresting files among groups of millions of files,so an examiner can focus on the unique data.
There are many other uses of hash values in both the forensic and cryptographic communities,but these examples should give you an idea of some of what is going on the next time you hear “hash value” in reference to an item of digital evidence.
