• Stars
    star
    106
  • Rank 325,871 (Top 7 %)
  • Language
    Go
  • License
    Apache License 2.0
  • Created about 4 years ago
  • Updated about 3 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

๐Ÿž Steganography-based image integrity - Merkle tree nodes embedded into image chunks so that each chunk's integrity can be verified on its own.

Verified image with marked manipulated parts

image-stego

standard-readme compliant Go Report Card

Steganography-based image integrity - Merkle tree nodes embedded into image chunks so that each chunk's integrity can be verified on its own. Jump to the results.

Table of Contents

Background

Tamper-proof timestamping of digital content (like images) is based on generating a cryptographic hash of the file and persisting it in a blockchain (e.g., transferring money to a bitcoin address derived from that hash). The corresponding block of that transaction contains a timestamp that is practically impossible to alter. At a later point in time, a third party can prove the existence by hashing the data, deriving the bitcoin address, and verify the presence of that address in the blockchain without additional information. If the address is found, the third party can be sure that the data has not been manipulated after the block's corresponding timestamp.

Especially if the digital content is an image, there is the disadvantage of just needing to change one pixel (actually only one bit), and the resulting hash will be completely different. However, the original image will be perceptually identical. In most other use-cases (I'm aware of), this is a huge advantage though.

Manipulation Detection

Overview

While the following approach won't completely solve the problem mentioned above, it may be a step forward and may cause others' thoughts.

What is the approach about in one sentence:

The method uses steganography to embed Merkle tree nodes into chunks of an image so that each chunk's integrity can be verified on its own.

In this context, steganography means using the least significant bits (LSB) of the image to encode information. There are other techniques, but this was the most straight forward for me to implement.

By having individual chunks, one can still prove the integrity of parts of the image while seeing which areas have been tampered with.

Method

As a first step, the image is divided into a set of chunks. These cannot be arbitrarily small though, because the smaller they are, the more data needs to be stored in each one but the less storage space each has. There's an optimum of in how many chunks the image should and can be divided into.

After the chunk count has been calculated, the first seven most significant bits of each chunk are hashed. This will result in a set of hashes that are now considered as Merkle tree leaves. Theses leaves are combined to derive the Merkle root hash. This hash can now be embedded into a blockchain.

Each chunk gets now the missing Merkle tree information encoded into its least significant bits so that it holds all information necessary to reconstruct the Merkle tree root hash.

Example

Let's consider a squared image that is divided into four equal chunks. The algorithm examines each chunk separately by looping through all pixels and calculating the hash of the seven most significant bits of the 8-Bit RGB (and A) values of each pixel in the chunk. This will give the hash values , , and . In the picture below, the considered bits are printed faintly in the top right corner.

Illustration of the idea

Those chunk hashes are now taken as Merkle tree leaves and used to construct the Merkle tree root hash like in the picture above in the bottom right.

The hash should be the one to be persisted in a blockchain to be able to prove the existence.

For each chunk to be independently verifiable, those Merkle nodes are taken that are necessary to reconstruct the Merkle root and embedded in the least significant bits of the chunk (denoted in yellow above). The yellow bar at the bottom illustrates the set of least significant bits and data saved in them.

E.g. for hash the hashes and are necessary to recalculate the Merkle tree root hash . The hash doesn't need to be saved in the LSBs because it can and should be derived from the seven most significant bits of the image data itself.

Now the image is prepared so that each chunk holds enough information to verify its integrity independently. If an adversary were to manipulate parts of the image, the corresponding chunks would become invalidated (e.g., the root hashes wouldn't equal the others), and those chunks can be identified. Other chunks can still be proven to not having been manipulated, which wouldn't have been the case if just the whole image was hashed.

Results

Original Image

(w: 1038px, h: 435px)

Original image

Encoded Image

Perceptually identical

Encoded image

Chunking

Encoded image with chunk overlay

Manipulated Image

Can you spot the manipulation?

Manipulated image

Detection

Decoded image

Verified image with marked manipulated parts

Usage

First you need to build the binary:

go build -o stego cmd/stego/main.go

and then run ./stego to get the following usage description:

Usage of ./stego:
  -d	Whether to decode the given image file(s)
  -e	Whether to encode the given image file(s)
  -o string
    	Output directory of an encoded image

Reproduction

Encoding

To reproduce the results build the tool as described above. Then take the example image and encode it by running:

./stego -e -o="out" data/car.jpg

Now you'll find the encoded image in the ./out/ folder along with an image that shows the chunks.

Decoding

Run the following command to verify that the image has not been tampered with:

./stego -d out/car.png

You should see the following output:

2020/09/16 19:05:44 ...
2020/09/16 19:05:44 This image has not been tampered with. All chunks have the same Merkle Root: 278cba1daf96d84165f8aa69d184e63df5c79f3a4c31cc6864e148c0317c713d

Manipulate the image and run the above command again (don't save the image as JPEG as the data in the LSBs wouldn't survive the compression):

./stego -d out/car.png

You should see the following output:

...
2020/09/16 19:10:30 Found multiple Merkle Roots. This image has been tampered with! RootHashes:
2020/09/16 19:10:30 Count       Root
2020/09/16 19:10:30     1       1323d18f3aab27b4414535825b9b755c61b19fbd2ce7f2a39688e95e5f32fe15
...
2020/09/16 08:10:30   413       278cba1daf96d84165f8aa69d184e63df5c79f3a4c31cc6864e148c0317c713d
...
2020/09/16 08:10:30 Drawing overlay image of altered regions...
2020/09/16 08:10:30 Saving overlay image: out/car.overlay.png

Limitations

There are several limitations that come to my mind I just want to list here:

  • Only lossless image file formats are supported as the least significant bits wouldn't survive a jpeg compression. There are steganography approaches that address precisely this problem, though.
  • The original image is altered.
  • It's actually unnecessary to embed the Merkle tree information in the image itself but to save it separately (maybe header information or a separate file). However, having all verification information in one place has its advantages too.
  • Cropping is not supported yet because there needs to be a mechanism to find the chunk dimensions independently of the image size.
  • The Chunk struct implements the Gos Writer interface to encode data in the LSBs. This means only whole bytes can be written, which leads to wasted space for meta-information like 1. How many hashes are encoded in this chunk, 2. which side should this hash be appended/prepended to calculate the root hash? Especially the latter information is a simple boolean flag which wastes a whole byte.
  • If an adversary knew about the encoding it is easy to invalidate it for the whole image

Second example

You can find the second example here.

Other Projects

You may be interested in one of my other projects:

Timestamps

Commits:

More Repositories

1

pcp

๐Ÿ“ฆ Command line peer-to-peer data transfer tool based on libp2p.
Go
1,036
star
2

nebula

๐ŸŒŒ A network agnostic DHT crawler, monitor, and measurement tool that exposes timely information about DHT networks.
Go
296
star
3

alfred-dict.cc-workflow

๐ŸŒ Alfred 4/5 workflow to get translations from dict.cc
Go
137
star
4

shamir

๐Ÿ”‘ A CLI frontend for Hashicorp Vault's Shamir's Secret Sharing implementation.
Go
20
star
5

optimistic-provide

A DHT measurement tool and proposal for an optimistic way to store provider records.
Jupyter Notebook
9
star
6

antares

๐Ÿ”ฌ A gateway and pinning service probing tool
Go
6
star
7

iaeste-lc-kiel-website

Website of IAESTE LC Kiel.
HTML
5
star
8

groundhog

Groundhog is a telegram bot to track your habits and save it to Google sheets
Python
4
star
9

lassunsreden.ch

The business website for "Systemische Beratung | Marie Lass"
SCSS
4
star
10

nebula-crawler-reports

4
star
11

originstamp-cli

Go client for the OriginStamp API
Go
3
star
12

lenden-flutter

A birthday present ๐ŸŽ for my friend Lenny ๐ŸŽ‰
Dart
2
star
13

parsec

Jupyter Notebook
2
star
14

alfred-cid-decoder

An Alfred workflow to decode multiformats Content Identifiers.
Go
2
star
15

cau-kiel-latex-beamer-template

๐Ÿ“ˆ A latex beamer template for CAU Kiel students
TeX
2
star
16

probelab-website

1
star
17

dennis-tra

1
star
18

voi-client-go

An unofficial go client for the VOI Scooter REST API
Go
1
star
19

write-on-stream-error

Go
1
star
20

web3-storage-client

Go
1
star
21

go-multicodec

Periodically self-generated Go constants of multicodecs used by the multiformats projects.
Go
1
star
22

peem-controller

Micro-Manager 2.0 plugins to control and monitor a PEEM in conjunction with an image acquisition system and an interferometric delay stage ๐Ÿ”ฌ
Java
1
star
23

go-kinesis

Go
1
star