WIBE

WIBE is an extensible open source framework for evaluating imperceptibility and robustness of digital watermarks for generated images. The framework supports watermarking methods both during the image generation process and post-generation. So it is possible to evaluate watermarking techniques and attacks against them on both generated and original images.

The framework architecture consists of a core module and a set of extensions. The core implements Pipeline orchestration functionality. The extensions implement:

• Image watermarking Algorithms: currently 31 supoprted, including Watermark Anything, TrustMark, StegaStamp, Tree-Rings Watermarks

• Attacks on watermarks: both common distortions and 23 advanced attacks supported, including SADRE, DIP-based

• Datasets: DiffusionDB and MS COCO supported

• Metrics: 13 supported, including BER (Bit Error Rate), SSIM (Structural Similarity Index Measure), LPIPS (Learned Perceptual Image Patch Similarity), ImageReward

Contents

• Quick start
  • HuggingFace Authentication Setup
• System requirements
• Pipeline
  • Configuration file
• Algorithms
  • How to implement a new watermarking algorithm
  • Implemented algorithms
• Attacks
  • How to implement a new attack
  • Implemented attacks
• Datasets
  • How to add a new dataset
  • Implemented datasets
• Metrics
  • How to implement a new metrics
  • Implemented metrics