file-deduplicator

The only CLI tool that finds similar images, not just exact duplicates. Clean up your photo library with one command.

$ file-deduplicator -dir ~/Pictures -perceptual -dry-run
🔍 File Deduplicator v3.0.0 - Starting...
🖼️ Perceptual mode enabled (dhash, threshold: 10)
📊 Found 1,247 files
👯 Found 12 duplicate/similar groups
🖼️ Similar Images Found:
======================================================================
[1] Size: 2.4 MB | Files: 3 | Similarity: 85%
✓ KEEP ~/Photos/vacation/sunset.jpg
✗ DELETE ~/Photos/vacation/sunset_edit.jpg
✗ DELETE ~/Downloads/sunset_final.png
[2] Size: 1.8 MB | Files: 2 | Similarity: 92%
✓ KEEP ~/Photos/Cats/fluffy_original.jpg
✗ DELETE ~/Photos/Cats/fluffy_copy(1).jpg
======================================================================
📊 Summary: 14 duplicates/similar files, 28.6 MB can be freed

Features

🖼️

Perceptual Image Detection

Find similar images even when they've been resized, compressed, or lightly edited. Uses the same technology as Google Images and TinEye.

Fast Parallel Processing

SHA256 hashing across all CPU cores. Processes thousands of files per second. Written in Go for maximum performance.

🔒

Safe by Default

Dry-run mode to preview changes. Move instead of delete. Interactive confirmation. Never lose data accidentally.

🎯

Smart Selection

Automatically keep the oldest, newest, largest, or smallest file. Or specify a "sacred" directory to prioritize.

💻

Cross-Platform CLI

Works on macOS, Windows, and Linux. Scriptable and automatable. Integrate into your workflow or cron jobs.

📊

Detailed Reports

Export JSON reports of all duplicates found. Review before deleting. Track what was removed.

Why file-deduplicator?

Tool CLI Cross-Platform Perceptual Price
file-deduplicator Free / $10
dupeGuru Free
Gemini 2 ~ $20
fdupes Free

No other CLI tool offers perceptual image deduplication.

Completely Free & Open Source

Like ripgrep, fd, and bat, file-deduplicator is free and open source. Pre-built binaries available if you prefer convenience.

Pre-Built Binaries

$10
  • ✓ Ready-to-run binaries (no build needed)
  • ✓ All platforms (Linux, macOS, Windows)
  • ✓ One-time purchase
  • ✓ Supports development
Get Binaries

Want to support ongoing development?

☕ Buy Me a Coffee