xray

KO | EN

gitlite — search

#javascript #hacktoberfest #ai #machine-learning #deep-learning #docker #macos #windows #awesome #kubernetes #awesome-list #vue #pytorch #mcp

(★ 17)

xray compares media files by their perceptual hash and identifies dupes

xray Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

xray
====

xray compares media files by their perceptual hash and identifies dupes.

This means files are not compared byte-for-byte, but by their visual content.
It will (or at least it should) find duplicates of videos, even when they are
encoded in different formats, bitrates and/or resolutions.

## What it does
xray scans a given directory. Each video file it finds gets analyzed by taking
several snapshots of the video content. Those images are then p-hashed and
compared with all other videos it found. If xray considers two videos similar
enough it will output that it found a dupe and additionally shows you a
similarity score.

In case xray thinks it found a perfect match, it will also calculate the sha1sum
of both videos to safely identify exact copies of a file.

## Dependencies
xray depends on QtCore (Qt >= 5.2), ffmpeg and phash. You should be able to find
existing packages for your system. On Ubuntu install "libphash0-dev", on Arch
install "phash" from AUR, on OS X "brew install phash".

## Build it
    qmake xray.pro
    make

## Try it out
    ./xray /media/videos

## Plans
So far this is just a working proof-of-concept. Plans to enhance & improve xray:
- CLI params for consts, like thresholds, hamming distance etc.
- Center-crop and re-scale frames to eliminate issues with borders and aspect ratios.
- Combine individual frame hashes into one big file hash.
- Compare video frames and when finding a reasonably close one, do a close inspection comparing more of the surrounding frames of both files.
- Store hashes in a file (sqlite/unqlite/textfile) to speed up future comparisons.
- Offer to automatically quarantine dupe files.
- Provide an interactive mode.
- Drop external snapshot process. Directly use libvlc or ffmpeg or such.

Enjoy!

xray

xray Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

xray

xray Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README