gitwtfhub

wtf is peak-end-net?

amap-ml/peak-end-net — explained in plain English

Analysis updated 2026-05-18

26PythonAudience · researcherComplexity · 4/5LicenseSetup · hard

TL;DR

A research model that scores how visually pleasing a video looks, inspired by the psychology idea that people judge experiences mainly by their peak moment and ending.

Mindmap

mindmap
  root((Peak-End-Net))
    What it does
      Video aesthetic scoring
      Peak end weighting
      Attribute sub scores
    Tech stack
      PyTorch
      CLIP
      CUDA
    Use cases
      Aesthetic inference
      Research benchmarking
      Custom training
    Audience
      Researchers
      ML engineers

Code map

Detail Auto

An interactive map of this repo's files and how they connect — its source is parsed live in your browser. Click Visualize to build it.

filefunction / class

Why would anyone build with this?

REASON 1

Score a video's overall aesthetic quality using a pretrained checkpoint

REASON 2

Get detailed sub scores like lighting, color, and composition for a video

REASON 3

Train a custom video aesthetic model on your own labeled dataset

REASON 4

Research video quality assessment using an attention based temporal model

What's in the stack?

PythonPyTorchCLIPCUDA

How it stacks up

amap-ml/peak-end-net95ge/cfquantaevella/sky-pc-mcp-companion
Stars262626
LanguagePythonPythonPython
Setup difficultyhardmoderatemoderate
Complexity4/53/53/5
Audienceresearcherdevelopervibe coder

Figures from each repo's GitHub metadata at analysis time.

How do you spin it up?

Difficulty · hard Time to first run · 1h+

Training needs a CUDA capable GPU and multi GPU setup for full scale runs, inference alone is easier.

MIT license lets you use, copy, modify, and sell the code freely as long as you keep the original copyright notice.

Wtf does this do

Peak End Net is a research project that teaches a computer model to judge how visually pleasing a video looks, in a way that tries to match how people actually judge things. Instead of averaging every single frame equally, the model is built around a psychology idea called the peak end rule: people tend to remember and judge an experience mostly by its most striking moment and by how it ends, not by everything in between. This paper was accepted at the ACM Multimedia 2026 conference. The model looks at each frame using a pretrained image understanding model, then combines the frame scores across the whole video, giving extra weight to the most attention grabbing moments and to the final part of the video. A separate module then blends this video level judgment with a simpler frame averaged score to produce the final result. The output includes one overall aesthetic score plus ten more detailed scores covering things like lighting, color, composition, and framing. To use the project, a person needs Python along with a matching version of PyTorch for their graphics card, and ideally a capable GPU, although running on a regular processor is possible though slower. A ready to use trained model can be downloaded and used directly to score a video without training anything yourself. Training your own version from scratch is a three step process: first training a base aesthetic judging model on a public image dataset, then training the main video model, and finally training a small module that blends the two scoring methods together. This project builds on existing published research code and is released under the MIT license, so it can be reused and modified freely, including for commercial purposes.

Yoink these prompts

Prompt 1
Show me how to run inference.py to score a video's aesthetic quality with the pretrained checkpoint.
Prompt 2
Explain how the peak end rule inspires this model's attention over video frames.
Prompt 3
Walk me through preparing my own CSV and video path JSON files for training.
Prompt 4
Help me set up the three stage training process for Peak-End-Net on my own data.

Frequently asked questions

wtf is peak-end-net?

A research model that scores how visually pleasing a video looks, inspired by the psychology idea that people judge experiences mainly by their peak moment and ending.

What language is peak-end-net written in?

Mainly Python. The stack also includes Python, PyTorch, CLIP.

What license does peak-end-net use?

MIT license lets you use, copy, modify, and sell the code freely as long as you keep the original copyright notice.

How hard is peak-end-net to set up?

Setup difficulty is rated hard, with roughly 1h+ to a first successful run.

Who is peak-end-net for?

Mainly researcher.

View the repo → Decode another repo

This repo across BitVibe Labs

Don't trust strangers blindly. Verify against the repo.