Our sports video analysis and adaptation system is based on four modules which analyze a video and one additional module for video retargeting (see the following figure). In a first step, the system distinguishes playing frames from other frames. Additional modules detect court lines, players, objects, and the ball. For each frame, the components are run one after another. Only if a frame is processed successfully in the current step, it is forwarded to the next module. So, for example, if the court field is not detected in a frame, algorithms to locate court lines or players are skipped. Previously computed data is re-used wherever possible.

The adaptation of a frame depends on the results of the analysis. A frame is scaled if no semantic information could be derived. Otherwise, the advanced video retargeting module uses all available information to adapt a frame.

The following figure shows exemplary intermediate results of the processing steps. From left to right: court model, background image, difference image, player and object segmentation.