STRUCTURE
OF
SCAN-SCAN

Introduction

This work is a video installation/application using a video technique called slit-scan.

Various slit-scan works  have been created by many video creators and programmers. Therefore, this technique seems like tasteless chewing gum.
However, I aimed to create a new slit-scan work with the approach of visualizing the slit-scan structure.

first prototype

Ueda city art museum "Magic Museum Exhibition 2022"
When the visitor stands in front of the camera, various changes are projected on the screen, as if time and space have been distorted. Through this experience, visitors can get a bird's eye view of the structure of Slit-scan and how interesting it is.

Visualize slit-scan structure

Slit-scan can be regarded as a kind of image sculpture, in which multiple consecutive image frames are arranged in (x,y,t) 3D space, and the rectangular shape created by the image frames is cut and its cross section is viewed from which viewpoint. In the article by Baku Hashimoto, this is explained with the analogy of Kintaro candy (金太郎飴), and in Teis Draiby's video,these principles are introduced rather directly.

Since I am a front-end engineer and visualizing data and structures is a common practice, I thought of visualizing this Kintaro candy. With a combination of "cross-section," "viewpoint," and "input video." The combination of "cross-section," "viewpoint," and "input image," and their temporal changes, allowed us to get a bird's-eye view of most of the effects produced by the "slit-scan" technique. This work is intended to let the viewer experience the fascination of slit-scan and video.

Kintaro candy (金太郎飴)

金太郎飴の同じ断面の視点による違い
slit-scan業界では、左右の映像の効果はよく目にする。これは実は直方体の断面で説明できる。 その関係性をひとつの動画で視覚化している。

Implementation with 3D textures

This work was created in Unity, and I used 3D textures as a reference for implementing slit-scan in TouchDesigner. 3D textures are originally used for volumetric rendering, but if the z-axis is regarded as time t, they can be considered like the video data itself. If the z-axis is regarded as time t, it can be viewed as if it were the video data itself.

Non-sectional approach

So far I have written that Slit-scan can be explained by the variable of Kintaro cross section and the viewpoint from which it is taken, but it is possible that some things are not so. For example, Francois Vogel's video works. I am not sure about the mathematics, but rather than a cross-section, it might be better to think of the function that maps (x,y,t) to (x',y') as (x',y') to (x',y') rather than a cross-section.

STRUCTURE OF SLITSCANの製作を通し、 単なる断面ではない非・金太郎飴的なアプローチも slit-scanの新たな形として有効だろうと思い、スマホアプリをつくりました。

Response and future goals

I published the video on twitter  and received many responses, and I received a comment from Goran Levin, the author of "Code as creative medium", who shared with me his vast collection of slit-scan research.  So, following his lead, I have started collecting them myself, and will continue to explore new approaches using slit-scan.

Design & Development

Kitasenju Design
nabe@kitasenjudesign.com