HNNewShowAskJobs
Built with Tanstack Start
FFglitch, FFmpeg fork for glitch art(ffglitch.org)
153 points by captain_bender 9 hours ago | 21 comments
  • dylan6044 hours ago

    I love how we try to recreate things that are errors to add realism to something too clean. I've spent many hours in front of tape machines from analog to digital, and each format has its peculiarities when glitching. The analog formats had drop outs and other noise from the analog nature as well as things like head switching. There were also the various methods of drop out compensation like BCSP that would repeat the last good line which could lead to some interesting "smearing". Then there are other things that get imitated like when a monitor would lose sync and you'd see the horizontal/vertical blanking rolling through the screen or lose one of or swap the UV channels. The digital tape formats that had DCT blocks started displaying what this glitch art is inspired by (for lack of better phrasing). So for someone this "inside baseball", it would be a problem when these issues happened so it takes a second to get over the initial "oh no that needs to be fixed" to "that looks cool!"

  • mmcclure8 hours ago

    Not a lot of info on the page about the process, etc, but this is also called "datamoshing." If you're curious, there's a great talk from Demuxed '21 on some of the details: https://www.youtube.com/watch?v=Qtia43DGSrY

  • MitPitt6 hours ago

    Awesome! I remember seeing Datamosh 2 plugin for After Effects, but didn't know it used this open source project. Turns out there is a whole bunch of GUIs for ffglitch: https://ffglitch.org/frontends/

    • jedbrookean hour ago |parent

      there used to be a running joke in the AfterEffects subreddit that 95% of “What’s this effect called?” questions the answer was datamoshing. I think they even had a bot that would auto answer with datamoshing since it was asked so frequently.

  • BoardsOfCanada5 hours ago

    At university we implemented a DCT+quantization encoder/decoder for audio, and had a buggy version produce these super alien, beautiful sounds. I've often wished I had saved that version.

  • tentacleuno9 hours ago

    This page doesn't explain what FFglitch does, or how it's different to ffmpeg. For instance, what's Glitch? I'm guessing it's an architecture, but the post doesn't explain what it is or contextualize the term "architecture."

    • bawolff9 hours ago |parent

      From what i understand "glitch art" is using compression artifacts and encoding errors as art.

      Presumably ffglitch is ffmpeg with code to fudge the file checksums so that encoding errors are allowed to accumulate instead of triggering an error.

      • mamonoleechi36 minutes ago |parent

        >https://en.wikipedia.org/wiki/Glitch

        >Television glitch --> In broadcasting, a corrupted signal may glitch in the form of jagged lines on the screen, misplaced squares, static looking effects, freezing problems, or inverted colors. The glitches may affect the video and/or audio (usually audio dropout) or the transmission. These glitches may be caused by a variety of issues, interference from portable electronics or microwaves, damaged cables at the broadcasting center, or weather.

        On computers, those happens when some of the data (video, audio, image) is corrupted or lost.

        Glitch art: some of those glitches create cool effects that you can see a sort of photoshop filter ; ffglitch helps you corrupt files/create those effect for artistic purpose.

        You can see cool examples of glitch video art there: https://ffglitch.org/gallery/ ; they show the original clip, and then the glitched version

        ---

        You can also have corrupted sounds, you can check 'The Glitch Mob' which is an group creating music, with samples that sounds corrupted.

    • fishgoesblub9 hours ago |parent

      The clearly labeled "What?" button at the top of the page explains everything.

      • hiccuphippo9 hours ago |parent

        The what button doesn't explain much.

        As far as I know, "glitching" is opening a jpeg file with a text editor then deleting random ranges of characters, saving it again and then letting image viewers try to open the file, resulting in artifacts being added to the image.

        This project seems to do the same for video files, but generating a valid video at the end.

        • thenthenthen5 hours ago |parent

          That is “data bending” (borrowed from “circuit bending”; e.g. opening a toy that makes sound and using ‘a moist finger’ probing the pcb for changes in sound). Glitching is the intentional act of introducing errors in hardware or software, to expose the inner workings (in the case of Glitch art, this was the original aim, to expose ‘the ghost in the machine’). Rosa Menkman wrote extensively about Glitch Art here: https://beyondresolution.info/Glitch-Studies-Manifesto

        • shit_game5 hours ago |parent

          The best way I've come to describe glitch art in my papers or talks with peers is that a "glitch" in the context of glitch art is the deliberate abuse of a format of media, taking advantage of either noise, compression schemes, or undefined behavior to produce media that would otherwise not exist (due to contraints of, say, a compression algorithm and a binary format like JPEG), or to reproduce media that is discarded by these (and other) mechanisms of the format (The Ghost in the MP3[0] is a fantastic, and arguably the pioneering work in this regard).

          Formats such as circuitbending are alien to me, as I primarily work with digital and occasionally analog photos and videos, but generally follow the same principles of breaking away from intended use of some set of rules to express illegal states.

          0. https://www.theghostinthemp3.com/theghostinthemp3.html

  • bawolff7 hours ago

    You know, i was all ready to be dismissive of this, using encoder errors for art sounds silly.

    But i watched the video and it really was cool and artistic.

    • mamonoleechi30 minutes ago |parent

      It can sound cool with music too:

      - https://en.wikipedia.org/wiki/Glitch_(music)

      - group: the glitch mob http://www.youtube.com/watch?v=frfs4tkN-AY

    • shit_game5 hours ago |parent

      Plenty of incredible works of art and story telling use glitch art to evoke feelings and notions of "brokenness" or surreality. Some pieces that come to mind are Adventure Time S5E15: A Glitch is a Glitch, created by artist David OReilly[0] and the music video for A$AP Mob - Yamborghini High made by editor Uncle Luc[1].

      This of course doesnt even begin to touch on the influences glitch art has had on music and audio - it's arguable that glitch art has its origins in printing, photography/film, and in electronic music, but most deliberate uses of "glitches" as artistic vehicles tended to arise during the early eras of electronic music production. Rosa Menkman speaks in depth about the origins of glitch art in the music scene in her paper The Glitch Moment(um)[2].

      0. https://rhizome.org/editorial/2013/apr/25/datamoshing-land-o...

      1. https://www.youtube.com/watch?v=tt7gP_IW-1w

      2. https://mediarep.org/server/api/core/bitstreams/b16c898a-c6b...

      • epiccoleman4 hours ago |parent

        The quintessential example of glitch art, imo, is Adult Swim's Off the Air, which compiles various short animations and music cut together with various datamoshed transitions. While the glitch stuff isn't always the central focus it definitely goes a long way towards setting the trippy vibe they're going for.

        There are too many excellent episodes to list but Animals is a great one to get a feel: https://youtu.be/59QBOO6m210

        And the Dan Deacon USA special episode might be peak Off The Air:

        https://youtu.be/9X4fYP9bqqw

  • jedbrookean hour ago

    cool art! seeing datamoshing like this always impresses me at how much motion is encoded in modern video codecs

  • Hamuko39 minutes ago

    Didn't we already have VLC for this?

  • pkdpic4 hours ago

    this is beautiful, the video with the two guys in the urban landscape was especially inspiring, looking forward to experimenting with this someday

  • mkl8 hours ago

    Glitch art, not glitch arch. The main page https://ffglitch.org/ is a slightly better introduction to the project.

    • tomhow5 hours ago |parent

      Updated, thanks!