HNNewShowAskJobs
Built with Tanstack Start
Show HN: I'm building an AI-proof writing tool. How would you defeat it?(auth-auth.vercel.app)
10 points by callmeed a day ago | 16 comments
  • ephou7a day ago

    I used this:

    #!/usr/bin/python3 import subprocess import time import random with open("/tmp/x") as f: t = f.read() for c in t: subprocess.call([ "xdotool", "type", c ]) time.sleep(abs(random.gauss(0,0.07)))

    And pasted a random Hacker News comment:

    Authenticity Score 81 Highly Authentic

    Words per minute: 162 Keystroke variance: 52ms Paste attempts: 0 Window/tab switches: 4 Pauses (≥10s): 0 DOM manipulations: 0

    You failed.

    • callmeedan hour ago |parent

      That's cool, thanks for sharing.

      Is there a way to detect this approach?

  • ticulatedsplinea day ago

    - Screencap and OCR the prompt

    - feed it to an llm to answer

    - use a tool [1] to emulate human typing cadence.

    - Use a tool to send mouse events to the browser window.

    [1] https://multilogin.com/blog/paste-as-human-typing/

    not sure if you have any feedback at the end but if you do the alternative is feedback poisoning in your training set to mark AI stuff as real and real stuff as fake. The former is automatable and if there were a good reason you could probably mechanical-Turk a large number of people at low cost to do it for real and give feedback that they were actually AIs.

    • nine_ka day ago |parent

      An AI-proof writing tool is a pen and paper, on a glass table, in a Faraday-cage locked room, etc, etc.

      Depending on how high are the stakes, weeding off just the most obvious cases of AI usage may be enough. But wherever an electronic input is involved, it can be emulated in ways that are impossible to detect on a reasonable budget. Content analysis may help somehow, but again it would only detect the more obvious cases.

    • forgotpwd16a day ago |parent

      Or write a script that does all that and bind it to shortcut. Eventually https://files.catbox.moe/zargud.png. (The window/tab switches were 1~2 when ended; reached 9 after few attempts to screenshot it.)

  • JoshuaDavid21 hours ago

    The following by "Claude Slopson" (Claude Opus asked to write an answer that was obviously AI) scored 87% authentic:

    > Ah, what a fantastic question

    > For me, it's Breaking Bad–and honestly? It's not just a show, it's a masterclass in storytelling that fundamentally reshaped the television landscape.

    > What keeps drawing me back? The way it seamlessly blends moral complexity with edge-of-your-seat tension is nothing short of breathtaking. Walter White's transformation isn't just compelling–it's a profound meditation on identity, ambition, and the human condition itself.

    > But here's the thing–it's also deeply rewatchable. Every frame is meticulously crafted. Every detail matters. The foreshadowing alone is chef's kiss!

    > Whether you're a first-time viewer or a seasoned fan, Breaking Bad offers something for everyone. It's a testament to what happens when visionary creators push the boundaries of their medium.

    > In an era of endless content, some shows simply transcend. This is one of them.

    > 10/10, would recommend! What's YOUR comfort rewatch? Drop it below!

    (HN strips the emojis, but don't worry–they were there)

  • hackingonempty18 hours ago

    A paper on this was just submitted.

    "We demonstrate that this class of defenses is insecure against two practical attack classes: the copy-type attack, in which a human transcribes LLM-generated text producing authentic motor signals, and timing-forgery attacks, in which automated agents sample inter-keystroke intervals from empirical human distributions."

    https://arxiv.org/abs/2601.17280v1

    There are tons of USB dongles available for about $10 containing a programmable microcontroller. You connect to the dongle from another device over wifi and it can act like a keyboard typing out whatever text you want using a model of human typing, perhaps even your own.

  • dpoloncsaka day ago

    >Pasting and DOM manipulation are disabled to ensure all writing is original.

    >We track telemetry such as typing speed, pauses, tab changes, and window focus events.

    People figure out ways around this for like...Runescape bots and other low-stake situations. I don't think it would hold up to anything other than casual users. Seems like an agent could whip something up in Auto-HotKey or something.

    I get this is the extreme end, but if this gets popular enough, can't you write like a custom 'keyboard' driver that just takes AI input and 'types' it? Random delay between keystrokes, whatever....

    It also can't be used to verify existing work, right? I can't see if a student's essay is LLM-written. Is there any real-world use you see? Or is this just a fun toy?

    • callmeedan hour ago |parent

      School/students were my target user when I created this. But also mostly just a fun toy.

    • yjftsjthsd-ha day ago |parent

      > I get this is the extreme end, but if this gets popular enough, can't you write like a custom 'keyboard' driver that just takes AI input and 'types' it? Random delay between keystrokes, whatever....

      We can easily go one more step than drivers; making a cheap microcontroller enumerate as a USB keyboard is easy.

      • dpoloncsaka day ago |parent

        Ai powered rubber duckies go crazyyyyyyy

  • stupidgeek314a day ago

    > Open chatgpt in second tab > Type what chatgpt says yourself

    The only "AI proof" writing tool is those blue books you take exams on in college.

    • kibibua day ago |parent

      No need for a second tab (focus switch is trackable) when you have a phone.

  • jryan4919 hours ago

    I pulled up a 2nd browser next to your site. I typed the prompt into Gemini, and manually typed what Gemini said and removed em dashes as I typed. It said it was 100% genuine.

    • callmeedan hour ago |parent

      Maybe I need to punish tab/windows switches more severely?

      Or perhaps require webcam and do eye tracking?

      • jryan4913 minutes ago |parent

        I only switched tab/windows once (to input the question). So I'm not sure how severely you'd want to rate that. The webcam doing eye tracking might help if the person isn't good a typing and can copy one side without checking if the other is okay...