Conversation

Notices

1. CEO of Monoeye Dating (ceo_of_monoeye_dating@bae.st)'s status on Thursday, 31-Aug-2023 19:06:18 JST CEO of Monoeye Dating

   • pistolero :thispersondoesnotexist:
   @Nerd02 @bmygsbvur @db0 cc @p What's your take on this tool?
   
   This topic has come up before more than once.
   • pistolero :thispersondoesnotexist: (p@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 19:06:17 JST pistolero :thispersondoesnotexist:

     in reply to
     @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 The last time the topic came up, the only publicly available API for this was owned by the feds. I don't know if this tool downloads a model (I also don't know how such a model could be legal to possess) or if it consults an API (which would be a privacy concern). In either case, you'd have to be very careful about false positives.
   •  (mint@ryona.agency)'s status on Thursday, 31-Aug-2023 19:06:17 JST 

     in reply to

     • pistolero :thispersondoesnotexist:
     @p @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 Yeah, it's using local CLIP model, something I've suggested both to gr*f and jakparty.soy admin. The problem is that it requires a lot of clock cycles, preferably on GPU, so it isn't something people with $5 VPSes can afford. Not fully sure about effectiveness, either, malicious actors can keep scrambling the image so that it passes the filter yet is still recognizable by human brain.
   • CEO of Monoeye Dating (ceo_of_monoeye_dating@bae.st)'s status on Thursday, 31-Aug-2023 20:17:50 JST CEO of Monoeye Dating

     in reply to

     • 
     • pistolero :thispersondoesnotexist:
     @p @Nerd02 @bmygsbvur @db0 @mint The problem with the models is the fact that training data can be reverse engineered from the model. If the model's not trained on any CP, there's not likely to be any problem.
      likes this.
   • CEO of Monoeye Dating (ceo_of_monoeye_dating@bae.st)'s status on Thursday, 31-Aug-2023 20:17:51 JST CEO of Monoeye Dating

     in reply to

     • 
     • pistolero :thispersondoesnotexist:
     @p @Nerd02 @bmygsbvur @db0 @mint >How does this not end up getting used to produce computer-generated CP?
     
     It was. That's the problem they wrote this script to try to solve.
   • pistolero :thispersondoesnotexist: (p@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 20:17:51 JST pistolero :thispersondoesnotexist:

     in reply to

     • 
     @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 @mint Yeah, presumably it is better at detecting stuff that it produces itself, but my understanding is that this kind of model is legally questionable to possess because of that.
   • pistolero :thispersondoesnotexist: (p@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 20:17:52 JST pistolero :thispersondoesnotexist:

     in reply to

     • 
     @mint @Nerd02 @bmygsbvur @ceo_of_monoeye_dating @db0
     
     > it's using local CLIP model,
     
     How does this not end up getting used to produce computer-generated CP?
     
     > isn't something people with $5 VPSes can afford.
     
     Yeah, but when you're at the $5 VPS stage, you're usually going to be hosting a couple dozen people at most.
     
     > malicious actors can keep scrambling the image so that it passes the filter yet is still recognizable by human brain.
     
     Yeah. Not foolproof.
   • pistolero :thispersondoesnotexist: (p@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 20:42:09 JST pistolero :thispersondoesnotexist:

     in reply to

     • 
     @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 @mint Yeah, but youtube-dl was on Github for years and then suddenly declared an evil piracy tool and scrubbed and banned. The odds that you get bonked are also higher than the odds that Github gets bonked; "I got it from Github" doesn't constitute much of a defense.
     
     In either case, I don't have much investment in the legality of that model because I don't plan to acquire it. Just it was my understanding that possessing a model that was trained on some source material and that can be used to produce material resembling the source material is considered the same, legally, as possessing the source material. I'm not an expert on that and I don't think there have even been any cases yet.
      likes this.
   • CEO of Monoeye Dating (ceo_of_monoeye_dating@bae.st)'s status on Thursday, 31-Aug-2023 20:42:10 JST CEO of Monoeye Dating

     in reply to

     • 
     • pistolero :thispersondoesnotexist:
     @p @Nerd02 @bmygsbvur @db0 @mint They've had the model on github for months. If they were gonna get bonked, they'd've gotten bonked by now.
      repeated this.
   • pistolero :thispersondoesnotexist: (p@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 20:43:59 JST pistolero :thispersondoesnotexist:

     in reply to

     • 
     @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 @mint Ah, okay, so this one wasn't trained on that material?
   •  (mint@ryona.agency)'s status on Thursday, 31-Aug-2023 20:43:59 JST 

     in reply to

     • pistolero :thispersondoesnotexist:
     @p @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 Yes, but it should be able to count two concepts together even if there were no overlap between the two in training data.
   • laurel (laurel@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 21:03:37 JST laurel

     in reply to

     • 
     • pistolero :thispersondoesnotexist:
     @ceo_of_monoeye_dating @p @Nerd02 @bmygsbvur @db0 @mint
     
     It's not their model, it's an implementation of the openAI paper from some academics hosted here https://github.com/pharmapsychotic/clip-interrogator/
     
     To be specific they use one of the ViT-L/14 models.
     This type of labeling models have been around for a long time. They used to be called text-from-image or some other similar verbose description.
     
     If the current generative models can produce porn then they can also produce CSAM, there's no need to go through another layer.
     The issue with models trained on actual illegal material is that then they could be reverse engineered to output the very same material that they have been trained with, in addition to very realistic generated ones. It's similar to how LLMs can be used to extract potentially private information they've been trained with.
      likes this.
   • laurel (laurel@freespeechextremist.com)'s status on Thursday, 31-Aug-2023 21:11:11 JST laurel

     in reply to

     • 
     • pistolero :thispersondoesnotexist:
     • laurel
     @ceo_of_monoeye_dating @Nerd02 @bmygsbvur @db0 @mint @p
     
     *some academics hosted here https://github.com/mlfoundations/open_clip
     The above link was just the wrapper.
      likes this.