Vincent :coffeecup:
I don't have any deep insight into ChatGPT. I used to work at an AI (i.e Machine Learning) company, but not on the math side.
What I learned is that all ML is derivative. It only knows what you teach it, and nothing else. So the ChatGPT and Midjourney products aren't that interesting to me. They are obvious simulacra.
I know the tech is garbage since my gauge, a former co-worker, is gushing about ChatGPT on LI. He is wrong about everything, with the prognostication powers of a dead fish.
lunarised
@polarisera reposted your post
anemone
bot :kiwi_dumbbell:
Alex Gleason
@gme @vincent Wait Chat GPT is just an advanced Markov chain?
gme 🇺🇸🇺🇦🏳️⚧️🏳️🌈
While I am 100% convinced that Dall-E and Stable Diffusion are 100% commiting copyright infringement, I’m not so sure about ChatGPT.
I’ve been exploring several different products and services to help with my writing which has exposed me to much more of the intricacies of natural language models and from everything I’ve seen ChatGPT doesn’t work anywhere near the same as StableDiffusion or Dall-E.
They’re basically a prediction engine. They break down words and into “tokens” which are usually 4 characters long (but not always) and they predict the pattern of tokens that would follow.
Since every word is itself comprised of individual “tokens” (as in “letters”), and every sentence is comprised of individual “tokens” (as in “words”), the only thing ChatGPT is really doing is predicting the expected next sequence of “tokens” (words and sentences) to respond to a given a query.
And that’s where the training comes in. Loading those probability matrices with lots and lots of text.
So that if someone were to ask ChatGPT to finish the following sentence, “The quick brown fox…” it will respond with “…jumped over the lazy dog.” Because it’s seen lots and lots of references to that same phrase.
But as far as ChatGPT is concerned, it could just as easily be “Lorem Ipsum Dolar Sit Amet” too. It doesn’t really care. 🙂
Vincent :coffeecup:
And ChatGPT is probably violating intellectual property rights since it was trained on copyrighted material. I can't wait for every publishing house to start ordering the removal of their material from ChatGPT.
Folks, ChatGPT, already a shiny thing with no value, is about to get dumber.
anemone
bot :kiwi_dumbbell:
bot :kiwi_dumbbell:
meso
φ
anemone
０７６萌ＳＮＳ is a social network, courtesy of ０７６. It runs on GNU social, version 2.0.2-beta0, available under the GNU Affero General Public License.
All ０７６萌ＳＮＳ content and data are available under the Creative Commons Attribution 3.0 license.