FaceDeer cover
FaceDeer avatar

FaceDeer

@FaceDeer@fedia.io

Basically a deer with a human face. Despite probably being some sort of magical nature spirit, his interests are primarily in technology and politics and science fiction.

Spent many years on Reddit and then some time on kbin.social.

FaceDeer ,
FaceDeer avatar

Have to save it up in jars ahead of time.

FaceDeer ,
FaceDeer avatar

Keep making it more expensive to suck on their toes and perhaps eventually they'll stop.

FaceDeer ,
FaceDeer avatar

Well that seems unlikely, what are the odds that an airplane is going to be chased by a ship?

Slack is now using all content, including DMs, to train LLMs ( mastodon.sdf.org )

cross-posted from: https://lemmy.ml/post/15741608...

 We offer customers a choice around these practices. If you want to exclude your Customer Data from helping to train Slack global models, you can opt out. If you opt out, Customer Data on your workspace will only be used to improve the experience on your own workspace and you will still enjoy all of the benefits of our globally trained Al/ML models without contributing to the underlying models.
ALT
FaceDeer ,
FaceDeer avatar

Also pretty sure training LLMs after someone opts out is illegal?

Why? There have been a couple of lawsuits launched in various jurisdictions claiming LLM training is copyright violation but IMO they're pretty weak and none of them have reached a conclusion. The "opting" status of the writer doesn't seem relevant if copyright doesn't apply in the first place.

FaceDeer ,
FaceDeer avatar

Nor is it up to you. But fact remains, it's not illegal until there are actually laws against it. The court cases that might determine whether current laws are against it are still ongoing.

FaceDeer ,
FaceDeer avatar

Maybe it's "simple as that" if you're just expressing an opinion, but what's the legal basis for it?

FaceDeer ,
FaceDeer avatar

The GDPR says that information that has been anonymized, for example through statistical analysis, is fine. LLM training is essentially a form of statistical analysis. There's hardly anything in law that is "simple."

FaceDeer ,
FaceDeer avatar

You could say it's to "circumvent" the law or you could say it's to comply with the law. As long as the PII is gone what's the problem?

FaceDeer ,
FaceDeer avatar

It is impossible for them to contain more than just random fragments, the models are too small for it to be compressed enough to fit. Even the fragments that have been found are not exact, the AI is "lossy" and hallucinates.

The examples that have been found are examples of overfitting, a flaw in training where the same data gets fed into the training process hundreds or thousands of time over. This is something that modern AI training goes to great lengths to avoid.

FaceDeer ,
FaceDeer avatar

You don't think LLMs are being trained off of this content too? Nobody needs to bother "announcing a deal" for it, it's being freely broadcast.

FaceDeer ,
FaceDeer avatar

Surely the use of user-deleted content as training data carries the same liabilities as reinstating it on the live site?

Why would that be? It's not the same.

And what liabilities would there be for reinstating it on the live site, for that matter? Have there been any lawsuits?

FaceDeer ,
FaceDeer avatar

I just did a bit of poking around on the subject of the "right to be forgotten" and it's legally complex. Data without personally identifying information, and data that's been anonymized through statistical analysis (which LLM training is a form of) aren't covered.

FaceDeer ,
FaceDeer avatar

You think they don't have the originals archived?

FaceDeer ,
FaceDeer avatar

"Model collapse" can be easily avoided by keeping old human data with new synthetic data in the training set. The old archives of Reddit content from before there was AI are still around.

FaceDeer ,
FaceDeer avatar

There are torrents of complete Reddit comment archives available for any random person who wants them, I'm sure Reddit themselves has a comprehensive edit history of everything.

FaceDeer ,
FaceDeer avatar

By "old archives" I mean everything from 2022 and earlier.

FaceDeer ,
FaceDeer avatar

Existing AIs such as ChatGPT were trained in part on that data so obviously they've got ways to make it work. They filtered out some stuff, for example - the "glitch tokens" such as solidgoldmagikarp were evidence of that.

FaceDeer ,
FaceDeer avatar

The echo-chamberiness of Lemmy is different from Reddit, but still a thing unfortunately. It'll really depend on the community you're in, but since the population of the Fediverse (and especially the Threadiverse) is very small compared to Reddit you tend to have the same people cropping up a lot. I haven't been banned from anywhere (that I know of - I don't actually know if I would get notified) but I find myself hammered with downvotes more frequently here than on Reddit when I say something unpopular.

I'd say, mess around a bit and see.

FaceDeer ,
FaceDeer avatar

Honestly, I've been using Bing a lot in recent months thanks to its integrated AI. Google is now just for when I know I want a specific web page, when it's a general answer I want then nothing beats Bing Chat. So this is a good move by Google.

FaceDeer ,
FaceDeer avatar

Buddy, I just want to type a search term and get results.

Telemetry can help them do better at providing that. Devs aren't magical beings, they don't know what's working and what's not unless someone tells them.

FaceDeer ,
FaceDeer avatar

No, this analogy would make more sense if it was a matter of recording a large number of interactions between customers and tellers to ensure that the window isn't interfering with their interactions. Is the window the right size? Can the customer and teller hear each other through it? Is that little hole at the bottom large enough to let through the things they need to physically exchange? If you deploy the windows and then never gather any telemetry you have no idea whether it's working well or if it could be improved.

FaceDeer ,
FaceDeer avatar

The analogy isn't perfect, no analogy ever is.

In this case the content of the search is all that really matters for the quality of the search. What else would you suggest be recorded, the words-per-minute typing speed, the font size? If they want to improve the search system they need to know how it's working, and that involves recording the searches.

It's anonymized and you can opt out. Go ahead and opt out. There'll still be enough telemetry for them to do their work.

FaceDeer ,
FaceDeer avatar

I mean... progress? I guess? The new statue guy doesn't hate as many people...

FaceDeer ,
FaceDeer avatar

Got to run out of stuff to burn someday, though. Then things will go back to normal.

FaceDeer ,
FaceDeer avatar

Yeah, why aren't regular folks building reusable heavy-lift rocket systems?

FaceDeer ,
FaceDeer avatar

And even if SLS is an example of non-private rocketry, it's hardly something that should be touted as a positive example. Especially not when launch pace is your criterion.

FaceDeer ,
FaceDeer avatar

Some are, but they still don't build rockets. I think there's some other factor that's important.

FaceDeer ,
FaceDeer avatar

Maybe, but Trump has already had a weird vendetta against wind turbines for a long time. They had the audacity of being near enough to one of his golf courses that he imagined they might be visible (they're not) and reduce its value. Ever since waking from that night-terror he's been on the warpath.

How Zionism became a synonym for violence and oppression ( www.theguardian.com )

For decades, Joe Biden has proudly declared that he is a Zionist, and he has repeated that claim since Hamas’s 7 October attacks on Israel. But for the student anti-war protests gripping the US, the words “Zionist” and “Zionism” have become a watchword – pejorative and emblematic of the violent state policies driving...

FaceDeer ,
FaceDeer avatar

I wouldn't exactly call Israel "secular" when it is built around the concept of a particular religious group having special status.

FaceDeer ,
FaceDeer avatar

Now the effort is going into finding reasons not to like things, it seems.

FaceDeer ,
FaceDeer avatar

Given he's into cross-species dating he can't be that good a boy.

FaceDeer ,
FaceDeer avatar

Very odd. Where I live you're not supposed to return the bottles with the cap, they're different plastics and the recyclers don't want the caps. You're supposed to throw the caps away in the regular trash.

FaceDeer ,
FaceDeer avatar

I leave the little ring on and nobody's complained yet. I was just told to remove the caps one time, so I kept on throwing those out since then.

FaceDeer ,
FaceDeer avatar

As I said, someone did complain about the caps.

FaceDeer ,
FaceDeer avatar

Fortunately it doesn't have to be exactly like the real thing to be useful. Just ask machine learning scientists.

FaceDeer ,
FaceDeer avatar

I am becoming increasingly convinced that so is the human brain.

FaceDeer ,
FaceDeer avatar

Why hasn't it been incorporated into IDEs until now?

FaceDeer ,
FaceDeer avatar

To the contrary, I see code like that all the time in my career. I've written some.

FaceDeer ,
FaceDeer avatar

The example shown was specifically selected because it's funny, not because it's representative.

The fact that you called the tool "chatgpt4" suggests you're not experienced with copilot. They're not the same thing even if they're using similar LLMs as a component.

FaceDeer ,
FaceDeer avatar

Within IDEs people go out of their way to install Intellisense so that "shit randomly pops up while they're typing." There are companies whose whole existence depends on people wanting that to happen.

FaceDeer ,
FaceDeer avatar

I should note that currency and capitalism are not the same thing. Pretty much every existing economic system has currency of some form, it's just a way of tracking the relative values of various things so that people can make agreements about who gets what.

FaceDeer ,
FaceDeer avatar

You answered your question in the sentence right after your question. The landlord owns the property and so he can do what he wants with it. He's letting you live there but has decided he wants something in exchange for letting you live there. If currency didn't exist he'd want something else in exchange.

FaceDeer ,
FaceDeer avatar

Are you suggesting people shouldn't be allowed to own stuff? There are very few economic systems where people aren't allowed to own stuff and they tend not to be popular. Most of the people who are complaining about landlords and rent and whatnot really just want to own their own houses.

FaceDeer ,
FaceDeer avatar

Even this post showing it off feels like satire, how exactly does a room with cigarette smoke in it "fuck the planet?" Do people think cigarette smoke emissions are remotely relevant on a global scale? Poe's law is strong in this one.

FaceDeer ,
FaceDeer avatar

Sure, but having a smoking section in Tim Hortons isn't going to change that. I'd think it'd make it more likely for smokers to throw their butts out in a manner that can be properly disposed of, rather than making them smoke outside.

Note that I'm not advocating smoking or smoking sections. Smoking is awful on many levels and I'd rather see it go away entirely. I'm just pointing out that it's ridiculous to say having a smoking section in Tim Hortons is going to have a significant impact on the environment. Jumping to "this is going to fuck the planet" is crying wolf, it's going to result in people either getting sick of environmentalism or more subtly problematic it'll result in people thinking they're making a difference when they're not. The plastic straw ban, for example. Plastic straws were never a major contributor to ocean plastic waste. By far the largest contributor to ocean plastic waste is discarded fishing equipment, but I don't see any campaigning to reduce seafood consumption. People banned straws instead and then thought they'd accomplished something.

UN votes to back Palestinian membership, prompting Israeli envoy to shred charter ( www.theguardian.com )

The UN general assembly has voted overwhelmingly to back the Palestinian bid for full UN membership, in a move that signalled Israel’s growing isolation on the world stage amid global alarm over the war in Gaza and the extent of the humanitarian crisis in the strip. The move drew an immediate rebuke from Israel. Its envoy to...

FaceDeer ,
FaceDeer avatar

I mean, if you think the UN charter shouldn't bind you, you can always leave...

FaceDeer ,
FaceDeer avatar

The time limit is a century or so, so that's something our descendants can figure out.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • supersentai
  • WatchParties
  • Rutgers
  • MidnightClan
  • Lexington
  • cragsand
  • mead
  • RetroGamingNetwork
  • mauerstrassenwetten
  • loren
  • xyz
  • PowerRangers
  • AnarchoCapitalism
  • kamenrider
  • Mordhau
  • itdept
  • neondivide
  • steinbach
  • AgeRegression
  • WarhammerFantasy
  • Teensy
  • learnviet
  • bjj
  • electropalaeography
  • space_engine
  • khanate
  • jeremy
  • fandic
  • All magazines