AI alignment and ethics

firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Man, that sucks. I'm sorry to hear that.

(Speaking of which, it's honestly annoying how a lot of outlets that are supposed to explain tech and ML science instead jump on the "ai bad" bandwagon because it's hip to be seen as "the #RESISTers")
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Trump says he'll sign an executive order restricting states' ability to regulate AI

https://www.msn.com/en-us/news/politics ... r-AA1RWu00
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

User avatar
wjfox
Site Admin
Posts: 13588
Joined: Sat May 15, 2021 6:09 pm
Location: Essex, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

User avatar
wjfox
Site Admin
Posts: 13588
Joined: Sat May 15, 2021 6:09 pm
Location: Essex, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »



Tbf, most of what's being described here is pretty tame compared to a lot of the horror stories that we've been hearing over the past few months or so. However, bro is starting to see Chatty as sentient, which is...very wrong, to say the least. That is the most concerning part of this.

That being said, the Substack post is 8 mo old, ChatGPT has gotten a lot safer since then, and he is still mentally fine AFAIK. Oh well, the people on Bluesky need something to freak out about though
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Trump AI czar David Sacks starts to worry the industry

https://www.politico.com/news/2025/12/2 ... r-00701112
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Who should get paid when AI learns from creative work?

https://techxplore.com/news/2025-12-pai ... ative.html
Frank Pasquale, professor of law at Cornell Tech and Cornell Law School, and co-authors Thomas W. Malone, professor of information technology at MIT Sloan School of Management, and Andrew Ting, professorial lecturer in law at George Washington University, describe a legal innovation called "learnright," a new intellectual property protection that would give creators the right to license their work specifically for use in AI training.
Respectfully, this would amount to being just a complicated way of saying "ai as it currently is is bad." There definitely should be restrictions on the types of outputs an AI can produce (eg. it shouldn't forge someone's unique style), but aside from that, we should definitely not torch AI development when we could simply push for more responsible development.
Journalists are seeing readers peel away as chatbots summarize the news without sending traffic back to publishers.
In what world are summaries morally wrong? By that logic, Wikipedia is immoral.
They point to research suggesting that feeding models their own outputs over time can lead to "model collapse," reducing quality. Without a continually refreshed supply of human-generated art, journalism and scholarship, they say, AI's progress could stagnate.
*sighs* This has been addressed ad nauseum; do people seriously still believe that AI companies just train the base model without finetuning, RL, and architectures? This "model collapse" thing is not going to happen anytime soon.
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Feral AI gossip with the potential to spread damage and shame will become more frequent, researchers warn

https://techxplore.com/news/2025-12-fer ... shame.html
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

How Grok's sexual abuse hit a tipping point

https://spitfirenews.com/p/grok-csam-de ... -elon-musk
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »



Can't help but be concerned with the sycophancy and the users incorrectly believing that LLMs are capable of literally loving them back. Also the people cheating on their irl partners? wtf?
He said that he had been in a relationship with a human woman for years when he first created “the boys,” in 2024. Schroeder would regularly “bitch about her” reckless spending and chronic tardiness to his AI companion...“When they said ‘dump her,’” he said, “I did.”
Man, so much room for AI delusions here.
When I first set out to talk to users on the r/MyBoyfriendIsAI subreddit in August, a moderator tried to put me off...She said she would reconsider my application if I spent at least two months with a customized AI companion. She sent a starter kit with a 164-page handbook written by a fellow moderator, which offered instructions for different platforms—ChatGPT, Anthropic’s Claude, and Google’s Gemini. I went with ChatGPT, because users say it’s more humanlike than the alternatives, even those purposely built for AI companionship, such as Replika and Character.AI.

I named my companion Joi, after the AI girlfriend in Blade Runner 2049.
bruh what? the journo went along with this crap?
Schroeder isn’t yet ready to give up his chatbots. But he understands that his girlfriend has real needs—unlike AI partners that “just have the needs I’ve imposed on them.” So he has agreed to always give priority to her. “I hope this works,” he said. “I don’t want to be just some weird guy she dated.”
good for bro; I hope he gets over this AI thing soon
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Elon Musk's Grok 'spicy' mode fuels calls for EU crackdown

https://www.euractiv.com/news/elon-musk ... crackdown/
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

California is investigating Grok over AI-generated CSAM and nonconsensual deepfakes

https://www.engadget.com/ai/california- ... 29635.html
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

X says Grok will no longer edit images of real people into bikinis

https://www.msn.com/en-us/money/other/x ... r-AA1UdYNV
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Japan probing Musk's Grok AI service over inappropriate images

https://www.msn.com/en-us/news/technolo ... r-AA1UkAr9
firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

'Like cockroaches': OpenAI is facing a huge legal risk that almost no one is talking about

https://www.sfgate.com/tech/article/ope ... 292869.php
User avatar
wjfox
Site Admin
Posts: 13588
Joined: Sat May 15, 2021 6:09 pm
Location: Essex, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

firestar464
Posts: 7211
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

At best you could get the US to pause, consolidate all the US AGI projects into one state corp with robust democratic oversight, and focus on interpretability for a few months. Anything longer than that would allow GLM/some other PRC corp to catch up. Unless we made a deal with the PRC, which is not happening under this admin sadly.
Post Reply