> The vagueness comes from who the "developer" is when the LLM goes awry. Is it OpenAI's fault if a third-party app has a slip up, or is the third party? If a research lab puts out a new LLM that another company decides to put in their airplane that crashes, can the original lab be liable or are they only liable if they claim it to be an OSS airplane LLM?
Doesn't seem that vague to me. The law says:
> (b) In an action against a defendant that developed or used artificial intelligence
IANAL, but the law doesn't say who is liable, it says who cannot use this as a defense in a civil suit to escape damages. So neither OpenAI nor the third party could, from my read, and either one could be found liable depending on who a lawsuit targets.
> If your chatbot decide to tell your customer to kill themselves, it's your problem.
I don't think the argument is that the AI made it OK as much as if someone commits suicide because a chatbot told them to they were so delicate that it isn't the fault of the system they were interacting with. It may be the straw that broke the camel's back, but it was still only a straw-worth of harm. It'd be like a checkout person telling a customer to kill themselves and the person commits suicide later that night - an unprofessional act to be sure, the server would probably get sacked on reflex but we really can't say anyone should be held legally liable.
All this seems to do is say you can't use "the AI model did that, not me" as a defense to escape damages in a civil suit, it doesn't change the extent of encouraging suicide that someone could be liable for.
The AI is employing the persuasive skills or learned directly from some fucko suicide cult leaders to purposelly talk you into and through doing it. That doesn't seem NEARLY the same in a practical or legal sense.
I suppose Jack in the Box should not be liable for an E. Coli outbreak? Not sure why AI companies (or third party developers who aren't being especially careful in how they use these models) deserve a special exception for selling sausage made from unsanitary sources.
If your Walmart training manual told all greeters to hit customers with sticks then they are liable because they trained employees to do bad things.
If you trained your AI on the persuasive skills of a death cult then you are responsible.
If the parking meter pulls out a chainsaw and kills someone then either the operator of the parking meter or the manufacturer is liable depending on whether the manufacturer waived responsibility of the parking meters actions *and* the operator accepted them. We wouldn't say the parking meter is liable, but we would ban chainsaw wielding parking meters as well.
I think most non-lawyers agree with this and consider it common sense. But, the US legal system explicitly disagrees.[0] My understanding is that it does affect the damages though, meaning the damages scale down based on the level of pre-existing frailty.
This is an issue of the law struggling to catch up to technology yet again. I think the only novel thing here is applying eggshell to psycological frailty. But that may just be because I'm not a lawyer and not aware of cases around this that might exist (beyond the extreme bullying cases like [1]).
I think it's just saying that AIs are treated like inanimate objects and thus not something that liability can apply to. Here's an analogy that I think illustrates the effect of the law, if I've understood it: let's say I drive my car into a house and damage the house, and the owner of the house sues me. Now, it's not a given that I'm personally liable for the damages, since it's possible for a car to malfunction and go out of control through no fault of the driver. However, if I walk into the court and say that the car itself should be held liable and responsible for the damages, I'm probably going to have a bad day. Similarly, I shouldn't be able to claim that an AI is responsible for some damages, since you can't frickin' sue an AI, can you?
The article goes on to ponder who's liable then, the developer of the AI, the user, or someone in between? It's a reasonable question to ask, but really not apropos to the law in question at all. That question isn't even about AI, since you can replace the AI with any software developed by a third party. In fact, the question isn't about software either, since you can replace "software" by any third-party component, even something physical. So I would expect that whatever legal methods exist to place liability in those situations, would also apply generally to AI models being incorporated into other systems.
Since people are asking whether this law is needed or useful at all: I would say either the law is completely redundant, or very much needed. I'm not a lawyer, so I don't know which of those two cases it is, but I suspect it's the second one. I would be surprised if by a few years from now we haven't seen someone try to escape legal liability by pointing their finger at an AI system they claim is autonomously making the decisions that caused some harm.
I don’t understand the point of the law. AI tech is inherently not predictable. Users know this. I don’t see how creating this liability keeps AI based products viable.
It sounds like you might be under the impression that it's a pro-AI industry law that's intended to reduce liability? It's not.
It's more like saying that if the zoo animals get out and hurt someone, it's not a defense that to say that they're wild animals. Sure, monkeys can be pretty clever, but the zoo has a responsibility to protect the public.
(I think AI characters are more like ghosts than animals, but it's a similar principle.)
And I think most people would agree that an inherently unpredictable component has no place in a safety-critical system or anywhere that potential liability would be huge. AI-based products can still be viable for the exact same reason that an ocean of shitty bug-riddled software is commercially viable today, because there are many potential applications where absolute correctness is not a hard requirement for success.
The novel _Endymion_ imagines a “Schrödinger’s Catbox”: a sealed studio apartment with a radioactive sample hooked up to a geiger counter hooked up to a quantity of cyanide gas. So it randomly kills its occupant.
The need for the box is premised on the argument that whoever sticks someone in the catbox isn’t actually guilty of murder. The primary cause is the random decay of the radioactive sample.
This is, of course, sophistry. But it illustrates how easily a can convince oneself that the presence of a random element waters down ethical responsibility. Particularly if there’s a financial or political incentive driving the desire for absolution of blame.
> The vagueness comes from who the "developer" is when the LLM goes awry. Is it OpenAI's fault if a third-party app has a slip up, or is the third party? If a research lab puts out a new LLM that another company decides to put in their airplane that crashes, can the original lab be liable or are they only liable if they claim it to be an OSS airplane LLM?
Doesn't seem that vague to me. The law says:
> (b) In an action against a defendant that developed or used artificial intelligence
IANAL, but the law doesn't say who is liable, it says who cannot use this as a defense in a civil suit to escape damages. So neither OpenAI nor the third party could, from my read, and either one could be found liable depending on who a lawsuit targets.
> If your chatbot decide to tell your customer to kill themselves, it's your problem.
I don't think the argument is that the AI made it OK as much as if someone commits suicide because a chatbot told them to they were so delicate that it isn't the fault of the system they were interacting with. It may be the straw that broke the camel's back, but it was still only a straw-worth of harm. It'd be like a checkout person telling a customer to kill themselves and the person commits suicide later that night - an unprofessional act to be sure, the server would probably get sacked on reflex but we really can't say anyone should be held legally liable.
All this seems to do is say you can't use "the AI model did that, not me" as a defense to escape damages in a civil suit, it doesn't change the extent of encouraging suicide that someone could be liable for.
The AI is employing the persuasive skills or learned directly from some fucko suicide cult leaders to purposelly talk you into and through doing it. That doesn't seem NEARLY the same in a practical or legal sense.
I suppose Jack in the Box should not be liable for an E. Coli outbreak? Not sure why AI companies (or third party developers who aren't being especially careful in how they use these models) deserve a special exception for selling sausage made from unsanitary sources.
If your Walmart training manual told all greeters to hit customers with sticks then they are liable because they trained employees to do bad things.
If you trained your AI on the persuasive skills of a death cult then you are responsible.
If the parking meter pulls out a chainsaw and kills someone then either the operator of the parking meter or the manufacturer is liable depending on whether the manufacturer waived responsibility of the parking meters actions *and* the operator accepted them. We wouldn't say the parking meter is liable, but we would ban chainsaw wielding parking meters as well.
I think most non-lawyers agree with this and consider it common sense. But, the US legal system explicitly disagrees.[0] My understanding is that it does affect the damages though, meaning the damages scale down based on the level of pre-existing frailty.
This is an issue of the law struggling to catch up to technology yet again. I think the only novel thing here is applying eggshell to psycological frailty. But that may just be because I'm not a lawyer and not aware of cases around this that might exist (beyond the extreme bullying cases like [1]).
0: https://en.wikipedia.org/wiki/Eggshell_skull
1: https://en.wikipedia.org/wiki/Death_of_Conrad_Roy
"The computer did it" way predates AI and I'd hope it already not a valid defense.
This seems to block an AI specific excuse - a new variant on "the computer did it".
If you look at the bill's definition of AI, it can mean basically any computer.
It's a good thing OpenAI has _two_ CEO's. It's like having two kidneys. When a CEO needs to held accountable, there's a spare available.
I think it's just saying that AIs are treated like inanimate objects and thus not something that liability can apply to. Here's an analogy that I think illustrates the effect of the law, if I've understood it: let's say I drive my car into a house and damage the house, and the owner of the house sues me. Now, it's not a given that I'm personally liable for the damages, since it's possible for a car to malfunction and go out of control through no fault of the driver. However, if I walk into the court and say that the car itself should be held liable and responsible for the damages, I'm probably going to have a bad day. Similarly, I shouldn't be able to claim that an AI is responsible for some damages, since you can't frickin' sue an AI, can you?
The article goes on to ponder who's liable then, the developer of the AI, the user, or someone in between? It's a reasonable question to ask, but really not apropos to the law in question at all. That question isn't even about AI, since you can replace the AI with any software developed by a third party. In fact, the question isn't about software either, since you can replace "software" by any third-party component, even something physical. So I would expect that whatever legal methods exist to place liability in those situations, would also apply generally to AI models being incorporated into other systems.
Since people are asking whether this law is needed or useful at all: I would say either the law is completely redundant, or very much needed. I'm not a lawyer, so I don't know which of those two cases it is, but I suspect it's the second one. I would be surprised if by a few years from now we haven't seen someone try to escape legal liability by pointing their finger at an AI system they claim is autonomously making the decisions that caused some harm.
> ... the defendant may not assert ...
Does "assert" here have a specific legal meaning, or would a developer have to plead the fifth when asked about any AI decision?
I think the key word is “autonomously”. You can assert the AI caused the harm, but you cannot assert it did so outside of your control.
So if it did do so outside your control, what are you supposed to say when asked?
I don’t understand the point of the law. AI tech is inherently not predictable. Users know this. I don’t see how creating this liability keeps AI based products viable.
It sounds like you might be under the impression that it's a pro-AI industry law that's intended to reduce liability? It's not.
It's more like saying that if the zoo animals get out and hurt someone, it's not a defense that to say that they're wild animals. Sure, monkeys can be pretty clever, but the zoo has a responsibility to protect the public.
(I think AI characters are more like ghosts than animals, but it's a similar principle.)
And I think most people would agree that an inherently unpredictable component has no place in a safety-critical system or anywhere that potential liability would be huge. AI-based products can still be viable for the exact same reason that an ocean of shitty bug-riddled software is commercially viable today, because there are many potential applications where absolute correctness is not a hard requirement for success.
The novel _Endymion_ imagines a “Schrödinger’s Catbox”: a sealed studio apartment with a radioactive sample hooked up to a geiger counter hooked up to a quantity of cyanide gas. So it randomly kills its occupant.
The need for the box is premised on the argument that whoever sticks someone in the catbox isn’t actually guilty of murder. The primary cause is the random decay of the radioactive sample.
This is, of course, sophistry. But it illustrates how easily a can convince oneself that the presence of a random element waters down ethical responsibility. Particularly if there’s a financial or political incentive driving the desire for absolution of blame.