inari@piefed.zip to Technology@lemmy.worldEnglish · 1 month agoAI’s recursive self-improvement might not come so quickly after allwww.technologyreview.comexternal-linkmessage-square47linkfedilinkarrow-up160arrow-down16
arrow-up154arrow-down1external-linkAI’s recursive self-improvement might not come so quickly after allwww.technologyreview.cominari@piefed.zip to Technology@lemmy.worldEnglish · 1 month agomessage-square47linkfedilink
minus-squareMangoCats@feddit.itlinkfedilinkEnglisharrow-up3arrow-down4·1 month agoA year ago they were similarly bad at writing code, often created unit tests that tested nothing, etc. If the models are trained in what they’re doing wrong, that can accelerate their progress toward doing it right.
minus-squareTrackinDaKraken@lemmy.worldlinkfedilinkEnglisharrow-up3·1 month agoI think they’ll find infinite ways to fuck up. The guardrails will never be high enough, or strong enough.
minus-squaresourdough@lemmy.worldlinkfedilinkEnglisharrow-up2·1 month agoThey would need to be trained for open ended creative tasks, which is just hard in the current reinforcement learning paradigm.
minus-squarerichmondez@lemdro.idlinkfedilinkEnglisharrow-up2·1 month agoThey still don’t get it right all the time, they just stacked a few together to filter out the obviously wrong stuff.
A year ago they were similarly bad at writing code, often created unit tests that tested nothing, etc.
If the models are trained in what they’re doing wrong, that can accelerate their progress toward doing it right.
I think they’ll find infinite ways to fuck up. The guardrails will never be high enough, or strong enough.
They would need to be trained for open ended creative tasks, which is just hard in the current reinforcement learning paradigm.
They still don’t get it right all the time, they just stacked a few together to filter out the obviously wrong stuff.