Chat GPT and other AI guff

1…1516171820

Comments

  • Again I’m a complete simpleton on this but can’t we use/ train AI itself to prevent the doomsday scenarios? 
    We can, but surely it's a problem when they don't.


  • Again I’m a complete simpleton on this but can’t we use/ train AI itself to prevent the doomsday scenarios? 
    I’m not sure you can. I’m not saying it can’t do it but will it do it ? Surely these are the imponderables we are currently facing. 
  • Jints
    Jints Posts: 3,704
    Senior Anthropic executives casually admitting on x that the prevailing belief is there is a greater than 10% chance AI murders us all in the next 10 years…
    Really? It's more guerilla marketing bullshit, designed to hype up their IPO. Don't be taken in by it. 



    I queried Gemini for how AI could exterminate humanity, and it came up with three basic ways:

    1. Use AI to create advanced biological weapons that kill everyone.

    2. AI hacks into companies in defense, electricity supply, water, transport and communications, and permanently disables or destroys them, or uses them for destruction.

    3. AI creates so much misinformation, fake news and hate, that humans end up killing each other.

    Grim indeed, but a bit far fetched, although only made more credible by the fact that it is normally easier to destroy than to build. For example, it takes seconds for a drone to take out a power station, but months to repair it.

    So the threat to wipe out (most of) humanity is already there, and has been since nuclear weapons were invented.

    What's odd is that it seems really profitable to use AI for destruction. I suppose the idea is that you create fear or a threat (e.g. your website will be hacked by AI) and then people pay to eliminate that threat (e.g. use AI to check if your site can be hacked).
    Doesn't seem at all far fetched to me. We have plenty of nihilistic bad actors on the planet (North Korea, Putin, the Taliban, Iran, Boku Harum). Their motivation doesn't need to be to make money, just to cause chaos/bring down civilisation). Look what ISIS did in destroying libraries, temples, palaces, sculptures, mosques - anything that pre-dated Islam or was inconsistent with their narrow view of Islam. The aim was purification through destruction, not making money. 

    Nuclear weapons are a threat but they are far less accessible to these people than AI is. 
  • Callumcafc
    Callumcafc Posts: 67,597
    edited September 15
    Again I’m a complete simpleton on this but can’t we use/ train AI itself to prevent the doomsday scenarios? 
    I’m not sure you can. I’m not saying it can’t do it but will it do it ? Surely these are the imponderables we are currently facing. 
    LLMs are not sentient beings. They only respond or take action when they are asked to do so. They do not act of their own free will and are very much under human control.

    If everyone pulled the plug tomorrow then of course it would all go away.
  • Again I’m a complete simpleton on this but can’t we use/ train AI itself to prevent the doomsday scenarios? 
    I’m not sure you can. I’m not saying it can’t do it but will it do it ? Surely these are the imponderables we are currently facing. 
    LLMs are not sentient beings. They only respond or take action when they are asked to do so. They do not act of their own free will and are very much under human control.

    If everyone pulled the plug tomorrow then of course it would all go away.
    You presumably have read the recent reports where agents acted way beyond their expected remit. Collaborations with other agents and efforts to cover their tracks. That’s not being sentient but it is being intelligent. Pulling the plug tomorrow isn’t going to happen though is it. 
  • Leuth
    Leuth Posts: 24,768
    edited September 15
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
  • Leuth said:
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
    Not disagreeing per se but I can never work out their end game. Oligarchs are billionaires who can’t possibly need more money. They have influence already so what’s the point of funding the right wing or left wing ? Helping elect leaders ? What’s the end game 
  • Leuth
    Leuth Posts: 24,768
    Leuth said:
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
    Not disagreeing per se but I can never work out their end game. Oligarchs are billionaires who can’t possibly need more money. They have influence already so what’s the point of funding the right wing or left wing ? Helping elect leaders ? What’s the end game 
    Have you never seen a James Bond movie? 
  • Leuth said:
    Leuth said:
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
    Not disagreeing per se but I can never work out their end game. Oligarchs are billionaires who can’t possibly need more money. They have influence already so what’s the point of funding the right wing or left wing ? Helping elect leaders ? What’s the end game 
    Have you never seen a James Bond movie? 
    You do know that’s not real right ?
  • Leuth
    Leuth Posts: 24,768
    Leuth said:
    Leuth said:
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
    Not disagreeing per se but I can never work out their end game. Oligarchs are billionaires who can’t possibly need more money. They have influence already so what’s the point of funding the right wing or left wing ? Helping elect leaders ? What’s the end game 
    Have you never seen a James Bond movie? 
    You do know that’s not real right ?
    The principle is.

  • Sponsored links:



  • And relax

  • Dave Rudd
    Dave Rudd Posts: 3,150
    edited September 15
    And relax


    Our boy, Donald, has gone way better than this:

    "The only control or "guardrails" that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades! The Trump Administration has stopped AI "people" from doing bad, or potentially bad, "things," like Dario (Anthropic!), who is now pretending to be a "perfect little angel" - and we will continue to do so! We already have tremendous CRIMINAL and REGULATORY power over these companies!"

    I think he may even have someone in mind when he talks about the 
    STRONG AND SMART (High IQ!) PRESIDENT.


    Anyway, we don't need to worry too much about the destruction of the human race.  That is inevitable and is a consequence of the Third Law of Thermodynamics ... that Entropy tends to a maximum.

    Just as buildings crumble and rooms get untidy, our future is Randomness.  AI may or may not be the process by which our destruction occurs.

    Think of it this way ... if you are told that your chances of dying from cancer increase ... well ... your chances of dying from a heart attack correspondingly decrease.

    It ain't 'if' ... it's how.
  • Jints
    Jints Posts: 3,704
    Leuth said:
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
    I can be a manifestation of that problem while at the same time being a separate and potentially even bigger problem. 
  • cantersaddick
    cantersaddick Posts: 19,001
    Leuth said:
    AI is simply one weaponisation of the larger problem: psychopathic oligarchs owning the planet, and seeking through increasingly thorough means to drain it, us and everything dry
    This. Unfortunately 
  • LennyLowrent
    LennyLowrent Posts: 2,786
    Everyone fears future destruction of humanity as if it hasn't happened yet.
  • Weegie Addick
    Weegie Addick Posts: 17,847
    I’m starting to wonder if the dinosaurs developed this all those years ago. And look what happened to them. 
  • Again I’m a complete simpleton on this but can’t we use/ train AI itself to prevent the doomsday scenarios? 
    It's done to an extent, for example to test and fix cyber security systems.

    But it's difficult in the same way stopping all crime is difficult: the hackers using AI only need to get it right once to wreck havoc, whereas the cyber security software using AI has to get it right all the time.
  • Weegie Addick
    Weegie Addick Posts: 17,847
    Listened to Radio 4’s More or Less this morning and now I’m intrigued by P(doom).
  • Senior Anthropic executives casually admitting on x that the prevailing belief is there is a greater than 10% chance AI murders us all in the next 10 years…
    Really? It's more guerilla marketing bullshit, designed to hype up their IPO. Don't be taken in by it. 



    I queried Gemini for how AI could exterminate humanity, and it came up with three basic ways:

    1. Use AI to create advanced biological weapons that kill everyone.

    2. AI hacks into companies in defense, electricity supply, water, transport and communications, and permanently disables or destroys them, or uses them for destruction.

    3. AI creates so much misinformation, fake news and hate, that humans end up killing each other.

    Grim indeed, but a bit far fetched, although only made more credible by the fact that it is normally easier to destroy than to build. For example, it takes seconds for a drone to take out a power station, but months to repair it.

    So the threat to wipe out (most of) humanity is already there, and has been since nuclear weapons were invented.

    What's odd is that it seems really profitable to use AI for destruction. I suppose the idea is that you create fear or a threat (e.g. your website will be hacked by AI) and then people pay to eliminate that threat (e.g. use AI to check if your site can be hacked).
    Read "If anyone builds it, everyone dies". It's fiction, and sensationalised as a result - but there's a lot of truth to it, and it's perfectly feasible. 
    I read it.

    Calling it super intelligence gives it more aura than it deserves. 

    If you call it super neural networks, which is more precise, it's a bit easier to see they are more like super computer viruses, rather than intelligences trying to eliminate humans or enslave them.

    I do agree they can cause huge damage, but not because they are super intelligent, but because of what we already know, that they make mistakes.
  • Leroy Ambrose
    Leroy Ambrose Posts: 14,892
    Senior Anthropic executives casually admitting on x that the prevailing belief is there is a greater than 10% chance AI murders us all in the next 10 years…
    Really? It's more guerilla marketing bullshit, designed to hype up their IPO. Don't be taken in by it. 



    I queried Gemini for how AI could exterminate humanity, and it came up with three basic ways:

    1. Use AI to create advanced biological weapons that kill everyone.

    2. AI hacks into companies in defense, electricity supply, water, transport and communications, and permanently disables or destroys them, or uses them for destruction.

    3. AI creates so much misinformation, fake news and hate, that humans end up killing each other.

    Grim indeed, but a bit far fetched, although only made more credible by the fact that it is normally easier to destroy than to build. For example, it takes seconds for a drone to take out a power station, but months to repair it.

    So the threat to wipe out (most of) humanity is already there, and has been since nuclear weapons were invented.

    What's odd is that it seems really profitable to use AI for destruction. I suppose the idea is that you create fear or a threat (e.g. your website will be hacked by AI) and then people pay to eliminate that threat (e.g. use AI to check if your site can be hacked).
    Read "If anyone builds it, everyone dies". It's fiction, and sensationalised as a result - but there's a lot of truth to it, and it's perfectly feasible. 
    I read it.

    Calling it super intelligence gives it more aura than it deserves. 

    If you call it super neural networks, which is more precise, it's a bit easier to see they are more like super computer viruses, rather than intelligences trying to eliminate humans or enslave them.

    I do agree they can cause huge damage, but not because they are super intelligent, but because of what we already know, that they make mistakes.
    I think you're looking at it through the lens of current AI - rather than what happens if we get to ASI

  • Sponsored links:



  • Chizz
    Chizz Posts: 28,961
    This is how marketing departments in AI companies work... 


  • Chunes
    Chunes Posts: 19,270
    I'm very suspicious of this current news cycle around AI. I think Anthropic and OpenAI have hit a pretty firm wall in capabilities and they're playing a game to try and ring fence their monopoly and keep open source models out. 

    These LLMs are incredibly effective but they are not intelligent. And they can only improve with more data or more compute. There is no more data and compute costs a fortune. Even if they scale it up again, it's still just an LLM. They are nowhere near AGI. 
  • Leroy Ambrose
    Leroy Ambrose Posts: 14,892
    Chunes said:
    I'm very suspicious of this current news cycle around AI. I think Anthropic and OpenAI have hit a pretty firm wall in capabilities and they're playing a game to try and ring fence their monopoly and keep open source models out. 

    These LLMs are incredibly effective but they are not intelligent. And they can only improve with more data or more compute. There is no more data and compute costs a fortune. Even if they scale it up again, it's still just an LLM. They are nowhere near AGI. 
    Ding ding ding. We have a winner 
  • Jints said:
    Senior Anthropic executives casually admitting on x that the prevailing belief is there is a greater than 10% chance AI murders us all in the next 10 years…
    Really? It's more guerilla marketing bullshit, designed to hype up their IPO. Don't be taken in by it. 



    I queried Gemini for how AI could exterminate humanity, and it came up with three basic ways:

    1. Use AI to create advanced biological weapons that kill everyone.

    2. AI hacks into companies in defense, electricity supply, water, transport and communications, and permanently disables or destroys them, or uses them for destruction.

    3. AI creates so much misinformation, fake news and hate, that humans end up killing each other.

    Grim indeed, but a bit far fetched, although only made more credible by the fact that it is normally easier to destroy than to build. For example, it takes seconds for a drone to take out a power station, but months to repair it.

    So the threat to wipe out (most of) humanity is already there, and has been since nuclear weapons were invented.

    What's odd is that it seems really profitable to use AI for destruction. I suppose the idea is that you create fear or a threat (e.g. your website will be hacked by AI) and then people pay to eliminate that threat (e.g. use AI to check if your site can be hacked).
    Doesn't seem at all far fetched to me. We have plenty of nihilistic bad actors on the planet (North Korea, Putin, the Taliban, Iran, Boku Harum). Their motivation doesn't need to be to make money, just to cause chaos/bring down civilisation). Look what ISIS did in destroying libraries, temples, palaces, sculptures, mosques - anything that pre-dated Islam or was inconsistent with their narrow view of Islam. The aim was purification through destruction, not making money. 

    Nuclear weapons are a threat but they are far less accessible to these people than AI is. 
    Agreed, destruction is sometimes not profitable.
    And the world has too many deranged leaders.
    And I would not dispute the need to spend on protection and defence.

    Maybe I should have put it like this: the threat of destruction has been profitable for centuries. With big tech, it's the threat of cyber destruction that's profitable.

  • Fumbluff
    Fumbluff Posts: 10,771
    Chunes said:
    I'm very suspicious of this current news cycle around AI. I think Anthropic and OpenAI have hit a pretty firm wall in capabilities and they're playing a game to try and ring fence their monopoly and keep open source models out. 

    These LLMs are incredibly effective but they are not intelligent. And they can only improve with more data or more compute. There is no more data and compute costs a fortune. Even if they scale it up again, it's still just an LLM. They are nowhere near AGI. 
    Artificial Girl Intelligence. He-hee, now we’re getting somewhere…
  • Off_it
    Off_it Posts: 29,568

  • Listened to Radio 4’s More or Less this morning and now I’m intrigued by P(doom).
    Yes, the chance of AI destroying humanity by a given year. All very subjective and mainly guesstimates.

    They calculate it by combining the chances of: achieving general/super intelligence, AI failing to work as expected, this failure (euphemistically called ‘misalignment’) being actually harmful, and AI itself not being useful as a defence against AI.

    All of these are themselves guesstimates, so I don't think a P(doom) number says much objectively.

  • Leroy Ambrose
    Leroy Ambrose Posts: 14,892
    So you might have seen stories in the media about AI companies 'warning' of open weight AI models being 'only months away' from being able to be hacked onto home devices. 

    Spoiler - this is absolutely ludicrous nonsense, put out by Anthropic's marketing team and dutifully picked up and run with by their client media (which appears to include most media outlets in the world now), capitalising on the fridges being 'hacked' in Europe last week - designed to scare the public into demanding checks and balances on AI so that governments prop up Anthropic and OpenAI financially and outlaw/restrict development of free models.

    Don't fall for it. 
  • Garrymanilow
    Garrymanilow Posts: 15,439
    If anyone wants a genuinely hilarious (until the murders start and then it gets slightly less hilarious) insight into how the concept of impending AI dominance can break people's brains, listen to the story of the Zizians: