Welcome home, fellow Gator.

The Gator Nation's oldest and most active insider community
Join today!
  1. Hi there... Can you please quickly check to make sure your email address is up to date here? Just in case we need to reach out to you or you lose your password. Muchero thanks!

Military AI tried to kill its operator because it didn’t like its orders

Discussion in 'Too Hot for Swamp Gas' started by oragator1, Jun 2, 2023.

  1. oragator1

    oragator1 Hurricane Hunter Premium Member

    23,308
    5,990
    3,513
    Apr 3, 2007
    So this is fun:

    AI-controlled US military drone 'KILLS' its human operator in simulated test | Daily Mail Online
     
    • Wish I would have said that Wish I would have said that x 1
  2. WarDamnGator

    WarDamnGator GC Hall of Fame

    10,852
    1,357
    1,718
    Apr 8, 2007
    • Winner Winner x 1
  3. ncargat1

    ncargat1 VIP Member

    14,461
    6,326
    3,353
    Dec 11, 2009
    1. I don't believe a single word of that.
    2. If that actually happened, the US Air Force would NEVER let this guy go talking about it in public.
    3. It is more likely that they have an agenda to control/manipulate AI development and are using this "amusing anecdote" as proof of what could go wrong if "they" are not listened to and to manipulate some illiterate congress member like MTG or Bobo-honker to propose or support something insanely stupid, that wastes $Billions on some stupid Air Force pet projects.
     
    • Agree Agree x 2
    • Winner Winner x 1
  4. wgbgator

    wgbgator Premium Member

    30,248
    1,906
    2,218
    Apr 19, 2007
    Damn, AI is getting better at friendly fire than real troops
     
  5. ncargat1

    ncargat1 VIP Member

    14,461
    6,326
    3,353
    Dec 11, 2009
    PS...My company is a supplier to the militaries around the world directly, as well as military contractors. I know what we have to sign and agree to never, ever discuss, and we are not in the military. So, pretty sure this guy just did not haphazardly let this silly little story slip in public.
     
    • Like Like x 1
  6. tampagtr

    tampagtr VIP Member

    17,612
    2,861
    1,618
    Apr 3, 2007
    Interesting. I had not thought of that but I wonder if that's true. I must admit that what you say makes some sense.
     
  7. oragator1

    oragator1 Hurricane Hunter Premium Member

    23,308
    5,990
    3,513
    Apr 3, 2007
    I read a bit more about it, think you are right…found this. Seems he is trying to cover his tracks a bit.


    in communication with AEROSPACE - Col Hamilton admits he "mis-spoke" in his presentation at the Royal Aeronautical Society FCAS Summit and the 'rogue AI drone simulation' was a hypothetical "thought experiment" from outside the military, based on plausible scenarios and likely outcomes rather than an actual USAF real-world simulation saying: "We've never run that experiment, nor would we need to in order to realise that this is a plausible outcome". He clarifies that the USAF has not tested any weaponised AI in this way (real or simulated) and says "Despite this being a hypothetical example, this illustrates the real-world challenges posed by AI-powered capability and is why the Air Force is committed to the ethical development of AI".]
     
    • Informative Informative x 2
  8. WarDamnGator

    WarDamnGator GC Hall of Fame

    10,852
    1,357
    1,718
    Apr 8, 2007
    They already updated the story to say he “misspoke”….
     
  9. wgbgator

    wgbgator Premium Member

    30,248
    1,906
    2,218
    Apr 19, 2007
    Well, now we know its real
     
    • Funny Funny x 3
  10. sierragator

    sierragator GC Hall of Fame

    15,574
    13,302
    1,853
    Apr 8, 2007
    so when does some incel send in a robot to do the mass shooting for them?
     
  11. tampagtr

    tampagtr VIP Member

    17,612
    2,861
    1,618
    Apr 3, 2007
    Tyler Rogway (forget who here introduced me to him - thanks, great follow), talks about the fact that AI drone swarms are feared as able to overcome any defense, and that the enemy gets a vote even if we try to limit unleashing AI because of the dangers, and there are dangers.

    Great tweet

     
  12. G8trGr8t

    G8trGr8t Premium Member

    32,420
    12,161
    3,693
    Aug 26, 2008
    It was a simulation.

    AI primary goal was to score points and highest point value was destroying the air defense. That was a major programming objective error.

    When something decreased it's opportunity to score points, it used its resources to overcome the thing preventingbit from achieving its objective.
     
  13. Gatorrick22

    Gatorrick22 GC Hall of Fame

    88,960
    26,798
    4,613
    Apr 3, 2007
  14. Trickster

    Trickster VIP Member

    10,111
    2,472
    3,233
    Sep 20, 2014
    We’ll, that’s a career ending blunder
     
  15. ncargat1

    ncargat1 VIP Member

    14,461
    6,326
    3,353
    Dec 11, 2009
    Again, truly doubt that this was not fully contrived by the US Military looking to suck even more money out of the budget for only heaven knows what? The Air Force came out and quickly denied it, which makes it even more difficult to believe that they let come Colonel go rouge and discuss something that they otherwise consider secret.
     
  16. Spurffelbow833

    Spurffelbow833 GC Hall of Fame

    9,632
    767
    1,293
    Jan 9, 2009
    When the police perfect their AI designed to stand by and do nothing.