Boeing problems...

Page 30 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

itsmydamnation

Diamond Member
Feb 6, 2011
3,055
3,861
136
Please don't hold back. Give us your thoughts too!
So the easiest thing to say is in Aviation Safety everything is signed off, Every Signature is accepting liability both civil and criminal*. Are you willing to put your signature on an AI interfering with the flight controls of an aircraft?

* its not as bad as it sounds once you understand how systems engineering processes , safety and V&V work together.
 

pmv

Lifer
May 30, 2008
14,987
9,868
136
So, it's better to have unhinged pilots crashing planes than software that's designed and tested to be fail safe, but could conceivably fail?

I dunno, though, that sounds disconcertingly close to what happened with the MCAS fiasco, no?
 
  • Like
Reactions: igor_kavinski

Paratus

Lifer
Jun 4, 2004
17,538
15,607
146
So, it's better to have unhinged pilots crashing planes than software that's designed and tested to be fail safe, but could conceivably fail?

I personally wrote a lot of code for a mission critical application for the company of my employ over 2+ years. I alone wrote the code changes, surveyed and tested each release and there were many. IIRC, I never had an embarrassing or serious failure that I couldn't remedy easily and quickly. In fact, I don't remember failures at all. You don't release code that can fail, was my mantra. You test it to your satisfaction. When hundreds of lives and many millions of dollars and a major corporation's reputation are at stake, you are that much more careful and testing methodologies take center stage.
One. My issue is with the suggestion to use “AI”. Which is basically black box software in what amounts to a catastrophic hazard control. The level of software verification you’d need to do to verify it’s not going to make things worse would be extraordinary. This a generic problem with all non-deterministic software controlling hazards.

Two. We haven’t seen 787’s falling out of the sky due to whatever this is. Whatever comes out of this failure investigation, the fix should not make things worse.

Fuel cutoffs activated during takeoff is bad except when it isn’t. Someone with pilot experience could confirm but based on their central location, easily accessible by either pilot I’m sure they are part of fire response. Do you want the “AI” saying “I’m
Sorry Dave I can’t do that” when the pilot is trying to cutoff fuel to an engine that’s on fire?

Three I’m not saying a software interlock is a necessarily a bad idea if the software is deterministic and can be verified.

It’s great you write good code. In my experience almost no company does. I’ve seen several dumb software bugs that slipped through testing and could have had catastrophic consequences.

That’s why I want to see a robust software validation and verification program and an Independent Verification and a Validation software program to make sure any code changes are bullet proof.
 

sdifox

No Lifer
Sep 30, 2005
99,458
17,588
126
One. My issue is with the suggestion to use “AI”. Which is basically black box software in what amounts to a catastrophic hazard control. The level of software verification you’d need to do to verify it’s not going to make things worse would be extraordinary. This a generic problem with all non-deterministic software controlling hazards.

Two. We haven’t seen 787’s falling out of the sky due to whatever this is. Whatever comes out of this failure investigation, the fix should not make things worse.

Fuel cutoffs activated during takeoff is bad except when it isn’t. Someone with pilot experience could confirm but based on their central location, easily accessible by either pilot I’m sure they are part of fire response. Do you want the “AI” saying “I’m
Sorry Dave I can’t do that” when the pilot is trying to cutoff fuel to an engine that’s on fire?

Three I’m not saying a software interlock is a necessarily a bad idea if the software is deterministic and can be verified.

It’s great you write good code. In my experience almost no company does. I’ve seen several dumb software bugs that slipped through testing and could have had catastrophic consequences.

That’s why I want to see a robust software validation and verification program and an Independent Verification and a Validation software program to make sure any code changes are bullet proof.

Igor travels by camel. He doesn't understand planes.
 
  • Haha
Reactions: igor_kavinski

Muse

Lifer
Jul 11, 2001
40,473
9,971
136
I dunno, though, that sounds disconcertingly close to what happened with the MCAS fiasco, no?
My imagining of AI usage in this thread was quite narrow and only concerns thwarting pilot initiated fuel shut off to both engines when the plane could not fail to crash if fuel is shut off to both engines, i.e. at quite low altitude and velocity. MCAS is entirely different.
 

hal2kilo

Lifer
Feb 24, 2009
25,703
12,033
136
One. My issue is with the suggestion to use “AI”. Which is basically black box software in what amounts to a catastrophic hazard control. The level of software verification you’d need to do to verify it’s not going to make things worse would be extraordinary. This a generic problem with all non-deterministic software controlling hazards.

Two. We haven’t seen 787’s falling out of the sky due to whatever this is. Whatever comes out of this failure investigation, the fix should not make things worse.

Fuel cutoffs activated during takeoff is bad except when it isn’t. Someone with pilot experience could confirm but based on their central location, easily accessible by either pilot I’m sure they are part of fire response. Do you want the “AI” saying “I’m
Sorry Dave I can’t do that” when the pilot is trying to cutoff fuel to an engine that’s on fire?

Three I’m not saying a software interlock is a necessarily a bad idea if the software is deterministic and can be verified.

It’s great you write good code. In my experience almost no company does. I’ve seen several dumb software bugs that slipped through testing and could have had catastrophic consequences.

That’s why I want to see a robust software validation and verification program and an Independent Verification and a Validation software program to make sure any code changes are bullet proof.
In my experience in the process of fixing a software problem, another problem is created sometimes. Validation and extensive testing of new versions is always required.
The last system generation change I was involved with, had new requirements by the government to send our processors to some outfit that spent a lot of time looking for embedded spyware/malware. It took forever to get out gear back to meet our schedule.
 
  • Like
Reactions: igor_kavinski
Jul 27, 2020
26,453
18,187
146

Vishwash's family said he is still haunted by nightmares where he sees 'everyone die.' He is reportedly wracked with guilt as he faces the reality of being the only person out of 242 passengers and crew to survive the crash after the jetliner slammed into the ground and burst into flames. He struggles to sleep at night, according to a member of his extended family, Krunal Keshave, 24, from Leicester.

'He sleeps but doesn't sleep properly. When he sleeps, he dreams he is on the flight. He remembers seeing everyone die in front of his eyes.' The miracle survivor previously said he feels 'terrible' he could not save his brother Ajay, 35, and feels tormented with guilt over his death. The pair ran a fishing business in Diu, India and would live there during the fishing season - which begins in September and ends in May - then would return to Leicester for the off-season.

'He sees him everywhere...He speaks but he doesn't speak about the crash. He is currently trying to have a normal life, but he is not going out too much. He is spending time at home with the family. He was living in the house in Diu with his brother before the crash,' Krunal told The Sunday Times . Another relative said: 'He feels guilty that he is the only one to have lived when everybody else, including his brother, died. It's a lot to live with.'

The 40-year-old told The Sun : 'It's a miracle I survived. I am OK physically but I feel terrible that I could not save Ajay.' Vishwash had tried to book two seats next to each other on flight AI171, which crashed into a densely populated part of the city of Ahmedabad shortly after takeoff. But by the time he came to make the reservation, he was forced to pick two seats apart from each other in row 11.

Vishwash said: 'If we had been sat together we both might have survived. 'I tried to get two seats together but someone had already got one. Me and Ajay would have been sitting together. 'But I lost my brother in front of my eyes. So now I am constantly thinking 'Why can't I save my brother?'