by D S Kane
* * *
At her apartment while she dressed for her first class of the day, Ann heard Laura in the bathroom. The door opened. Seeing Laura’s smile, Ann said, “You look happier than I’ve ever seen you.”
“Yeah. I had my first date in months.”
Ann remembered Dave asking about Laura. “Nordman?”
“How’d you know?”
Ann chuckled. “He asked me if he could take you to dinner. As if I was your mother!”
Laura cocked her head. “Really? I guess he really is geeky. But he made me feel happy.”
“Well, good luck. He’s bright and I think he has a good future ahead of him.”
Laura literally danced back into the bedroom to get dressed.
Ann returned her attention to Dave’s report and thought, this might actually work. She replied to Dave, remember to place safeguards on the thoughts and behavior that your AI can develop. We need an “ethics” module.
While she sipped a cup of coffee, Dave sent her back a text: Well, duh!
Ann’s misgivings faded. She placed her notebook computer in her backpack and headed off to the apartment building’s elevator. She felt happy about the team’s potential and their progress, but still had nagging doubts about what the team’s efforts would produce. Can a morality module really fix the potential an AI has to harm humanity?
CHAPTER 15
DARPA Headquarters,
Strategic Technology Office (STO),
675 North Randolph Street, Arlington, VA
September 30, 8:49 a.m.
Dr. Linda Beam parked her car in the DARPA parking structure and passed through the security gate of STO, DARPA’s Strategic Technology Office. Just last week she had finally been promoted to DARPA project manager at age twenty-eight, the average age for her position. At five-foot six, she was also average height for female DARPA employees, and the average intelligence for her position, and, she thought, not especially attractive. Average in every way. The very thought of her averageness left her unhappy as she bought a cup of coffee and a doughnut in the lobby and took the elevator to the fifth floor.
After walking through the warren of cubicles and narrow pathways on her floor of the building, she found hers. A poster of Lake Como hung on the cubicle’s fabric wall. It was a place she’d never been to and wasn’t particularly interested in visiting, but the poster was vibrant and, she believed, capable of provoking visitors into believing she had non-average dreams. Other than that, there was nothing to indicate her personality or what she wanted from her job or her life.
But this promotion might change her life. Tomorrow she would move from cubicle hell to a tiny office, one of the few perks of her promotion.
She sat at her desk watching the clock that would count down until the deadline for teams to apply for the AI Competition. Under one minute now left. As the seconds passed and the alarm on her watch buzzed, she sighed. Finally. Let me see how much work I’ve gotten myself into. Ninety-two teams are enrolled. The first deadline is in two weeks, and then a string of them every few days until December 1, when the competition ends.
She reviewed the completed team applications. Thirty-two teams staffed by startup companies, fifty from universities, and ten from publicly held tech corps. She examined the details for each team and guessed that only half would participate to the end and fewer than one-third would achieve any palpable result. Of the ninety-two entrants, she estimated sixteen might achieve a satisfactory result over the next two months.
Based on past contests, she thought, I’ll need four judges for about two months to judge the sixteen semifinalists.
She wrote a memo to DARPA’s STO management requesting staff time from four senior project managers.
* * *
Ann and Dave sat at the desk in his dorm room and stared at a summary of his team-leader status reports displayed on his notebook computer’s screen.
Ann said, “I see the problem. Do you have any ideas about how to fix it?”
Dave shook his head. “Not yet. But there are a few workaround tactics that might help.”
Ann nodded. “Like?”
“We could just comment out the ethics module until we can get it to work properly. Meanwhile, we can construct a list of situations that require ethical judgement and review the parameters of choices for each one. If we group them by similar characteristics, like severity, impact, or any other characteristic you can imagine, then we can come up with a set of general guidelines from which to form the rules.”
“I guess that might be a start.” But Ann wasn’t sure how the process would work. “Let me think about this and get back to you later today.”
Dave said, “Okay. But the hard part will be prioritizing which rule takes effect when there are two or more outcomes that have alternatives in conflict with each other. For example, a simple case is, suppose a runaway train is about to run into and kill five innocent people on the track, but you are in a position to act quickly and switch the train to another track, where only one person on the track would die. Would you do nothing and allow five to die, or actively steer the train to kill one innocent person? There are a whole set of similar cases, and some of them are quite complex.”
Ann shuddered at the thought of having a machine make this type of judgement. “Who on your team will be handling the input for the tables?”
“That’s up to us. We already have the Tensor tables ready to collect what we input. But as to the judgements, I haven’t assigned anyone yet.”
Ann reviewed the staff under Dave’s management. She thought Sandra Elmont, the only woman on the tech team, might be a voice of empathetic reason, but then immediately realized this was her own preconception. “Let me think about this for a few days. How much time do I have?”
Dave shrugged. “Maybe a day. More likely a few hours. There’s a ton of data we’ll have to enter. So get back to me fast and I’ll get it started. Oh, and I also have a general status report for you.”
Ann rose and paced Dave’s room. “Give it.”
“Walter Graves’s group has produced a final form of the systems flow chart,” Dave said. “All the screens detailing the processing of the giant AI mind had been buried by the analysts below the overall flow chart. Walter is fixing that. The revised screens will be at the top level of the flow chart, making it easier to understand and debug. It might at first look way too complex, but it’s complete and workable.
“Gary McHahn’s group completed a prototype of the AI’s functioning in Python. It looks like it might work, but McHahn reported there are several major bugs in the code, and they still need to be fixed. He estimates it might take a few days until his prelim work is complete.” Dave stared at Ann until she nodded.
“Okay then. Stuart Ley’s group has started on C++ programs to develop a settings module. When I attempted to run it, it worked perfectly. His status report says that their next step is to flesh out the data-entry module in JavaScript that records the settings for the AI into a final form. He claims it’ll take about a week to complete. They plan to test both modules in tandem.”
Dave paused just a moment before continuing. “Sandra Elmont’s Tensor specialists placed each piece of event code into a framework, but they are still missing the data segments. Elmont and Ley would need to fit their modules together and then test them. This will be the first time two of my groups have needed to work together.” Ann nodded again.
“Then, there’s Harry Schofield’s database management group. Harry outlined the data dictionary and showed me a preliminary design for organizing the data population. When he’s done that, Harry and Sandra will need to make sure their pieces work together, hand in glove.”
Dave made a quick mental calculation. “I figure the entire process is about ten percent complete.”
He walked to the whiteboard in his dorm room and drew a top-level system flowchart of the AI. He watched Ann study it.
She smiled. “Good work. Thanks.”
* * *
* * *
Michael Drapoff opened the door to the interrogation room. William and Betsy both looked up.
“We’re vetted the data on the thumb-drive. Sorry it took so long. Looks like you’ve netted a gold mine. And, you’re correct. The Russians will be hunting you. We’ll need to hide you two in one of the safe houses we have in Tel Aviv. I’ll take you now.”
William shrugged. He took Betsy’s hand and the three walked to the elevator. “How many guards?”
“We’ll give you three to start off. We’re also monitoring the Kremlin to see their reaction. They usually just kill anyone they think may be a problem, so if we see anything bad coming your way, we’ll rush reinforcements to you.”
Betsy stared incredulously at Michael. “Reaction? Like they’re gonna fucking wanna buy us from you? Listen, Michael, they want us dead. We expected this, but we didn’t think you’d need us for follow-up assignment where we are the bait.”
Now, Michael shrugged. “Spies lie. We’ll lie when they ask us to confirm. And they’ll know it. You guys know how the game is played.”
“To you, it may be a game, but for us, it’s no game.” Betsy cast her eyes at the floor of the moving elevator. “Fuck us.”
The doors opened and Michael led them through the garage to a black SUV. There were three very large men waiting there. Now six, the group loaded into the SUV, with William and Betsy in the middle back seats.
William heard the engine fire, then watched through the dark tinted windows as the SUV left the garage and headed toward the highway. He thought, Dicey. I wonder if the Russians stationed in Israel have received their orders to kill us just yet?
* * *
Glen closed his notebook as his afternoon class ended. He walked with the other students from the classroom. On his way down the stairs he saw Dave Nordman climbing the stairs. He’d seen Dave and Ann conversing before and had taken the time to research every one of Ann’s team profiles. Glen smiled and caught Dave’s attention. “Hi, Dave. I’m Glen. I’m sure Ann told you about me. How’s the DARPA project coming along?”
Nordman didn’t return the smile, but he moved out of the way of the traveling students. When Glen also moved out of the traffic, Dave shrugged. “The contest is a hell of a lot more work than I’d imagined. How did you do it last year and what made you believe it would be cool to try in again?”
“Last year, the startup was a new challenge. This year, none of the challenges was unexpected for us. Been there, done that, as they say. And remember Murphy’s Law. For this contest, I think that law will hit us harder, because DARPA set all the deadlines.” He pointed down the hall. “Want my advice?”
They walked into an empty classroom.
“First, tell me your team’s status. Then I’ll give you hints as to the obstacles on your horizon.”
Dave wondered if he was about to agree to a nasty deal with a nasty enemy. “Really, now? Why would you want to help me?”
“Because I still feel bad about what happened between Ann and me last year. You know.”
Dave nodded. But can I believe anything Glen said? I might as well play along until I understand the parameters of this situation. Then he suppressed a giggle as he realized this would be a version of the ethics module’s decision-making for the AI his team was coding. Life following art.
CHAPTER 16
Ainsley/Sashakovich House,
220 Kirke Street, Chevy Chase, Maryland
September 30, 6:11 p.m.
Cassandra Sashakovich looked around the kitchen. She thought, this house is too empty. Way too big for just two people. But, the dining-room table where she and Lee sat was set for just the two of them.
She cut a slice of pork chop and chewed it while she thought about Lee’s question. “Well, if we have to decide whether we trust the folks at DARPA, the answer right now would be to look at their past performance. Our government never treated me with fairness. And, they tried to kill both of us numerous times. The question would then become, how much is DARPA like the rest of government? After all, spies are trained in disseminating disinformation. Lies. When we were spies, we constantly lied. And when spies lie to elected officials, those officials lie to voters like us. I hate to see Ann playing with this monster.”
Lee swallowed a sip of the cherry-colored Monterey County Pinot and shook his head. “I’ve worked with DARPA and my own experiences are mixed. They’re one of the most honest of the Fed’s agencies, but these days they seem to have grown ever more blatant about designing war tools. Of course, that’s not what they tell us.”
“So, then, what would happen to Ann’s prospects for a normal life if her team successfully completes their DARPA contest entry? Will the Fed foreclose any other job alternatives for her? Will they force her to work for them?”
Lee nodded. “Yes, I think they might, especially if she wins. I don’t trust either DARPA or Ann to make mature decisions. And we both know Ann doesn’t trust authority figures. Even us. It would be better if we could spend a few months with her while she finishes the contest. But both of us have exhausted all our vacation and paid time off. If we take off time without pay, the government will become suspicious. So, we’ll need a surrogate to watch her if that’s what you agree we should do.”
Cassie shrugged. She could see that Lee had already decided. “William and Betsy aren’t available. Jon sent them out on assignment and they’ll be gone for months. Who else is there to be a sounding board for her and act as a bodyguard if things start to go south?”
Lee sat in silent thought. “Sommers.”
“But Jon lives in Manhattan, 2,500 miles away from Palo Alto and Ann. And Jon has a full-time job running the UN paramilitary force. Is it even possible for us to get him to do this for us?”
“Only one way to find out.” Lee pulled his cellphone from his pocket and punched in a number. He turned on the phone’s speaker.
“Sommers.”
“It’s Lee and Cassie. We need a favor. From you or someone you trust. We have an issue with Ann and need someone she trusts to be her bodyguard and mentor in California.”
Sommers’ laugh came through the speaker. “Ann trusts no one. Certainly not me. But she does owe me one and I can’t tell you what it’s for. This place is driving me crazy with diplomatic doublespeak. I need a vacation, and, oh yes, it looks like I’ve accumulated nearly two months. So right, then, I’ll babysit your daughter.”
Cassie smiled at Lee. “Thanks, Jon. Now we owe you one too.”
After the conversation ended, Lee said, “We should speak with Ann right now. We’ll need to ask her permission to do what Jon has just agreed to do. Let’s make a plan.”
Cassie nodded. “Deviousness is our best talent, love.”
Suddenly, the overly spacious house didn’t feel quite as big to Cassie.
* * *
William wasn’t quite sure he’d heard what Michael Drapoff had just said. “You want us to do what?”
Michael repeated his plan more slowly. “I want you two to walk out from Mossad ‘s headquarters building through the front entrance and hail a taxi. Take it to the hotel we’ll book for you. Then wait there. We’ll have you under close surveillance.”
Betsy’s reaction was far more volatile. She shouted, “Absolutely not!”
Michael shrugged. “I expected you to say no. But, in order to make sure the Mossad’s plan works, we’ll need to effect this little charade.”
William leaned forward in his chair in the safe house. “We’ve been here for a few days now, and you want us to simply walk out onto the street, alone, and see who catches us. The Russians will kill us, maybe interrogating us first, or maybe just drivin
g by. The Chinese would interrogate and torture us. Either way, we’ll die. Why the fuck would we want to do this?”
“William, we’ll be with you every step of the way, and we’ll stop it before it gets dangerous.”
“You can’t guarantee that you can save our lives.” Betsy shook her head. “You’re fucking batshit crazy.”
Michael sighed. “Both the Russians and the Chinese are developing weaponized AIs, but we don’t know how far along any of them are. There are multiple players, all of them holding their cards closely. If we can capture any of their operatives, we can get information from them using chemical interrogations. You would be heroes. And, we have new tech that uses an undetectable tracker and also channels what you see and hear directly back to us. A new version of Bug-Lok. We’ll be less than fifty meters behind you. We’ll have snipers riding the roofs of buses, keeping you in range. And, after you have delivered the message and they send it back to their handlers, we’ll engage.”
William looked at Betsy. She shrugged. William faced Michael. “So help me, Michael, if you let us die, we’ll become golems and haunt you for the rest of your life.”
Michael took a deep breath. “The state of Israel owes you a great debt.”
Betsy said, “And you’d better pay it in cash.”
* * *
Dave Nordman smiled at Glen. “Our team is close to achieving the prime objective. My guess is we’ll be at the finish line before the week’s end.”
Glen felt a weakness in his entire body trunk. “Really?”
“Yeah. Listen, Glen, it’s been nice, but I’ll be late for my next class if I don’t get going now.” Dave waved once and descended the stairs.
Glen found a relatively empty corner of one of the snack rooms. He sat at a desk and sent a text to his Russian handler, containing details of the brief conversation he’d just had with Dave. Then Glen waited.