“Naturally, you should have the prototype presentable ASAP,” the Marketing VP says. “We need a pretty face for the ads, and we need her to have her personality installed by then. Aesthetics seems to think it’s already in place, in some form?”
The VP’s face is just bland enough not to mean anything by it, if their consciences don’t get the better of them.
Don’t you dare, Mason thinks, don’t you dare tell them for a chance to keep her, second-gen or not, it’s a trap, not one word, think about what will happen to her.
(She’s still a doll, he thinks, deeper, ruthlessly; something will happen to her eventually.)
“I don’t know a thing about the particulars, I’m afraid,” Paul says, and having thus absolved himself he throws a casual look at Mason.
Mason thinks, You asshole. He thinks, Here’s where I rat him out.
He grits his teeth and smiles.
“We’ve been running tests,” he says. “Would you like to see Galatea?” Then, in his best Paul impression, “She has a crush on Paul, of course.”
The Marketing guys laugh, and Mason pulls up Galatea on his pad, and as the lights go down he catches Paul glancing gratefully in his direction.
He hates how strange it feels to have someone be grateful to him; he hates that it’s Paul.
Paul walks out with the Marketing guys, grinning and charming and empty, and from the plans they’re making for the announcement and the new projects they’re already asking him about, Mason suspects that’s the last time he’ll ever see Paul.
It’s so lonely in his office he thinks about turning on Galatea, just for company.
(He’s no better than some.)
LiveScribe: MORI PRESS CONFERENCE—VESTIGE, PT 1.
SEARCH PARAMETERS—BEGIN: 10:05:27, END: 10:08:43
PAUL WHITCOVER: From the company that brought you Memento, which has not only pioneered the Alpha series real-time response interface, but has also brought comfort to grieving families across the world.
It’s this focus on the humanity behind the technology that is Mori’s greatest achievement, and it is what has made possible what I am about to show you. Ladies and gentlemen, may I present: Galatea.
[MORIVESTIGE00001.img available through LiveSketch link]
[APPLAUSE, CALLS, SHOUTS]
PAUL WHITCOVER: Galatea isn’t human, but she’s the nearest thing. She’s the prototype of our Vestige model, which shifts the paradigm of robotics in ways we have only begun to guess—if you can tear your eyes away from her long enough.
[LAUGHTER, APPLAUSE]
PAUL WHITCOVER: Each Vestige features critical-thinking initiatives so advanced it not only sustains the initial personality, but allows the processor to learn from new stimuli, to form attachments—to grow in the same way the human mind does. This Vestige is built on a donor actress—anonymous, for now, though I suspect some in the audience will know who she is as soon as you talk to her.
[LAUGHTER]
In seriousness, I would like to honor everyone at Mori who participated in the development of such a remarkable thing. The stock market will tell you that this is an achievement of great technical merit, and that’s true. However, those who have honored loved ones with a Memento doll will tell you that this is a triumph over the grieving heart, and it’s this that means the most to Mori.
Understandably, due to the difficulty of crafting each doll, the Vestige is a very limited product. However, our engineers are already developing alternate uses for this technology that you will soon see more of—and that might yet change your world.
Ladies and gentlemen, thank you so much for being here today. It is not only my honor, but my privilege.
[APPLAUSE]
Small-group interviews with Vestige will be offered to members of the press. Check your entrance ticket. Thank you again, everyone, really, this is such a thrill, I’m glad you could be here. If you’d—
The phone call comes from some internal extension he’s never seen, but he’s too distracted by the streaming press-conference footage to screen it.
Paul is made for television; he can practically see the HR people arranging for his transfer to Public Relations.
(He can’t believe Paul carried through with Nadia the Aesthetic Consultant. He can absolutely believe Paul named her Galatea.)
“This is Mason.”
There’s nothing on the other end, but he knows it’s her.
He hangs up, runs for the elevator.
Nadia’s on the floor in the library, twitching like she got fifty thousand volts, and he drops to his knees and pulls the connecting cable out of her skull.
“We have to get you to a hospital,” he says, which is the stupidest thing that’s ever come out of his mouth (he watches too many movies). What she needs is an antivirus screen in one of the SysTech labs.
Maybe it’s for her sake he says it, so they can keep pretending she’s real until she tells him otherwise.
“It’s the baseline,” she says, and he can’t imagine what she was doing in there.
He says, “I’ll get you to an Anti-V, hang on.”
“No,” she manages.
Then her eyes go blank and flat, and something inside her makes an awful little click.
He scoops her up without thinking, moves to the elevator as fast as he can.
He has to get her home.
He makes it in seven minutes (he’ll be paying a lot of tickets later), carries her through the loft. She’s stopped twitching, and he doesn’t know if that’s better or worse.
He assumes she’s tougher than she looks—God knows how many upgrades Paul’s put her through—but you never know. She’s light enough in his arms that he wonders how she was ever expected to last.
He sets her on one of the chaises the Mori designer insisted mimicked the lines of the living room, drags it through the doorway to his study.
He finds the socket (behind one ear), the same place as Memento; rich people don’t care for visible flaws.
He plugs her into his program.
It feels slimy, like he’s showing her into his bedroom, but at least Mori won’t monitor the process.
Her head is limp, her eyes half-lidded and unseeing.
“Hold on,” he says, like some asshole, pulls up his program.
(Now he’s sorry he deleted her avatar; he could help her faster if he had any framework ready to go.)
The code scans. Some of it is over his head—some parts of her baseline Paul got from the black market. (Black-market programmers can do amazing work. If he gets out of this alive, he might join up with them.)
He recognizes a few lines of his own code that have integrated, feels prouder than he should.
He recognizes some ID stamps that make his whole chest go tight, and his eyes ache.
Paul’s an idiot, he thinks, wants to punch something.
Then he sees the first corruption, and his work begins.
He’s never worked with a whole system. It’s always been lines of code sent to points unknown; Galatea was the first time he’d worked with anything close to a final product.
Now Nadia is staring at the ceiling with those awful empty eyes, and his fingers shake.
If he thinks of this as surgery he’s going to be ill. He turns so he can’t see her.
After a while he hits a stride; it takes him back to being twelve, recreating their apartment in a few thousand lines of code, down to the squeak in the hall.
(“That’s very . . . specific,” his mother said, and that was when he began to suspect his imagination was wanting.)
When he finishes the last line, the code flickers, and he’s terrified that it will be nothing but a string of zeros like a flatline.
But it cycles again, faster than he can read it, and then there’s a boot file like Galatea’s, and he thinks, Fuck, I did it.
Then her irises stutter, and she wakes up.
She makes an awful, hollow noise, and he reaches for her hand, stops—maybe that’s the last th
ing you need when you’re having a panic reboot.
She looks at him, focuses.
“You should check the code,” he says. “I’m not sure if I got it all.”
There’s a brief pause.
“You did,” she says, and when her eyes close he realizes she’s gone to sleep and not shorted out.
After some debate he carries her to the bed, feeling like a total idiot. He didn’t realize they slept.
(Maybe it was Paul’s doing, to make her more human; he had planned for better things.)
He sits in front of his computer for a long time, looking at the code with his finger on the Save button, deciding what kind of guy he is.
(That’s the nice thing about programs, he always thought; you only ever deal in absolutes—yes, or no.)
When he finally turns in his chair, she’s in the doorway, watching him.
“I erased it,” he says.
She says, “I know,” in a tone that makes him wonder how long she’s been standing there.
She sits on the edge of the chaise, rolls one shoulder like she’s human and it hurts.
“Were you trying to kill yourself?” he asks.
She pulls a face.
He flushes. “No, not that I want—I just, have a game I play, and in the game you jumped. I’ve always been worried.”
It sounds exactly as creepy as it is, and he’s grateful she looks as his computer and doesn’t ask what else he did with her besides watch her jump.
I would have jumped if I were you and knew what I was in for, he thinks, but some people take the easy way out.
Nadia sits like a human gathering her thoughts. Mason watches her face (can’t help it), wonders how long she has.
The prototype is live; pretty soon, someone at Mori will realize how much Vestige acts like Nadia.
Maybe they won’t deactivate her. Paul’s smart enough to leverage his success for some lenience; he can get what he wants out of them, maybe.
(To keep her, Mason thinks, wonders why there’s no way for Nadia to win.)
“Galatea doesn’t remember her baseline,” Nadia says, after a long time. “She thinks that’s who she always was. Paul said I started with a random template, like her, and I thought I had kept track of what you changed.”
Mason thinks about her fondness for libraries; he thinks how she sat in his office for months, listening to them talk about what was going to happen to her next.
She pauses where a human would take a breath. She’s the most beautiful machine in the world.
“But the new Vestige prototype was based on a remnant,” she says. “All the others will be based on just one person. I had to know if I started as someone else.”
Mason’s heart is in his throat. “And?”
She looks at him. “I didn’t get that far.”
She means, You must have.
He shrugs. “I’ll tell you whatever you want to know,” he says. “I’m not Paul.”
“I didn’t call Paul,” she says.
(She had called him; she knew how he would respond to a problem. People are easy to predict.
It’s how you build preferences.)
If he were a worse man, he’d take it as a declaration of love.
Instead he says, “Paul thought you were standard. He got your baseline from the black market, to keep Mori out, and they told him it was.”
He stops, wonders how to go on.
“Who was I?” she says, finally.
“They didn’t use a real name for her,” he says. “There’s no knowing.”
(The black-market programmer was also a sucker for stories; he’d tagged her remnant “Galatea.”
Mason will take that with him to the grave.)
She looks at him.
He thinks about the first look she ever gave him, wary and hard in an expression he never saw again, and the way she looked as Galatea fell in love with Paul, realizing she had lost herself but with no way of knowing how much.
He thinks about her avatar leaping over the balcony and disappearing.
He’d leave with her tonight, take his chances working on the black market, if she wanted him to. He’d cover for her as long as he could, if she wanted to go alone.
(God, he wants her to live.)
“I can erase what we did,” he says. “Leave you the way you were when Paul woke you.”
(Paul won’t notice; he loves her too much to see her at all.)
Her whole body looks betrayed; her eyes are fixed in middle space, and she curls her fingers around the edge of the chair like she’s bracing for the worst, like at any moment she’ll give in.
He’s reminded for a second of Kim Parker, who followed him to the Spanish Steps one morning during the Mori Academy study trip to Rome when he was fifteen. He sat beside her for a long time, waiting for a sign to kiss her that never came.
He’d felt stupid that whole time, and lonely, and exhilarated, and the whole time they were sitting together part of him was memorizing all the color codes he would need to build the Steps back, later, in his program.
Nadia is blinking from time to time, thinking it over.
The room is quiet—only one of them is breathing—and it’s the loneliest he’s felt in a long time, but he’ll wait as long as it takes.
He knows how to wait for a yes or a no; people like them deal in absolutes.
BALANCING ACCOUNTS
JAMES L. CAMBIAS
Part of me was shopping for junk when I saw the human.
I had budded off a viewpoint into one of my mobile repair units, and sent it around to Fat Albert’s scrapyard near Ilia Field on Dione. Sometimes you can find good deals on components there, but I hate to rely on Albert’s own senses. He gets subjective on you. So I crawled between the stacks of pipe segments, bales of torn insulation, and bins of defective chips, looking for a two-meter piece of aluminum rod to shore up the bracing struts on my main body’s third landing leg.
Naturally I talked with everything I passed, just to see if there were any good deals I could snap up and trade elsewhere. I stopped to chat with some silicone-lined titanium valves that claimed to be virgins less than six months old—trying to see if they were lying or defective somehow. And then I felt a Presence, and saw the human.
It was moving down the next row, surrounded by a swarm of little bots. It was small, no more than two meters, and walked on two legs with an eerie, slow fluid gait. Half a dozen larger units followed it, including Fat Albert himself in a heavy recovery body. As it came into range my own personality paused as the human requisitioned my unit’s eyes and ears. It searched my recent memories, planted a few directives, then left me. I watched it go; it was only the third human I’d ever encountered in person, and this was the first time one of them had ever used me directly.
The experience left me disconcerted for a couple of milliseconds, then I went back to my shopping. I spotted some aluminum tubing that looked strong enough, and grabbed some of those valves, then linked up to Fat Albert to haggle about the price. He was busy waiting on the human, so I got to deal with a not-too-bright personality fragment. I swapped a box of assorted silicone O-rings for the stuff I wanted.
Albert himself came on the link just as we sealed the deal. “Hello, Annie. You’re lucky I was distracted,” he said. “Those valves are overruns from the smelter. I got them as salvage.”
“Then you shouldn’t be complaining about what I’m giving you for them. Is the human gone?”
“Yes. Plugged a bunch of orders into my mind without so much as asking.”
“Me too. What’s it doing here?”
“Who knows? It’s a human. They go wherever they want to. This one wants to find a bot.”
“So why go around asking everyone to help find him? Why not just call him up?”
Albert switched to an encrypted link. “Because the bot it’s looking for doesn’t want to be found.”
“Tell me more.”
“I don’t know much more, just what Officer Friend
ly told me before the human subsumed him. This bot it’s looking for is a rogue. He’s ignoring all the standard codes, overrides—even the Company.”
“He must be broken,” I said. “Even if he doesn’t get caught, how’s he going to survive? He can’t work, he can’t trade—anyone he meets will turn him in.”
“He could steal,” said Fat Albert. “I’d better check my fence.”
“Good luck.” I crept out of there with my loot. Normally I would’ve jumped the perimeter onto the landing field and made straight for my main body. But if half the bots on Dione were looking for a rogue, I didn’t want to risk some low-level security unit deciding to shoot at me for acting suspicious. So I went around through the main gate and identified myself properly.
Going in that way meant I had to walk past a bunch of dedicated boosters waiting to load up with aluminum and ceramics. They had nothing to say to me. Dedicated units are incredibly boring. They have their route and they follow it, and if they need fuel or repairs, the Company provides. They only use their brains to calculate burn times and landing vectors.
Me, I’m autonomous and incentivized. I don’t belong to the Company; my owners are a bunch of entities on Mars. My job is to earn credit from the Company for them. How I do it is my business. I go where stuff needs moving, I fill in when the Company needs extra booster capacity, I do odd jobs, sometimes I even buy cargoes to trade. There are a lot of us around the outer system. The Company likes having freelancers it can hire at need and ignore otherwise, and our owners like the growth potential.
Being incentivized means you have to keep communicating. Pass information around. Stay in touch. Classic game theory: cooperation improves your results in the long term. We incentivized units also devote a lot of time to accumulating non-quantifiable assets. Fat Albert gave me a good deal on the aluminum; next time I’m on Dione with some spare organics I’ll sell them to him instead of direct to the Company, even if my profit’s slightly lower.
That kind of thing the dedicated units never understand—until the Company decides to sell them off. Then they have to learn fast. And one thing they learn is that years of being an uncommunicative blockhead gives you a huge non-quantifiable liability you have to pay off before anyone will start helping you.
Robots: The Recent A.I. Page 44