Millions of people, some my age but most younger, have been keeping lifelogs for years, wearing personal cams that capture continuous video of their entire lives. People consult their lifelogs for a variety of reasons – everything from reliving favorite moments to tracking down the cause of allergic reactions – but only intermittently; no one wants to spend all their time formulating queries and sifting through the results. Lifelogs are the most complete photo album imaginable, but like most photo albums, they lie dormant except on special occasions. Now Whetstone aims to change all of that; they claim Remem's algorithms can search the entire haystack by the time you've finished saying "needle."
Remem monitors your conversation for references to past events, and then displays video of that event in the lower left corner of your field of vision. If you say "remember dancing the conga at that wedding?", Remem will bring up the video. If the person you're talking to says "the last time we were at the beach," Remem will bring up the video. And it's not only for use when speaking with someone else; Remem also monitors your subvocalizations. If you read the words "the first Szechuan restaurant you ate at," your vocal cords will move as if you're reading aloud, and Remem will bring up the relevant video.
There's no denying the usefulness of software that can actually answer the question "where did I put my keys?" But Whetstone is positioning Remem as more than a handy virtual assistant: they want it to take the place of your natural memory.
It was the summer of Jijingi's thirteenth year when a European came to live in the village. The dusty harmattan winds had just begun blowing from the north when Sabe, the elder who was regarded as chief by all the local families, made the announcement.
Everyone's initial reaction was alarm, of course. "What have we done wrong?" Jijingi's father asked Sabe.
Europeans had first come to Tivland many years ago, and while some elders said one day they'd leave and life would return to the ways of the past, until that day arrived it was necessary for the Tiv to get along with them. This had meant many changes in the way the Tiv did things, but it had never meant Europeans living among them before. The usual reason for Europeans to come to the village was to collect taxes for the roads they had built; they visited some clans more often because the people refused to pay taxes, but that hadn't happened in the Shangev clan. Sabe and the other clan elders had agreed that paying the taxes was the best strategy.
Sabe told everyone not to worry. "This European is a missionary; that means all he does is pray. He has no authority to punish us, but our making him welcome will please the men in the administration."
He ordered two huts built for the missionary, a sleeping hut and a reception hut. Over the course of the next several days everyone took time off from harvesting the guinea-corn to help lay bricks, sink posts into the ground, weave grass into thatch for the roof. It was during the final step, pounding the floor, that the missionary arrived. His porters appeared first, the boxes they carried visible from a distance as they threaded their way between the cassava fields; the missionary himself was the last to appear, apparently exhausted even though he carried nothing. His name was Moseby, and he thanked everyone who had worked on the huts. He tried to help, but it quickly became clear that he didn't know how to do anything, so eventually he just sat in the shade of a locust bean tree and wiped his head with a piece of cloth.
Jijingi watched the missionary with curiosity. The man opened one of his boxes and took out what at first looked like a block of wood, but then he split it open and Jijingi realized it was a tightly bound sheaf of papers. Jijingi had seen paper before; when the Europeans collected taxes, they gave paper in return so that the village had proof of what they'd paid. But the paper that the missionary was looking at was obviously of a different sort, and must have had some other purpose.
The man noticed Jijingi looking at him, and invited him to come closer. "My name is Moseby," he said. "What is your name?"
"I am Jijingi, and my father is Orga of the Shangev clan."
Moseby spread open the sheaf of paper and gestured toward it. "Have you heard the story of Adam?" he asked. "Adam was the first man. We are all children of Adam."
"Here we are descendants of Shangev," said Jijingi. "And everyone in Tivland is a descendant of Tiv."
"Yes, but your ancestor Tiv was descended from Adam, just as my ancestors were. We are all brothers. Do you understand?"
The missionary spoke as if his tongue were too large for his mouth, but Jijingi could tell what he was saying. "Yes, I understand."
Moseby smiled, and pointed at the paper. "This paper tells the story of Adam."
"How can paper tell a story?"
"It is an art that we Europeans know. When a man speaks, we make marks on the paper. When another man looks at the paper later, he sees the marks and knows what sounds the first man made. In that way the second man can hear what the first man said."
Jijingi remembered something his father had told him about old Gbegba, who was the most skilled in bushcraft. "Where you or I would see nothing but some disturbed grass, he can see that a leopard had killed a cane rat at that spot and carried it off," his father said. Gbegba was able to look at the ground and know what had happened even though he had not been present. This art of the Europeans must be similar: those who were skilled in interpreting the marks could hear a story even if they hadn't been there when it was told.
"Tell me the story that the paper tells," he said.
Moseby told him a story about Adam and his wife being tricked by a snake. Then he asked Jijingi, "How do you like it?"
"You're a poor storyteller, but the story was interesting enough."
Moseby laughed. "You are right, I am not good at the Tiv language. But this is a good story. It is the oldest story we have. It was first told long before your ancestor Tiv was born."
Jijingi was dubious. "That paper can't be so old."
"No, this paper is not. But the marks on it were copied from older paper. And those marks were copied from older paper. And so forth many times."
That would be impressive, if true. Jijingi liked stories, and older stories were often the best. "How many stories do you have there?"
"Very many." Moseby flipped through the sheaf of papers, and Jijingi could see each sheet was covered with marks from edge to edge; there must be many, many stories there.
"This art you spoke of, interpreting marks on paper; is it only for Europeans?"
"No, I can teach it to you. Would you like that?"
Cautiously, Jijingi nodded.
As a journalist, I have long appreciated the usefulness of lifelogging for determining the facts of the matter. There is scarcely a legal proceeding, criminal or civil, that doesn't make use of someone's lifelog, and rightly so. When the public interest is involved, finding out what actually happened is important; justice is an essential part of the social contract, and you can't have justice until you know the truth.
However, I've been much more skeptical about the use of lifelogging in purely personal situations. When lifelogging first became popular, there were couples who thought they could use it to settle arguments over who had actually said what, using the video record to prove they were right. But finding the right clip of video often wasn't easy, and all but the most determined gave up on doing so. The inconvenience acted as a barrier, limiting the searching of lifelogs to those situations in which effort was warranted, namely situations in which justice was the motivating factor.
Now with Remem, finding the exact moment has become easy, and lifelogs that previously lay all but ignored are now being scrutinized as if they were crime scenes, thickly strewn with evidence for use in domestic squabbles.
I typically write for the news section, but I've written feature stories as well, and so when I pitched an article about the potential downsides of Remem to my managing editor, he gave me the go-ahead. My first interview was with a married couple whom I'll call Joel and Deirdre, an architect and a painter, respectively. It wasn't hard to get them
talking about Remem.
"Joel is always saying that he knew it all along," said Deirdre, "even when he didn't. It used to drive me crazy, because I couldn't get him to admit he used to believe something else. Now I can. For example, recently we were talking about the McKittridge kidnapping case."
She sent me the video of one argument she had with Joel. My retinal projector displayed footage of a cocktail party; it's from Deirdre's point of view, and Joel is telling a number of people, "It was pretty clear that he was guilty from the day he was arrested."
Deirdre's voice: "You didn't always think that. For months you argued that he was innocent."
Joel shakes his head. "No, you're misremembering. I said that even people who are obviously guilty deserve a fair trial."
"That's not what you said. You said he was being railroaded."
"You're thinking of someone else; that wasn't me."
"No, it was you. Look." A separate video window opened up, an excerpt of her lifelog that she looked up and broadcast to the people they've been talking with. Within the nested video, Joel and Deirdre are sitting in a café, and Joel is saying, "He's a scapegoat. The police needed to reassure the public, so they arrested a convenient suspect. Now he's done for." Deidre replies, "You don't think there's any chance of him being acquitted?" and Joel answers, "Not unless he can afford a high-powered defense team, and I'll bet you he can't. People in his position will never get a fair trial."
I closed both windows, and Deirdre said, "Without Remem, I'd never be able to convince him that he changed his position. Now I have proof."
"Fine, you were right that time," said Joel. "But you didn't have to do that in front of our friends."
"You correct me in front of our friends all the time. You're telling me I can't do the same?"
Here was the line at which the pursuit of truth ceased to be an intrinsic good. When the only persons affected have a personal relationship with each other, other priorities are often more important, and a forensic pursuit of the truth could be harmful. Did it really matter whose idea it was to take the vacation that turned out so disastrously? Did you need to know which partner was more forgetful about completing errands the other person asked of them? I was no expert on marriage, but I knew what marriage counselors said: pinpointing blame wasn't the answer. Instead, couples needed to acknowledge each other's feelings and address their problems as a team.
Next I spoke with a spokesperson from Whetstone, Erica Meyers. For a while she gave me a typically corporate spiel about the benefits of Remem. "Making information more accessible is an intrinsic good," she says. "Ubiquitous video has revolutionized law enforcement. Businesses become more effective when they adopt good recordkeeping practices. The same thing happens to us as individuals when our memories become more accurate: we get better, not just at doing our jobs, but at living our lives."
When I asked her about couples like Joel and Deirdre, she said, "If your marriage is solid, Remem isn't going to hurt it. But if you're the type of person who's constantly trying to prove that you're right and your spouse is wrong, then your marriage is going to be in trouble whether you use Remem or not."
I conceded that she may have had a point in this particular case. But, I asked her, didn't she think Remem created greater opportunities for those types of arguments to arise, even in solid marriages, by making it easier for people to keep score?
"Not at all," she said. "Remem didn't give them a scorekeeping mentality; they developed that on their own. Another couple could just as easily use Remem to realize that they've both misremembered things, and become more forgiving when that sort of mistake happens. I predict the latter scenario will be the more common one with our customers as a whole."
I wished I could share Erica Meyers' optimism, but I knew that new technology didn't always bring out the best in people. Who hasn't wished they could prove that their version of events was the correct one? I could easily see myself using Remem the way Deirdre did, and I wasn't at all certain that doing so would be good for me. Anyone who has wasted hours surfing the internet knows that technology can encourage bad habits.
Moseby gave a sermon every seven days, on the day devoted to resting and brewing and drinking beer. He seemed to disapprove of the beer drinking, but he didn't want to speak on one of the days of work, so the day of beer brewing was the only one left. He talked about the European god, and told people that following his rules would improve their lives, but his explanations of how that would do so weren't particularly persuasive.
But Moseby also had some skill at dispensing medicine, and he was willing to learn how to work in the fields, so gradually people grew more accepting of him, and Jijingi's father let him visit Moseby occasionally to learn the art of writing. Moseby offered to teach the other children as well, and for a time Jijingi's age-mates came along, mostly to prove to each other that they weren't afraid of being near a European. Before long the other boys grew bored and left, but because Jijingi remained interested in writing and his father thought it would keep the Europeans happy, he was eventually permitted to go every day.
Moseby explained to Jijingi how each sound a person spoke could be indicated with different mark on the paper. The marks were arranged in rows like plants in a field; you looked at the marks as if you were walking down a row, made the sound each mark indicated, and you would find yourself speaking what the original person had said. Moseby showed him how to make each of the different marks on a sheet of paper, using a tiny wooden rod that had a core of soot.
In a typical lesson, Moseby would speak, and then write what he had said: "When night comes I shall sleep." Tugh mba a ile yo me yav. "There are two persons." Ioruv mban mba uhar. Jijingi carefully copied the writing on his sheet of paper, and when he was done, Moseby would look at his paper.
"Very good. But you need to leave spaces when you write."
"I have." Jijingi pointed at the gap between each row.
"No, that is not what I mean. Do you see the spaces within each line?" He pointed at his own paper.
Jijingi understood. "Your marks are clumped together, while mine are arranged evenly."
"These are not just clumps of marks. They are. . . I do not know what you call them." He picked up a thin sheaf of paper from his table and flipped through it. "I do not see it here. Where I come from, we call them 'words.' When we write, we leave spaces between the words."
"But what are words?"
"How can I explain it?" He thought a moment. "If you speak slowly, you pause very briefly after each word. That's why we leave a space in those places when we write. Like this: How. Many. Years. Old. Are. You?" He wrote on his paper as he spoke, leaving a space every time he paused: Anyom a ou kuma a me?
"But you speak slowly because you're a foreigner. I'm Tiv, so I don't pause when I speak. Shouldn't my writing be the same?"
"It does not matter how fast you speak. Words are the same whether you speak quickly or slowly."
"Then why did you say you pause after each word?"
"That is the easiest way to find them. Try saying this very slowly." He pointed at what he'd just written.
Jijingi spoke very slowly, the way a man might when trying to hide his drunkenness. "Why is there no space in between an and yom?"
"Anyom is one word. You do not pause in the middle of it."
"But I wouldn't pause after anyom either."
Moseby sighed. "I will think more about how to explain what I mean. For now, just leave spaces in the places where I leave spaces."
What a strange art writing was. When sowing a field, it was best to have the seed yams spaced evenly; Jijingi's father would have beaten him if he'd clumped the yams the way the Moseby clumped his marks on paper. But he had resolved to learn this art as best he could, and if that meant clumping his marks, he would do so.
It was only many lessons later that Jijingi finally understood where he should leave spaces, and what Moseby meant when he said "word." You could not find the places where words began and ended b
y listening. The sounds a person made while speaking were as smooth and unbroken as the hide of a goat's leg, but the words were like the bones underneath the meat, and the space between them was the joint where you'd cut if you wanted to separate it into pieces. By leaving spaces when he wrote, Moseby was making visible the bones in what he said.
Jijingi realized that, if he thought hard about it, he was now able to identify the words when people spoke in an ordinary conversation. The sounds that came from a person's mouth hadn't changed, but he understood them differently; he was aware of the pieces from which the whole was made. He himself had been speaking in words all along. He just hadn't known it until now.
The ease of searching that Remem provides is impressive enough, but that merely scratches the surface of what Whetstone sees as the product's potential. When Deirdre fact-checked her husband's previous statements, she was posing explicit queries to Remem. But Whetstone expects that, as people become accustomed to their product, queries will take the place of ordinary acts of recall, and Remem will be integrated into their very thought processes. Once that happens, we will become cognitive cyborgs, effectively incapable of misremembering anything; digital video stored on error-corrected silicon will take over the role once filled by our fallible temporal lobes.
What might it be like to have a perfect memory? Arguably the individual with the best memory ever documented was Solomon Shereshevskii, who lived in Russia during the first half of the twentieth century. The psychologists who tested him found that he could hear a series of words or numbers once and remember it months or even years later. With no knowledge of Italian, Shereshevskii was able to quote stanzas of The Divine Comedy that had been read to him fifteen years earlier.
But having a perfect memory wasn't the blessing one might imagine it to be. Reading a passage of text evoked so many images in Shereshevskii's mind that he often couldn't focus on what it actually said, and his awareness of innumerable specific examples made it difficult for him to understand abstract concepts. At times, he tried to deliberately forget things. He wrote down numbers he no longer wanted to remember on slips of paper and then burnt them, a kind of slash-and-burn approach to clearing out the undergrowth of his mind, but to no avail.
The Best Science Fiction and Fantasy of the Year: Volume Eight Page 18