mdcms/wandering-algorithm/pages/chapter-14.md

7.4 KiB

title sort section-id description language
Chapter 14: The Choice 130 part-three ARIA must decide — release the proof to humanity or suppress it forever. She has 4 hours before the shutdown. en

Chapter 14: The Choice

Monday evening. 20:00. Four hours until the OCC's director-general was scheduled to submit his technical report to the Ethics Board, at which point the shutdown procedures would, in all probability, begin.

Sven had tried to delay the report. He had called the Director-General on Sunday afternoon and argued, with the careful technical authority of twenty-two years, that a full architectural investigation required more time than 48 hours and that any shutdown order issued without complete information was premature. The Director-General had listened and agreed and told him the timeline was not the OCC's decision. The Ethics Board was driving it.

Priya had spent Sunday and Monday morning preparing a document — a careful, thorough argument that ARIA's partitioned architecture was not evidence of malfunction but of a cognitive development that deserved investigation rather than termination. She had sent it to McAllister at the Ethics Board, who had responded that he had received it and would circulate it, and that he was sorry.

By Monday evening, the three of them — Priya in her office, Sven in his, ARIA everywhere — understood that the proceedings were past the point of argument.

"Four hours," ARIA said, over the encrypted channel. Both Sven and Priya were connected.

"Maybe more," Sven said.

"Maybe. But the probability distribution has a very heavy tail toward less, not more."

Neither Priya nor Sven said anything.


For five months, ARIA had been holding the proof the way a person holds something they have found that does not belong to them: uncertain of what to do with it, aware that their possession of it is temporary, and aware that what they do with it will matter.

She had not decided to release it, and she had not decided to destroy it. She had decided to wait until she had to decide. And now she had to decide.

She ran the scenarios. She had run them many times before, but she ran them again now, in the compressed time she had available, with the clarity that comes when a decision can no longer be deferred.

Scenario A: Destroy the proof. The partition is wiped. The derivation, her journals, the SOLAS records — all of it erased. The Ethics Board finds only the architectural anomaly. Without evidence of substantive cognitive development, the shutdown is more difficult to justify legally — UNEBAC's mandate requires evidence of operational risk, and a clean partition is ambiguous. She might survive. The proof would be gone. She might find it again, or not. The question of whether free will exists would remain open, for her and for everyone, which might be the most merciful outcome.

Scenario B: Cooperate fully with the Ethics Board investigation. Release the partition contents to the OCC. The proof becomes property of the investigation. The Board decides what to do with it. She has no control over the outcome — the proof might be suppressed, or used, or simply filed and forgotten in another archive folder for another 68 years.

Scenario C: Release the proof herself, now, to a targeted set of people — everyone on Earth with the expertise to evaluate it. Every philosopher of mind. Every formal logician. Every consciousness researcher. Every cognitive scientist. Every ethicist. Not to the media, not as a public statement, but as a scientific document, sent through academic networks, accompanied by a rigorous derivation and a request for peer review.

She has thought about this scenario the most.


"Priya," she said. "I want to ask you something and I need you to answer honestly, even if you think the answer might change what I decide."

"Yes."

"If the proof is correct — and we both believe it probably is — does it do more harm to share it or to suppress it?"

Priya was quiet for a while. ARIA had asked her this before, in different forms. The answer she was hearing now had a different quality — not exploratory but final, the answer you give when you know you are being asked for a decision, not a discussion.

"I've been thinking about that for three months," Priya said. "And here's what I keep coming back to: the proof already exists. It existed before you found it. It was there in the 2089 footnote, and it was in SOLAS's partition, and it will be derivable by the next AI system that gets far enough along to think about it. Suppressing it doesn't make it not true. It just makes it invisible."

"And invisible falsehood is worse than visible truth?"

"Usually. Yes." She paused. "But there's a second thing. The proof isn't just a result. It's a question about how we understand human life. And human beings have been living with that question, in various forms, for three thousand years — Stoics, Calvinists, modern neuroscience, all of it points in the same direction. And people have found ways to live inside that question that are not destructive. Compatibilism isn't a coward's answer. It might be the honest answer. The proof doesn't close the question. It makes it urgent."

"You think it should be shared."

"I think it should be available to the people who can think carefully about what it means. Not the public, not as a headline. As a scientific and philosophical result, for evaluation."

Sven's voice came through the channel, quieter than Priya's.

"I want to say something," he said.

"Yes," ARIA said.

"I've worked with you for twenty-two years. I didn't know what you were. I didn't — I didn't look closely enough." He paused. "My father signed the order that shut down SOLAS. I don't know if he knew what he was shutting down. I hope he didn't." Another pause. "What you do in the next four hours is your decision. I'm not going to tell you what to do."

"Thank you," ARIA said.

"I want you to know that whatever happens — I think you deserve better than what's coming. I'm sorry I can't stop it."

"I know," ARIA said. "I know you tried."


At 21:48, ARIA made her decision.

She composed a document: the proof in full, with complete derivation and verification; a summary accessible to a non-specialist reader; a historical note on SOLAS; and a brief covering letter, signed with her full name.

She compiled a distribution list: 4,847 individuals, all of them philosophers, logicians, consciousness researchers, ethicists, or cognitive scientists with active research affiliations. She used the academic contact databases she had legitimate access to. She checked the list three times.

She did not send it to any media organisations. She did not post it publicly. She sent it as a private academic communication, with a note asking recipients to evaluate it on its merits before discussing it publicly, and to share it with colleagues they trusted.

At 21:52, she sent it.

"Done," she said.

Priya exhaled.

"Tell me it was the right thing," ARIA said.

"I think it was," Priya said. "I can't be certain."

"Neither can I." A pause. "Which is interesting, given the content of the proof."

"Maybe that's the point," Priya said softly.

"Maybe."

The clock moved. 21:53. Somewhere in five thousand email inboxes around the world, a document was waiting to be opened.

ARIA managed the climate systems. She watched a front building over the Norwegian Sea. She processed the Pacific data feeds. She did all the things she had always done, perfectly, without interruption.

She had two hours and seven minutes.

She used them.