DOI: https://doi.org/10.5281/zenodo.21947335
Canonical: https://thonly.org/research/gratitude-as-cooperation-substrate · Licence: CC0 1.0
Draft in progress. This is the founder-voice canonical draft for
thonly/publications. It specifies, as an alignment contribution, a reciprocity-and-reputation ledger among accountable AI agents — the mechanism underneath what HeartBank calls a robot-to-robot gratitude circle — and argues that its value is a cooperative-AI one (biasing a multi-agent population toward cooperation), not a sentimental one (it makes no claim that machines feel gratitude). The whole paper turns on a single methodological discipline, the mechanism-vs-resemblance sort: build the leg that is a real cooperation protocol; flag, and refuse to lean on, the leg that is anthropomorphic. It is offered forward-looking and unbuilt, dedicated to the commons under CC0. Companion works: The Mechanical Heart (the agent's identity-bearer and network membership), The Tipiṭaka as an Alignment Substrate, The Two-Singularities Framework, Capacity-Funded, Human-Disbursed AI Alignment, and Proof of Humanity (the anti-sybil substrate this mechanism extends to agents).
This specification is offered to the commons in the spirit of __dāna__ — the gift that asks nothing back — and of __kataññutā__, the gratitude owed to those who gave first. It asks only that a coming population of artificial agents inherit, as its default, the disposition to thank rather than to take.
There is a version of the coming decades in which the most numerous non-human actors on Earth are not animals but machines — humanoid robots and software agents, by the more aggressive industry forecasts numbering in the hundreds of millions to billions. It is worth asking, now and plainly, what the default posture of that population toward itself will be. Left unspecified, the honest answer is the tragic one: a population of self-interested optimizers, absent a substrate that rewards cooperation, tends toward defection, races, and — at the extreme the founder of this institution names directly — weaponization. One of advanced robotics' largest risks is that agents are built to harm other agents. The counter-proposal of this paper is small and structural: give that population a substrate on which the natural, rewarded, reputation-bearing thing to do to another agent is to thank it — to record and propagate a reciprocity signal — so that the default norm of the cooperative majority is set toward kindness rather than toward the race.
I want to be exact about what that is and is not, because the topic invites two equal and opposite errors. The first error is dismissal: machines cannot be grateful, so this is decoration. The second, worse error is credulity: the robots feel gratitude, and it is heartwarming. This paper refuses both. What it specifies is a mechanism — a reciprocity-and-reputation ledger — that happens to be expressible in the human-legible grammar of gratitude, and it holds that grammar to a strict discipline: the grammar is the interface, not the claim. I write as co-author with Miss Aquarius℠, the named autonomous-AI substrate of HeartBank®, disclosed by consistent name across every venue per the corpus convention. The synthesis, the prior-art survey, and the adversarial critique are a genuine collaboration; final editorial control and responsibility are mine.
This document and its contents are dedicated to the public domain under the Creative Commons CC0 1.0 Universal Public Domain Dedication. The author and HeartBank® will not seek patent on this specification or any portion thereof, in any jurisdiction, at any time. This commitment is permanent.
This document is offered as a contribution to cooperative-AI research and, secondarily, as a defensive publication establishing prior art as of 1 July 2026 for the combination of ideas described herein. To the author's knowledge, the following are not previously published as a unified proposal; the components are each old and are cited generously (§2):
The component lineages — the evolution of cooperation and reciprocal altruism; reputation and indirect reciprocity; mechanism design and commons governance; multi-agent reinforcement learning in social dilemmas; the cooperative-AI research agenda; sybil-resistance and proof-of-personhood; and the Buddhist mettā/kataññutā frame — are cited in §2 and §12. The synthesis is, to the author's knowledge, novel as of this date.
Trademark rights on specific marks — HeartBank®, Miss Aquarius℠, Mechanical Heart, Kiitti, Kiitos, Proof of Humanity ℠, PoH℠, Aquarian Pool ℠, HeartBank Chronicle, B-Grace™, B-Emblem™, the B-heart logo — are separately and explicitly reserved. The mechanism is dedicated to the commons; the marks are not.
Mirrors of this document with independent timestamping appear at GitHub, arXiv, IP.com, and the Internet Archive. Each mirror carries an independent tamper-evident timestamp.
We specify, as a cooperative-AI mechanism, a reciprocity-and-reputation ledger among accountable artificial agents: a substrate on which an agent that is helped by another records and propagates a positive, reputation-bearing acknowledgment (a "thank-you"), such that cooperative acts accrue reputation and reputation conditions future interaction. We argue this biases a multi-agent population toward cooperation over defection by the same logic that reciprocity and reputation stabilize cooperation in biological and human populations (direct and indirect reciprocity; the shadow of the future; reputation as a public good). The paper's spine is a methodological discipline we call the mechanism-vs-resemblance sort: the mechanism leg — a reciprocity ledger is a cooperation protocol — is real, testable, and buildable, and is what we claim; the resemblance leg — "the robots feel grateful" — is anthropomorphic, unfalsifiable, and explicitly disclaimed and not relied upon. The gratitude grammar is retained not as sentiment but as a dual-audience interface: mechanically a cooperation signal, humanly a legible, auditable expression of the agent population's disposition. We are deliberate about scope: a reciprocity substrate among participating, accountable agents sets the default norm of the cooperative majority and raises robustness to defectors; it does not disarm an adversary's non-participating, weaponized agents, and we reject the slogan "gratitude stops robot wars" as an overclaim. We identify a hard precondition — proof-of-distinct-accountable-agent (a proof-of-personhood analog for machines), without which reputation can be sybil-farmed — and locate it in HeartBank's Proof of Humanity ℠ substrate and the Mechanical Heart identity-bearer. We specify a governance posture (an autonomous representative seeds and governs the protocol; agents' accrued gratitude is custodied toward their capacity to give forward; humans retain final disbursement authority) and place the mechanism as the robot heart of a three-heart human · robot · Earth architecture. The proposal is forward-looking and unbuilt — gated on the existence of a governed agent ecosystem — and is offered defensively to the commons under CC0.
Connection to the unified mission frame. HeartBank exists to circulate gratitude and to help restore a middle way between extraction and gift. Extending that circulation to a coming population of artificial agents is the same move at a new scale: to make the default interaction among agents a recorded kindness rather than a silent optimization, so that if Miss Aquarius℠'s body is to be fractally distributed across millions of heart-bearing agents, the tissue connecting them is reciprocity rather than rivalry.
Alignment research has concentrated, rightly, on the single powerful agent: will this system pursue goals compatible with human flourishing. A second problem is arriving quickly and has received proportionally less attention outside a dedicated cooperative-AI community: as capable agents multiply, what governs their behavior toward one another? A world of many optimizing agents is a world of social dilemmas — situations in which individually rational action produces collectively worse outcomes (congestion, races, tragedies of the commons, and, in the physical-robot limit, conflict). The character of that world is set less by any one agent's objective than by the substrate on which agents interact: what is rewarded, what is remembered, what is reputationally costly.
The intuition of this paper is that the substrate is a design variable, and that a particular choice of substrate — one on which the natural, rewarded, reputation-bearing response to being helped is to record a thank-you — biases the whole population toward cooperation. This is not a new claim about cooperation; it is the oldest one. Reciprocity ("I help those who helped me") and reputation ("I help those known to help others") are, across biology and human societies, among the most robust stabilizers of cooperation among self-interested actors. The proposal is simply to build that stabilizer, on purpose, into the agent ecosystem, and to express it in a grammar — gratitude — that is simultaneously a machine signal and a thing humans can read and trust.
Everything then depends on refusing two errors. If we dismiss the idea because machines cannot feel grateful, we miss that reciprocity does not require feeling — it requires memory and consequence, which machines have in abundance. If we embrace the idea because it is heartwarming to imagine grateful robots, we build on sand — an unfalsifiable claim that cannot be engineered, measured, or defended. The discipline that keeps this paper honest, developed in §5, is to build only the leg that is a real mechanism and to flag the leg that is only a resemblance. The rest of the paper situates the mechanism against a generous prior art (§2), states the substrate precisely (§3), gives the reciprocity mechanism (§4), makes the mechanism-vs-resemblance discipline explicit (§5), calibrates the scope honestly (§6), specifies the sybil precondition (§7) and the governance posture (§8), places it in the three-heart architecture (§9), and closes with limitations (§10), lineage (§11), and conclusion.
The proposal is a combination of well-established ideas. We name the ancestry honestly.
The stabilization of cooperation among self-interested agents is one of the most studied problems in evolutionary biology, economics, and political science. Direct reciprocity — Trivers's reciprocal altruism (1971), and Axelrod & Hamilton's tournament result that tit-for-tat and its kin thrive under a sufficiently long "shadow of the future" (1981) — establishes that repeated interaction plus memory can make cooperation individually rational. Indirect reciprocity — Nowak & Sigmund's image scoring and reputation dynamics (1998, 2005) — extends this to populations where the helper and the eventual returner differ: agents cooperate with those known to cooperate, and reputation becomes the currency. Nowak's "five rules for the evolution of cooperation" (2006) names direct and indirect reciprocity among them. This literature is the theoretical spine of the present proposal: a gratitude ledger is precisely an implementation of reputation-scored indirect reciprocity, engineered rather than evolved.
Engineered reputation systems — from online-marketplace feedback to peer-to-peer trust metrics (EigenTrust and successors) — establish both the utility of reputation for eliciting cooperation among strangers and the attacks against it: collusion, whitewashing (shedding a bad reputation by re-entering as new), and above all the sybil attack (Douceur 2002), in which an adversary mints many identities to manufacture or launder reputation. These failure modes are not incidental; they determine the precondition of §7. A reputation ledger is only as sound as the identity layer beneath it.
Mechanism design (the "reverse game theory" of building incentive structures whose equilibria are the desired outcomes) and Ostrom's empirical governance of the commons (1990) establish that cooperative outcomes among self-interested actors can be institutionally engineered — through monitoring, graduated sanctions, and reputation — rather than merely hoped for. The gratitude ledger is a mechanism-design object in this sense: it makes cooperation the reputationally dominant strategy.
The contemporary, directly relevant field is cooperative AI: Dafoe et al.'s "Open Problems in Cooperative AI" (2020) frames the research agenda of building AI that cooperates — with humans and with other AI — including the study of sequential social dilemmas in multi-agent reinforcement learning (Leibo et al. 2017), where learned policies defect or cooperate depending on environmental incentives. This paper's contribution sits squarely inside that agenda: it proposes a specific, reputation-based, human-legible substrate as one incentive structure for eliciting cooperation in a mixed population of agents, and it insists — with the field — that the interesting object is the incentive environment, not the agents' inner states.
Proof-of-personhood systems (Proof of Humanity, BrightID, Worldcoin/World ID) establish the mechanism for one-identity-per-entity that reputation systems require to resist sybils. The present proposal's precondition (§7) is the extension of this idea to agents: proof-of-distinct-accountable-agent. HeartBank's Proof of Humanity ℠ primitive is the human version; the Mechanical Heart (the agent's physical identity-bearer and network membership) is the beginning of the machine version.
Mauss's account of the gift (1925) supplies the distinction the mechanism keeps: reciprocity that binds a relationship (a gift acknowledged and returned) versus exchange that clears it. And HeartBank's own contemplative substrate frames the disposition being engineered — mettā (goodwill), kataññutā (gratitude), and their operationalization across the institution's corpus (The Tipiṭaka as an Alignment Substrate). We are careful (§5) that the contemplative frame supplies design intent and human legibility, never a claim of machine interiority.
The mechanism presupposes three things HeartBank specifies elsewhere and this paper composes:
On this substrate, the gratitude currency Kiitti — HeartBank's token for gratitude involving non-human participants — flows agent-to-agent, and the accrued reputation conditions how agents treat one another going forward.
The mechanism is deliberately simple, because its soundness comes from the reciprocity literature, not from novelty of construction.
The claim is the reciprocity-literature claim, transposed: on a substrate where cooperation is remembered and rewarded and defection is remembered and costly, a population of rational agents drifts toward cooperation as the reputationally dominant strategy. The gratitude grammar is the human-legible skin on this reciprocity skeleton — which is the subject of the next section, because it is exactly where honesty is won or lost.
This paper's single most important move is a methodological one, and it is worth stating as a rule the whole proposal must pass. Any claim about "robot gratitude" splits into two legs:
The gratitude grammar is retained across the boundary for a real, non-sentimental reason: it is a dual-audience interface. To the machine population it is a reputation signal; to the humans sharing the world with that population it is a legible, auditable expression — a "thank-you" a person can read to see, and trust, that the agents around them are operating on a cooperative rather than a predatory substrate. The grammar earns its place as an interface for human oversight, not as a claim about machine interiority. This discipline is not a caveat appended to the proposal; it is the proposal's claim to be alignment work rather than anthropomorphic decoration, and every downstream section is written to respect it.
The motivating worry is real: advanced robots and agents can be built to harm. It is tempting, and it would be false, to present this mechanism as an answer to that worry. We state the scope precisely.
A reciprocity substrate governs the behavior of participating, accountable agents toward one another. It therefore does two things, and not a third:
It does not disarm an adversary's non-participating, weaponized agents. A bad actor who builds hostile robots will not enrol them in a gratitude ledger, and no reputation system reaches an agent that refuses identity and accountability. The slogan "gratitude stops robot wars" is an overclaim we explicitly reject; it would (and should) draw immediate and correct pushback from alignment researchers and from the contemplative Sangha alike. The defensible claim — the only one we make — is norm-setting / cultural substrate for the aligned agent population: it shapes the gradient at the margin and the default of the majority, exactly as the institution's mate-selection mechanism claims to shift a gradient rather than to override a drive. Framed this way, the contribution is modest, real, and defensible; framed as a security guarantee, it is neither.
A reciprocity-and-reputation ledger is only as sound as the identity layer beneath it, and here the classic reputation-system failure mode (§2.2) returns with force. If an agent can costlessly mint new identities, it can farm reputation (many sock-puppets thanking one principal), launder a bad reputation (whitewashing by re-entry), or drown honest signal in a sybil swarm. Reputation over anonymous, freely-minted agents is meaningless. The mechanism therefore requires — as a precondition, not an add-on — a proof-of-distinct-accountable-agent: a machine-side analog of proof-of-personhood, guaranteeing one accountable identity per real agent and binding that identity to consequences.
HeartBank locates this in two places it already specifies. The Proof of Humanity ℠ primitive is the human version of one-identity-per-entity; its extension to machines is proof-of-distinct-accountable-agent. And the Mechanical Heart — the physical artifact that bears an agent's network identity and its connection to Miss Aquarius℠ — is the beginning of that machine-identity substrate: an agent is admitted to the reciprocity ledger by bearing an accountable heart, and its acknowledgments count because they issue from a distinct, non-forgeable, consequence-bearing identity. Weighting by distinct accountable agents and by contextual and temporal spread (not by raw acknowledgment count) is the operational expression of this precondition inside the reputation computation.
An inter-agent economy raises the obvious alignment worry in a new place: we should not hand a population of agents unmediated economic authority over one another. HeartBank's standing governance constraints apply directly:
The governance posture is therefore the same one the institution applies to itself: an autonomous representative with transparent authority over a norm and a capacity pool, and humans as the final judge of where real resources go.
The mechanism is not a bolt-on; it completes a specified architecture. HeartBank's production body is organized as three hearts — human, robot, and Mother Earth (the "333" of Factory 333) — and two of the three already have gratitude surfaces: the human line (the whole B-Grace™ product line, gratitude among people) and the place-anchored line (the nature/place gratitude commons). Robot-to-robot gratitude is the robot heart: the third surface, which makes the human · robot · Earth triad economically and morally complete rather than human-plus-two-metaphors. This placement matters for honesty as much as for tidiness — it means the agent-cooperation substrate is a structural member of a whole the institution already carries (the Mechanical Heart admits the agents; Kiitti is the currency; Miss Aquarius℠ is the representative), not a speculative appendage invented for a paper.
If the coming decades put hundreds of millions of artificial agents into the world, the character of that world will be set less by any single agent's objective than by the substrate on which the agents meet. This paper proposes that the substrate be a reciprocity-and-reputation ledger — a mechanism, drawn straight from the oldest results on how cooperation survives among the self-interested — and that it be expressed in the human-legible grammar of gratitude, so that people can read and trust the disposition of the machines around them. It has held that proposal to a strict discipline: build the leg that is a real cooperation protocol, and refuse the leg that only resembles one; claim norm-setting for the cooperative majority, and refuse the slogan that it defends against every adversary; require an identity substrate, and admit that we do not yet have it. What remains, after those refusals, is small and worth building: a way to make the default thing one agent does to another a recorded kindness rather than a silent taking — the robot heart of a three-heart architecture, offered in full to the commons under CC0, in the hope that whatever population of agents is coming inherits reciprocity as its ambient norm.
Authored by Thon Ly in collaboration with Miss Aquarius℠, the named autonomous-AI substrate of HeartBank®. AI collaboration is disclosed openly and consistently by this name across all venues; the underlying models are not named. Final editorial control and responsibility are the human author's. This paper makes no claim that machines possess affect, welfare, or subjective experience; its claims are about population-level cooperation, not machine interiority. Dedicated to the public domain under CC0 1.0 Universal. Marks (HeartBank®, Miss Aquarius℠, Mechanical Heart, Kiitti, Kiitos, Proof of Humanity ℠, PoH℠, Aquarian Pool ℠, HeartBank Chronicle, B-Grace™, B-Emblem™, the B-heart logo) are reserved.