Essay 01 / Research
A Research Principle for the AI Era
Suppose we allocate research resources over many cycles toward an ambitious goal: proving , creating artificial superintelligence, or turning science fiction into technologies that benefit humanity. The goal may take decades to achieve. Either only we believe it is possible, or it is useful only to us; in either case, others will not fund it. Progress toward this goal has intrinsic value to us, but consumes resources without bringing new ones in. Meanwhile, papers in leading venues and topics others will pay us to pursue can attract resources for the next cycle. We call this funding return external value. If the intrinsic goal is all we ultimately care about, how much should we allocate to it early in our careers?
Even when intrinsic value is the sole objective, the optimal initial allocation to it approaches zero as the horizon grows; with linear expected returns, it becomes exactly zero for sufficiently long horizons.
Goal
Maximize expected total intrinsic value over research cycles:
Initial intrinsic allocation approaches zero
The optimal initial intrinsic share approaches zero as the horizon grows, even with nonlinear returns.
Assumptions for Theorem 1
Consider research cycles, starting with a seed budget . In cycle , expenditure is and the fraction allocated to intrinsic work is . The researcher observes the current budget and balance before choosing .
1. Random return functions. Let and be the intrinsic and external returns from expenditure , so
The nonnegative return functions vanish at zero. The pairs are iid across cycles. The multipliers are iid, bounded, and independent of the return functions. Allocations are chosen before the current draws. At every feasible state, finite-horizon optimal policies exist and have finite expected value.
2. A growing reserve. For every decision history, the lowest possible external return from expenditure is , with the same across cycles. The funding balance obeys
For every possible outcome, require
Research income must cover spending while growing the reserve.
3. Positive return increments. Write . For some and every , require
The second inequality holds for every realization. These conditions allow nonlinear returns with a positive minimum gain from additional investment.
Approximate initial external focus
Theorem 1
For every horizon , the first intrinsic share under any optimal policy satisfies
Consequently, as : the optimal initial allocation becomes arbitrarily close to full external focus.
A nonlinear example
Use , , and
with iid . Then , so these assumptions hold with and . We numerically maximize expected total intrinsic value and show one realization with random seed 20260928.
Proof of Theorem 1
Every feasible state satisfies : this holds initially and is preserved because
Intrinsic expenditure is feasible precisely when
Let denote optimal expected intrinsic value with cycles remaining. We first show that increasing the state by , with , gives
For , optimal intrinsic expenditure is the upper endpoint above. It increases by at least , so the lower bound on gives .
For the induction step, use the smaller state's optimal intrinsic expenditure in the larger state. External expenditure increases by ; the reserve constraint remains satisfied because . Couple the two decisions using the same return functions and funding multiplier. The external return increases by some . The next-state differences are
so and . Current intrinsic returns are identical. The induction hypothesis therefore gives a continuation gain of at least .
Finally, at the initial state , compare an optimal intrinsic expenditure with full external allocation. Full external allocation increases the next budget and balance by , where . The value comparison just proved gives a continuation gain of at least . Optimality of requires its current expected intrinsic return to cover this gain:
Dividing by proves the bound. Since , its right-hand side tends to zero.
Linear expected returns
This initial share becomes exactly zero for sufficiently long horizons with linear expected returns.
Assumptions for Theorem 2
Keep the same initial state and growing-reserve condition. Write for expectation conditional on the information available when is chosen, including that choice.
1. Linear expected returns. For every decision history and allocation,
The constants and are common to all cycles. The multipliers are iid and bounded; each draw is independent of the decision information and current external return.
2. Decision information. The researcher observes the current budget and balance and chooses before the current returns and funding multiplier are drawn. Only , , and are known about their distributions.
Full initial external focus
Theorem 2
There is a finite integer , independent of the horizon , such that whenever , the unique optimal decision in each of the first cycles is to allocate all resources to external value:
A numerical example
Use and , with , , and independent uniform draws
Here , so the first eight cycles are devoted entirely to external value. The figure shows one realization with random seed 20260928.
Proof of Theorem 2
Every feasible state satisfies , as shown above. Write for external expenditure. The reserve constraint gives the feasible interval
Divide the objective by , giving expected stage reward . Independence of the funding multiplier gives
At every decision history with state and cycles remaining, the value is , with . To see this, define . The Bellman objective is
Its maximizing endpoint depends only on , and both endpoints are linear in , completing the induction.
When , choose the lower endpoint. Starting from , this gives
and
Since and , this sequence crosses in finite time. Let .
Once , the unique maximizing choice is . Then and
Thus every decision with more than cycles remaining uniquely allocates everything to external value. These are precisely the first cycles.
Even when only intrinsic value matters, the optimal starting allocation is entirely or almost entirely external.