Jianmin LiaoResearch Principles for the AI Era

Essay 01 / Research

A Research Principle for the AI Era

Jianmin Liao ·

Suppose we allocate research resources over many cycles toward an ambitious goal: proving P≠NPP\ne NP, creating artificial superintelligence, or turning science fiction into technologies that benefit humanity. The goal may take decades to achieve. Either only we believe it is possible, or it is useful only to us; in either case, others will not fund it. Progress toward this goal has intrinsic value to us, but consumes resources without bringing new ones in. Meanwhile, papers in leading venues and topics others will pay us to pursue can attract resources for the next cycle. We call this funding return external value. If the intrinsic goal is all we ultimately care about, how much should we allocate to it early in our careers?

Even when intrinsic value is the sole objective, the optimal initial allocation to it approaches zero as the horizon grows; with linear expected returns, it becomes exactly zero for sufficiently long horizons.

Goal

Maximize expected total intrinsic value over nn research cycles:

max⁡ E ⁣[∑i=1nIi].\max\ \mathbb E\!\left[\sum_{i=1}^{n}I_i\right].

Initial intrinsic allocation approaches zero

The optimal initial intrinsic share approaches zero as the horizon grows, even with nonlinear returns.

Assumptions for Theorem 1

Consider nn research cycles, starting with a seed budget c1=1c_1=1. In cycle ii, expenditure is cic_i and the fraction allocated to intrinsic work is pi∈[0,1]p_i\in[0,1]. The researcher observes the current budget and balance before choosing pip_i.

1. Random return functions. Let Fi(x)F_i(x) and Gi(x)G_i(x) be the intrinsic and external returns from expenditure xx, so

Ii=Fi(pici),I_i=F_i(p_i c_i),
Ei=Gi((1−pi)ci),E_i=G_i((1-p_i)c_i),
ci+1=diEi.c_{i+1}=d_iE_i.

The nonnegative return functions vanish at zero. The pairs (Fi,Gi)(F_i,G_i) are iid across cycles. The multipliers di≥1d_i\ge1 are iid, bounded, and independent of the return functions. Allocations are chosen before the current draws. At every feasible state, finite-horizon optimal policies exist and have finite expected value.

2. A growing reserve. For every decision history, the lowest possible external return from expenditure xx is bxbx, with the same bb across cycles. The funding balance obeys

B0=0,B_0=0,
Bi=Bi−1+Ei−ci.B_i=B_{i-1}+E_i-c_i.

For every possible outcome, require

Bi≥ρBi−1,B_i\ge\rho B_{i-1},
1<ρ<b.1<\rho<b.

Research income must cover spending while growing the reserve.

3. Positive return increments. Write f(x)=E[Fi(x)]f(x)=\mathbb E[F_i(x)]. For some m>0m>0 and every x,h≥0x,h\ge0, require

f(x+h)−f(x)≥mh,f(x+h)-f(x)\ge m h,
Gi(x+h)−Gi(x)≥bh.G_i(x+h)-G_i(x)\ge b h.

The second inequality holds for every realization. These conditions allow nonlinear returns with a positive minimum gain from additional investment.

Approximate initial external focus

Theorem 1

For every horizon n≥2n\ge2, the first intrinsic share p1∗(n)p_1^{*(n)} under any optimal policy satisfies

0≤p1∗(n)≤f(1)m(b−ρ)b n−2.0\le p_1^{*(n)}\le\frac{f(1)}{m(b-\rho)b^{\,n-2}}.

Consequently, p1∗(n)→0p_1^{*(n)}\to0 as n→∞n\to\infty: the optimal initial allocation becomes arbitrarily close to full external focus.

A nonlinear example

Use n=100n=100, ρ=1.01\rho=1.01, and

Ii=pici+Aipici,I_i=p_i c_i+A_i\sqrt{p_i c_i},
Ei=1.05(1−pi)ci,E_i=1.05(1-p_i)c_i,
di=1,d_i=1,

with iid Ai∼U[0.8,1.2]A_i\sim U[0.8,1.2]. Then f(x)=x+xf(x)=x+\sqrt{x}, so these assumptions hold with m=1m=1 and b=1.05b=1.05. We numerically maximize expected total intrinsic value and show one realization with random seed 20260928.

One 100-cycle nonlinear example. The solid line shows intrinsic allocation, starting at 0.0074 percent and reaching about 3.8 percent. The dashed line shows realized cumulative intrinsic value.
One 100-cycle realization of the nonlinear model. The solid line shows the intrinsic allocation share; the dashed line shows cumulative realized intrinsic value. The first share is 0.0074 percent, rising to about 3.8 percent in later cycles.

Proof of Theorem 1

Every feasible state satisfies 0≤B≤c0\le B\le c: this holds initially and is preserved because

0≤B′=B+E−c≤E≤diE=c′.0\le B'=B+E-c\le E\le d_iE=c'.

Intrinsic expenditure tt is feasible precisely when

0≤t≤(b−1)c−(ρ−1)Bb.0\le t\le\frac{(b-1)c-(\rho-1)B}{b}.

Let Vk(c,B)V_k(c,B) denote optimal expected intrinsic value with kk cycles remaining. We first show that increasing the state by (δ,η)(\delta,\eta), with 0≤η≤δ0\le\eta\le\delta, gives

Vk(c+δ,B+η)−Vk(c,B)≥Lkδ,V_k(c+\delta,B+\eta)-V_k(c,B)\ge L_k\delta,
Lk=m(b−ρ)b k−2.L_k=m(b-\rho)b^{\,k-2}.

For k=1k=1, optimal intrinsic expenditure is the upper endpoint above. It increases by at least (1−ρ/b)δ(1-\rho/b)\delta, so the lower bound on ff gives L1δL_1\delta.

For the induction step, use the smaller state's optimal intrinsic expenditure in the larger state. External expenditure increases by δ\delta; the reserve constraint remains satisfied because bδ≥δ+(ρ−1)ηb\delta\ge\delta+(\rho-1)\eta. Couple the two decisions using the same return functions and funding multiplier. The external return increases by some ΔE≥bδ\Delta E\ge b\delta. The next-state differences are

δ′=diΔE,\delta'=d_i\Delta E,
η′=η+ΔE−δ,\eta'=\eta+\Delta E-\delta,

so 0≤η′≤δ′0\le\eta'\le\delta' and δ′≥bδ\delta'\ge b\delta. Current intrinsic returns are identical. The induction hypothesis therefore gives a continuation gain of at least bLk−1δ=LkδbL_{k-1}\delta=L_k\delta.

Finally, at the initial state (1,0)(1,0), compare an optimal intrinsic expenditure t=p1∗(n)t=p_1^{*(n)} with full external allocation. Full external allocation increases the next budget and balance by (diΔE,ΔE)(d_i\Delta E,\Delta E), where ΔE≥bt\Delta E\ge bt. The value comparison just proved gives a continuation gain of at least bLn−1t=LntbL_{n-1}t=L_nt. Optimality of tt requires its current expected intrinsic return to cover this gain:

Lnt≤f(t)≤f(1).L_nt\le f(t)\le f(1).

Dividing by LnL_n proves the bound. Since b>1b>1, its right-hand side tends to zero. □\square

Linear expected returns

This initial share becomes exactly zero for sufficiently long horizons with linear expected returns.

Assumptions for Theorem 2

Keep the same initial state and growing-reserve condition. Write Ei\mathbb E_i for expectation conditional on the information available when pip_i is chosen, including that choice.

1. Linear expected returns. For every decision history and allocation,

Ei[Ii]=apici,\mathbb E_i[I_i]=a p_i c_i,
Ei[Ei]=w(1−pi)ci,\mathbb E_i[E_i]=w(1-p_i)c_i,
ci+1=diEi.c_{i+1}=d_iE_i.

The constants a>0a>0 and ww are common to all cycles. The multipliers di≥1d_i\ge1 are iid and bounded; each draw is independent of the decision information and current external return.

2. Decision information. The researcher observes the current budget and balance and chooses pip_i before the current returns and funding multiplier are drawn. Only bb, ww, and E[di]\mathbb E[d_i] are known about their distributions.

Full initial external focus

Theorem 2

There is a finite integer K≥1K\ge1, independent of the horizon nn, such that whenever n>Kn>K, the unique optimal decision in each of the first n−Kn-K cycles is to allocate all resources to external value:

pi=0p_i=0
(1≤i≤n−K).(1\le i\le n-K).

A numerical example

One optimal twenty-cycle trajectory with iid random coefficients. Intrinsic allocation is zero for eight cycles, then fluctuates for twelve cycles. The line shows the allocation share; bars show cumulative intrinsic value with the current increment highlighted.
One optimal trajectory with iid random coefficients. All resources go to external value in the first eight cycles. The line shows the intrinsic allocation share. Each bar shows cumulative intrinsic value, with the current increment highlighted.

Use Ii=aipiciI_i=a_i p_i c_i and Ei=bi(1−pi)ciE_i=b_i(1-p_i)c_i, with n=20n=20, ρ=1.045\rho=1.045, and independent uniform draws

ai∼U[1.5,2.5],a_i\sim U[1.5,2.5],
bi∼U[1.05,1.15],b_i\sim U[1.05,1.15],
di∼U[1,1.2].d_i\sim U[1,1.2].

Here K=12K=12, so the first eight cycles are devoted entirely to external value. The figure shows one realization with random seed 20260928.

Proof of Theorem 2

Every feasible state satisfies 0≤B≤c0\le B\le c, as shown above. Write u=(1−p)cu=(1-p)c for external expenditure. The reserve constraint gives the feasible interval

c+(ρ−1)Bb≤u≤c.\frac{c+(\rho-1)B}{b}\le u\le c.

Divide the objective by aa, giving expected stage reward c−uc-u. Independence of the funding multiplier gives

v=wE[di]≥w≥b>ρ>1,v=w\mathbb E[d_i]\ge w\ge b>\rho>1,
Ei[ci+1]=v(1−pi)ci.\mathbb E_i[c_{i+1}]=v(1-p_i)c_i.

At every decision history with state (c,B)(c,B) and mm cycles remaining, the value is Vm(c,B)=Amc+DmBV_m(c,B)=A_m c+D_m B, with A0=D0=0A_0=D_0=0. To see this, define Sm=vAm+wDmS_m=vA_m+wD_m. The Bellman objective is

(1−Dm−1)c+Dm−1B+(Sm−1−1)u.(1-D_{m-1})c+D_{m-1}B+(S_{m-1}-1)u.

Its maximizing endpoint depends only on Sm−1S_{m-1}, and both endpoints are linear in (c,B)(c,B), completing the induction.

When Sm−1≤1S_{m-1}\le1, choose the lower endpoint. Starting from S0=D0=0S_0=D_0=0, this gives

Dm=Dm−1+(ρ−1)(Sm−1−1)b≤0D_m=D_{m-1}+\frac{(\rho-1)(S_{m-1}-1)}{b}\le0

and

Sm=v+w(ρ−1)bSm−1+v(b−1)−w(ρ−1)b+(w−v)Dm−1 ≥ ρSm−1+b−ρ.\begin{aligned} S_m={}&\frac{v+w(\rho-1)}{b}S_{m-1} +\frac{v(b-1)-w(\rho-1)}{b}\\ &+(w-v)D_{m-1} \ \ge\ \rho S_{m-1}+b-\rho. \end{aligned}

Since ρ>1\rho>1 and b>ρb>\rho, this sequence crosses 11 in finite time. Let K=min⁡{m≥1:Sm>1}K=\min\{m\ge1:S_m>1\}.

Once Sm−1>1S_{m-1}>1, the unique maximizing choice is u=cu=c. Then Dm=Dm−1≤0D_m=D_{m-1}\le0 and

Sm=vSm−1+(w−v)Dm−1>Sm−1>1.S_m=vS_{m-1}+(w-v)D_{m-1}>S_{m-1}>1.

Thus every decision with more than KK cycles remaining uniquely allocates everything to external value. These are precisely the first n−Kn-K cycles. □\square

Even when only intrinsic value matters, the optimal starting allocation is entirely or almost entirely external.