AI与编程实战应用

AI·深度学习与3D游戏引擎数学实战指南

通过一行总结与代码片段,直观了解数学公式如何驱动大语言模型、3D图形渲染、量化金融与密码学。

The Mathematical Pipeline Behind ChatGPT & Claude Token Generation
Attention⁡(Q,K,V)=softmax⁡ ⁣(QKTdk)V\operatorname{Attention}(Q,K,V) = \operatorname{softmax}\!\left(\frac{QK^T}{\sqrt{d_k}}\right)V
  • Dot Product (#L02): Measures Query-Key semantic alignment across tokens
  • Matrix Multiplication (#L04): Parallelizes multi-head projection on GPU Tensor Cores
  • Softmax (#P10): Converts raw logits into temperature-controlled token probabilities
  • Cross-Entropy (#P09) & Chain Rule (#C03): Evaluates loss and backpropagates gradients

Large Language Models (LLM & Transformer)

Computes contextual token similarity via scaled dot products, normalizes weights with Softmax, and backpropagates Cross-Entropy Loss via the Chain Rule.

#L02 · 线性代数

向量点积(内积)与余弦相似度

a⋅b=∑i=1naibi=∥a∥∥b∥cos⁡θ\mathbf{a} \cdot \mathbf{b} = \sum_{i=1}^{n} a_i b_i = \|\mathbf{a}\|\|\mathbf{b}\|\cos\theta

ChatGPT自注意力机制(Q·K^T点积)、RAG向量数据库余弦检索与3D图形兰伯特漫反射光照(N·L)

const cosSim = (a:number[], b:number[]) => dot(a,b) / (norm(a) * norm(b));
#L04 · 线性代数

矩阵乘法与线性变换复合 (GEMM)

(AB)ij=∑k=1nAikBkj(AB)_{ij} = \sum_{k=1}^{n} A_{ik} B_{kj}

占据NVIDIA GPU张量核心90%算力的AI深度学习(Y=XW)与3D图形引擎MVP坐标变换流水线

const matMul2 = (A:number[][], B:number[][]) => [[A[0][0]*B[0][0]+A[0][1]*B[1][0], A[0][0]*B[0][1]+A[0][1]*B[1][1]]];
#P02 · 概率·统计

条件概率与乘法定理

P(A∣B)=P(A∩B)P(B),P(A∩B)=P(B)P(A∣B)P(A \mid B) = \frac{P(A \cap B)}{P(B)}, \quad P(A \cap B) = P(B)P(A \mid B)

GPT等大语言模型(LLM)根据前文词序列计算下一个词的条件概率 P(w_t | w_<t) 的核心生成公式。

const pAgivenB = (pAB, pB) => pB > 0 ? pAB / pB : 0;
#P09 · 概率·统计

香农信息熵与交叉熵损失 (Cross-Entropy)

H(P,Q)=−∑xP(x)log⁡Q(x)=H(P)+DKL(P∥Q)H(P, Q) = -\sum_x P(x) \log Q(x) = H(P) + D_{\mathrm{KL}}(P \parallel Q)

大语言模型(LLM)训练、图像分类器等几乎所有现代分类与生成式AI的标准损失函数(Cross-Entropy Loss)。

const bceLoss = (y, yHat) => -(y * Math.log(yHat + 1e-9) + (1 - y) * Math.log(1 - yHat + 1e-9));
#P10 · 概率·统计

Softmax函数与随机梯度下降 (SGD)

σ(z)i=ezi/T∑j=1Kezj/T,θt+1=θt−η∇θL(θt)\sigma(\mathbf{z})_i = \frac{e^{z_i / T}}{\sum_{j=1}^K e^{z_j / T}}, \quad \theta_{t+1} = \theta_t - \eta \nabla_\theta \mathcal{L}(\theta_t)

Transformer自注意力机制、LLM温度采样以及所有深度学习优化器(SGD, AdamW)的心脏公式。

const softmax = (zs, T=1) => { const exps = zs.map(z => Math.exp(z/T)); const s = exps.reduce((a,b)=>a+b,0); return exps.map(e => e/s); };
#C03 · 微积分

乘积法则与复合函数链式法则 (Chain Rule)

dydx=dydu⋅dudx,(uv)′=u′v+uv′\frac{dy}{dx} = \frac{dy}{du} \cdot \frac{du}{dx},\quad (uv)' = u'v + uv'

深度学习神经网络误差反向传播(Backpropagation)与PyTorch自动微分(Autograd)计算图核心

const dL_dw = dL_dy * dy_du * du_dw; // Backpropagation Chain Rule

全部50个数学公式代码实现与AI应用矩阵

#Linear Layer y=wx+b#UI Lerp Animation#Constraint Solver

机器学习单层感知机(y = wx + b)权重偏置建模与UI动画线性插值(Lerp)

const solveLinear = (a: number, b: number) => -b / a;
#Polynomial Kernel SVM#Symbolic Algebra#Completing Square

机器学习多项式核函数(SVM)特征映射与计算机代数系统(CAS)符号化简

const sqSum = (a: number, b: number) => a*a + 2*a*b + b*b;
#IEEE 754 Float#Shader Gamma Correction#Exponential Scaling

IEEE 754浮点数指数编码与3D图形渲染伽马校正(c^(1/2.2))

const gammaCorrect = (c: number, g = 2.2) => Math.pow(c, 1 / g);
#3D Ray Tracing#Physics Collision#Optimization Parabola

3D光线追踪(Ray-Sphere)射线与球体相交检测及物理引擎抛物线弹道碰撞计算

const D = b*b - 4*a*c; const x1 = (-b + Math.sqrt(D)) / (2*a);
#Matrix Trace & Det#Control Theory Poles#Symmetric Polynomials

控制工程系统极点稳定性判别与矩阵特征值迹/行列式快速校验

const sumRoots = -b / a; const prodRoots = c / a;
#O(log N) Complexity#Log-Likelihood AI#Information Theory

二分查找O(log₂ N)时间复杂度分析与深度学习对数似然(Log-Likelihood)防下溢计算

const logBase = (a: number, x: number) => Math.log(x) / Math.log(a);
#RL Discounted Return#Quant Finance DCF#Algorithm Loop Analysis

强化学习(RL)折扣累积奖励(∑ γ^t)收敛上界计算与金融复利现值定价

const geoSum = (a: number, r: number, n: number) => a * (1 - Math.pow(r, n)) / (1 - r);
#Bernstein Basis#Dynamic Programming#Combinatorial AI

3D贝塞尔曲线的伯恩斯坦基多项式构建与集成学习(Ensemble)多数投票概率分析

const nCr = (n: number, k: number): number => k === 0 ? 1 : (n * nCr(n - 1, k - 1)) / k;
#Quantum Computing#RF Signal DSP#2D Rotation

音频与无线通信FFT复数频谱分析、量子计算量子比特振幅与分形图形渲染

const mag = Math.hypot(re, im); const phase = Math.atan2(im, re);
#RSA Cryptography#Blockchain Security#Hash Table Modulo

HTTPS/金融安全RSA公钥加密算法、区块链数字签名与哈希表(Hash Table)寻址

const modPow = (a: bigint, e: bigint, m: bigint): bigint => /* binary exp */
#Game Physics Distance#L2 Metric Foundation#CAD Geometry

游戏引擎碰撞距离计算(Math.hypot)与AI高维特征空间L2欧氏距离度量的原型

const hypotenuse = (a: number, b: number) => Math.hypot(a, b);
#K-Means & KNN ML#A* Pathfinding#3D Spatial Query

机器学习KNN分类、K-Means聚类距离度量与3D游戏A*寻路算法启发式函数

const dist3D = (dx: number, dy: number, dz: number) => Math.hypot(dx, dy, dz);
#Three.js Radians#Robotics Odometry#Shader Angles

Three.js/WebGL图形库标准弧度接口与机器人轮式里程计(l=rθ)位移解算

const degToRad = (deg: number) => (deg * Math.PI) / 180;
#LLM RoPE Encoding#Wave Shader#Circular Orbit

大语言模型Transformer旋转位置编码(RoPE)与3D游戏圆周运动/波浪着色器

const posOnCircle = (r: number, rad: number) => ({ x: r * Math.cos(rad), y: r * Math.sin(rad) });
#Inverse Kinematics IK#GPS Triangulation#Vector Dot Product

机器人机械臂与3D角色骨骼逆运动学(IK)关节角求解及GPS三角测量

const cosC = (a*a + b*b - c*c) / (2 * a * b);
#Rotation Matrix Proof#5G QAM Modulation#Audio DSP

推导2D/3D旋转矩阵复合运算 R(α)R(β)=R(α+β) 与5G无线通信正交调幅(QAM)解调

const sinAdd = (a: number, b: number) => Math.sin(a)*Math.cos(b) + Math.cos(a)*Math.sin(b);
#Kepler Orbit Sim#Mahalanobis Ellipse#Antenna Optics

人造卫星开普勒椭圆轨道仿真与机器学习多维高斯协方差椭圆(马氏距离等高线)

const eccentricity = (a: number, b: number) => Math.sqrt(1 - (b*b)/(a*a));
#3D Globe Mapping#OrbitControls Camera#Spherical Harmonics

3D地球仪360°全景纹理映射、Three.js相机环绕控制(OrbitControls)与量子力学球谐函数

const toXYZ = (r:number, th:number, ph:number) => [r*Math.sin(ph)*Math.cos(th), r*Math.cos(ph), r*Math.sin(ph)*Math.sin(th)];
#3D Mesh Topology#Graph Theory#CAD Manifold Check

3D建模与游戏引擎多边形流形网格(Manifold Mesh)拓扑校验及芯片平面图布线

const eulerChar = (V: number, E: number, F: number) => V - E + F;
#SVG & Font Rendering#CSS cubic-bezier#3D Camera Splines

SVG矢量图形、CSS动画cubic-bezier缓动函数、字体渲染与自动驾驶平滑轨迹规划

const quadBezier = (p0:number, p1:number, p2:number, t:number) => (1-t)*(1-t)*p0 + 2*(1-t)*t*p1 + t*t*p2;
#Sigmoid & Softmax#Continuous Compounding#Calculus Foundation

深度学习激活函数(Sigmoid/Softmax/GELU)指数核与量化金融连续复利(e^rt)定价

const approxE = (n: number) => Math.pow(1 + 1 / n, n);
#Numerical Differentiation#Physics Velocity#Optimization Extremum

游戏物理引擎速度/加速度数值微分与深度学习损失函数切线斜率计算

const diff = (f: (x:number)=>number, x: number, h = 1e-5) => (f(x + h) - f(x - h)) / (2 * h);
#Deep Learning Backprop#PyTorch Autograd#Neural Net Training

深度学习神经网络误差反向传播(Backpropagation)与PyTorch自动微分(Autograd)计算图核心

const dL_dw = dL_dy * dy_du * du_dw; // Backpropagation Chain Rule
#Physics RK4 Integrator#3D Rendering Equation#Probability CDF

物理引擎速度到位置数值积分(RK4)、3D渲染方程光照积分与概率累积分布函数(CDF)

const simpson = (f:(x:number)=>number, a:number, b:number) => ((b-a)/6)*(f(a)+4*f((a+b)/2)+f(b));
#FEM Physics Sim#Fourier Transform Proof#Signal Laplace

工程物理仿真有限元分析(FEM弱形式推导)与傅里叶/拉普拉斯变换微分性质证明

const intXeX = (x: number) => (x - 1) * Math.exp(x) + 1; // ∫_0^x t*e^t dt
#XGBoost 2nd-Order Loss#CPU/GPU Fast Math#Physics Linearization

CPU/GPU超越函数底层快速近似与XGBoost梯度提升树二阶泰勒展开优化

const sinTaylor = (x: number) => x - (x**3)/6 + (x**5)/120 - (x**7)/5040;
#LLM RoPE e^(imθ)#Fourier Basis#Quantum Phase

大语言模型旋转位置编码(RoPE: e^(imθ))、FFT复指数基函数与量子计算相位门

const eulerCis = (theta: number) => ({ re: Math.cos(theta), im: Math.sin(theta) });
#Gradient Descent -∇L#Computer Vision Sobel#Physics Field ∇

百亿参数大模型梯度下降(-∇L)训练与计算机视觉图像边缘检测(Sobel算子)

const grad2D = (a:number, b:number, x:number, y:number) => ({ gx: 2*a*x, gy: 2*b*y });
#Audio AI Spectrogram#5G/Wi-Fi OFDM#JPEG/MP3 Compression

AI语音识别(Whisper梅尔频谱图)、MP3/JPEG有损压缩、5G/Wi-Fi正交频分复用与MRI医学成像

const dftBin = (sig: number[], k: number) => sig.reduce((s, x, n) => s + x * Math.cos(2*Math.PI*k*n/sig.length), 0);
#Diffusion AI ODE#Spring Physics UI#Control Engineering

生成式AI扩散模型(Diffusion ODE求解器)、React-Spring弹簧UI动画与机器人阻抗控制

const zeta = c / (2 * Math.sqrt(m * k)); const w0 = Math.sqrt(k / m);
#L1/L2 Regularization#3D Vector Normalize#Embedding Norm

深度学习L1/L2权重衰减正则化、LayerNorm层归一化与3D游戏角色斜向移动速度归一化

const norm2 = Math.hypot(vx, vy, vz); const unit = [vx/norm2, vy/norm2, vz/norm2];
#LLM Self-Attention Q·K#RAG Vector DB#3D Lighting Shader

ChatGPT自注意力机制(Q·K^T点积)、RAG向量数据库余弦检索与3D图形兰伯特漫反射光照(N·L)

const cosSim = (a:number[], b:number[]) => dot(a,b) / (norm(a) * norm(b));
#3D Surface Normal#Physics Torque r×F#Back-face Culling

3D网格三角形表面法线计算、背面剔除(Back-face Culling)与物理引擎刚体扭矩(τ=r×F)

const cross = (a:number[], b:number[]) => [a[1]*b[2]-a[2]*b[1], a[2]*b[0]-a[0]*b[2], a[0]*b[1]-a[1]*b[0]];
#GPU Tensor Cores GEMM#Deep Learning Y=XW#3D MVP Pipeline

占据NVIDIA GPU张量核心90%算力的AI深度学习(Y=XW)与3D图形引擎MVP坐标变换流水线

const matMul2 = (A:number[][], B:number[][]) => [[A[0][0]*B[0][0]+A[0][1]*B[1][0], A[0][0]*B[0][1]+A[0][1]*B[1][1]]];
#3D Mouse Raycasting#Jacobian Determinant#Normalizing Flows

3D游戏鼠标点击射线拾取逆投影(MVP⁻¹)与生成式AI流模型(Normalizing Flows)雅可比行列式

const det2 = (a:number, b:number, c:number, d:number) => a * d - b * c;
#Linear Solver Ax=b#SPICE Circuit Sim#Normal Equations

SPICE电路仿真器、结构力学有限元求解器与最小二乘正规方程(A^T A x = A^T b)求解

const det = a1*b2 - b1*a2; const x = (c1*b2 - b1*c2)/det; const y = (a1*c2 - c1*a2)/det;
#3D Engine Rotation#LiDAR Point Cloud#Orthogonal Matrix SO(3)

Three.js/Unreal/Unity 3D物体与相机旋转变换及自动驾驶激光雷达点云配准(ICP)

const rot2D = (x:number, y:number, r:number) => ({ x: x*Math.cos(r) - y*Math.sin(r), y: x*Math.sin(r) + y*Math.cos(r) });
#Google PageRank#Quantum Mechanics Hψ=Eψ#Spectral Graph Theory

Google搜索PageRank网页排名算法、量子力学薛定谔定态方程(Hψ=Eψ)与桥梁共振模态分析

const tr = a + d; const det = a*d - b*c; const l1 = (tr + Math.sqrt(tr*tr - 4*det))/2;
#LLM LoRA Fine-Tuning#PCA Dimensionality#Recommender System

大语言模型低秩微调(LoRA)、PCA高维特征降维、推荐系统矩阵分解与图像压缩

const explainedRatio = (s1:number, s2:number, s3:number) => (s1*s1) / (s1*s1 + s2*s2 + s3*s3);
#Three.js Quaternion#Gimbal Lock Free#Aerospace Attitude

Three.js/Unity/Unreal骨骼动画平滑插值(SLERP)与无人机/航天器防万向节死锁姿态控制

const quatFromAxisZ = (rad: number) => ({ w: Math.cos(rad/2), x: 0, y: 0, z: Math.sin(rad/2) });
#Combinatorics#Search Space#Algorithm Complexity#Feature Selection

用于算法搜索空间复杂度分析、超参数网格搜索组合数计算以及特征子集选择。

const nCr = (n, r) => Array.from({length: r}, (_, i) => (n - i) / (i + 1)).reduce((a, b) => a * b, 1);
#LLM Next-Token#Autoregressive AI#Markov Chains#Probabilistic Graphical Models

GPT等大语言模型(LLM)根据前文词序列计算下一个词的条件概率 P(w_t | w_<t) 的核心生成公式。

const pAgivenB = (pAB, pB) => pB > 0 ? pAB / pB : 0;
#Spam Filter#Bayesian Inference#Medical AI Diagnosis#Kalman Filter

直接驱动垃圾邮件过滤(朴素贝叶斯)、医疗AI诊断校准、自动驾驶卡尔曼/粒子滤波及贝叶斯超参数优化。

const bayes = (prior, sens, fpr) => (sens * prior) / (sens * prior + fpr * (1 - prior));
#Reinforcement Learning#Batch Normalization#Quant Risk#Weight Initialization

强化学习(RL)期望累计奖励最大化、深度学习批归一化(BatchNorm/LayerNorm)及权重初始化的核心公式。

const mean = xs.reduce((a,b)=>a+b,0)/xs.length; const variance = xs.reduce((s,x)=>s+(x-mean)**2,0)/xs.length;
#A/B Testing#Dropout Regularization#CTR Modeling#Game Gacha Math

用于广告点击率(CTR) A/B测试、神经网络Dropout掩码概率建模以及游戏抽卡概率模拟。

const binomPMF = (n, k, p) => nCr(n, k) * Math.pow(p, k) * Math.pow(1 - p, n - k);
#Diffusion Models#3D Gaussian Splatting#VAE Latent Space#Anomaly Detection

图像生成扩散模型(Diffusion)高斯噪声调度、变分自编码器(VAE)潜空间以及3D高斯泼溅(3DGS)的核心公式。

const normalPDF = (x, mu, sig) => Math.exp(-0.5 * ((x - mu) / sig) ** 2) / (sig * Math.sqrt(2 * Math.PI));
#Mini-Batch SGD#Monte Carlo Ray Tracing#Confidence Intervals#Statistical Inference

解释小批量随机梯度下降(Mini-Batch SGD)的 1/√n 方差缩减规律以及蒙特卡洛光线追踪误差界。

const stdError = (sigma, n) => sigma / Math.sqrt(n); const ci95 = (mean, se) => [mean - 1.96*se, mean + 1.96*se];
#Linear Regression#Supervised ML#Quant Finance Beta#Feature Engineering

机器学习监督学习线性回归预测器、量化金融投资组合Beta系数以及特征相关性分析的基石。

const slope = covXY / varX; const intercept = meanY - slope * meanX; const r = covXY / Math.sqrt(varX * varY);
#Cross-Entropy Loss#LLM Pretraining#Information Theory#KL Divergence

大语言模型(LLM)训练、图像分类器等几乎所有现代分类与生成式AI的标准损失函数(Cross-Entropy Loss)。

const bceLoss = (y, yHat) => -(y * Math.log(yHat + 1e-9) + (1 - y) * Math.log(1 - yHat + 1e-9));
#Transformer Attention#Deep Learning Optimizer#LLM Temperature#Backpropagation

Transformer自注意力机制、LLM温度采样以及所有深度学习优化器(SGD, AdamW)的心脏公式。

const softmax = (zs, T=1) => { const exps = zs.map(z => Math.exp(z/T)); const s = exps.reduce((a,b)=>a+b,0); return exps.map(e => e/s); };