Advanced mathematics & numerical methods
Use numerical methods without trusting the computer blindly
Starting question — How do we know a numerical answer is close enough to the physical answer?
Intuition. Numerical work is controlled approximation: the step size, conditioning, reference values and convergence evidence matter as much as the final digits.
- Explain the governing idea before calculating.
- Name the units, evidence source and operational boundary of every key quantity.
This module marks a decisive step: mathematics is no longer a collection of formulas to plug numbers into, but a language for building, testing and criticizing models. A trajectory, navigation filter, thermal budget or reliability estimate rapidly becomes a multi-variable problem whose quantities evolve with time. The objective is not to train a pure mathematician, but to develop the habits needed to understand what engineering software is computing and to recognize a physically absurd result.
Mastery objectives
- explain concepts with units and assumptions
- redo a simple calculation by hand before using a tool
- identify at least one failure mode or model limitation
- connect the discipline to a complete Mars architecture
Zero-prerequisite concepts
numerical error
Definition. Numerical error is the discrepancy introduced by finite precision, discretisation or an approximate algorithm.
Example. A trajectory propagated with a coarse time step can diverge from a finer reference even when the physics model is unchanged.
Pitfall. A small displayed residual does not prove the numerical method is globally accurate.
Change step size or precision and check whether the result converges toward a stable value.
Guided exercise — numerical error
In a Mars mission scenario, identify one situation in which “numerical error” changes an engineering or operational decision. State the evidence you would inspect, the mistake you must avoid, and one independent check you would perform before accepting the decision.
Detailed correction — numerical error
Core meaning. Numerical error is the discrepancy introduced by finite precision, discretisation or an approximate algorithm.
Mission example. A trajectory propagated with a coarse time step can diverge from a finer reference even when the physics model is unchanged.
Error to reject. A small displayed residual does not prove the numerical method is globally accurate.
Independent check. Change step size or precision and check whether the result converges toward a stable value.
- Quantification
- Use the physical unit that belongs to numerical error when it is quantitative; if it is qualitative, do not invent a numerical unit.
- Verification
- Compare the conclusion with the mission example, the stated pitfall and the mental check before using numerical error operationally.
convergence
Definition. Convergence means successive refinements of a method approach a stable solution or reduce a defined residual.
Example. A Newton solver may require several iterations before the residual falls below a chosen tolerance.
Pitfall. Stopping because two printed numbers look similar can hide a poorly scaled residual.
Track both the change in the solution and a physically meaningful residual.
Guided exercise — convergence
In a Mars mission scenario, identify one situation in which “convergence” changes an engineering or operational decision. State the evidence you would inspect, the mistake you must avoid, and one independent check you would perform before accepting the decision.
Detailed correction — convergence
Core meaning. Convergence means successive refinements of a method approach a stable solution or reduce a defined residual.
Mission example. A Newton solver may require several iterations before the residual falls below a chosen tolerance.
Error to reject. Stopping because two printed numbers look similar can hide a poorly scaled residual.
Independent check. Track both the change in the solution and a physically meaningful residual.
- Quantification
- Use the physical unit that belongs to convergence when it is quantitative; if it is qualitative, do not invent a numerical unit.
- Verification
- Compare the conclusion with the mission example, the stated pitfall and the mental check before using convergence operationally.
time step
Definition. The time step is the interval advanced by one numerical integration update.
Example. An orbit propagator may be compared at 60 s, 20 s and 10 s steps to check sensitivity.
Pitfall. A smaller step is not automatically “correct”; it also increases computation and can expose other numerical issues.
Halve the step and compare a mission-relevant output, not only the number of iterations.
Guided exercise — time step
In a Mars mission scenario, identify one situation in which “time step” changes an engineering or operational decision. State the evidence you would inspect, the mistake you must avoid, and one independent check you would perform before accepting the decision.
Detailed correction — time step
Core meaning. The time step is the interval advanced by one numerical integration update.
Mission example. An orbit propagator may be compared at 60 s, 20 s and 10 s steps to check sensitivity.
Error to reject. A smaller step is not automatically “correct”; it also increases computation and can expose other numerical issues.
Independent check. Halve the step and compare a mission-relevant output, not only the number of iterations.
- Quantification
- Use the physical unit that belongs to time step when it is quantitative; if it is qualitative, do not invent a numerical unit.
- Verification
- Compare the conclusion with the mission example, the stated pitfall and the mental check before using time step operationally.
conditioning
Definition. Conditioning describes how strongly a problem’s output changes when its inputs are perturbed slightly.
Example. Nearly singular navigation geometry can amplify tiny measurement errors into large position uncertainty.
Pitfall. A stable algorithm cannot repair a fundamentally ill-conditioned physical geometry.
Perturb inputs within their realistic uncertainty and observe whether the output changes disproportionately.
Guided exercise — conditioning
In a Mars mission scenario, identify one situation in which “conditioning” changes an engineering or operational decision. State the evidence you would inspect, the mistake you must avoid, and one independent check you would perform before accepting the decision.
Detailed correction — conditioning
Core meaning. Conditioning describes how strongly a problem’s output changes when its inputs are perturbed slightly.
Mission example. Nearly singular navigation geometry can amplify tiny measurement errors into large position uncertainty.
Error to reject. A stable algorithm cannot repair a fundamentally ill-conditioned physical geometry.
Independent check. Perturb inputs within their realistic uncertainty and observe whether the output changes disproportionately.
- Quantification
- Use the physical unit that belongs to conditioning when it is quantitative; if it is qualitative, do not invent a numerical unit.
- Verification
- Compare the conclusion with the mission example, the stated pitfall and the mental check before using conditioning operationally.
Calculation laboratory — formula, units, inverse check and limits
Quantitative mini-lessons
Relative error
- 1 — Concrete question
- What does “e_rel = |x_calc − x_ref| / |x_ref|” compute in “Relative error”?
- 2 — Intuition without symbols
- Relative error scales the discrepancy by the reference value so problems of different sizes can be compared.
- 3 — Quantities
- e_rel: relative error; x_calc: calculated value; x_ref: reference value
- 4 — Formula
- e_rel = |x_calc − x_ref| / |x_ref|
- 5 — Read aloud
- Read “e_rel = |x_calc − x_ref| / |x_ref|” by naming every operation, subscript and grouping explicitly.
- 6 — Symbols and meaning
- e_rel: relative error; x_calc: calculated value; x_ref: reference value
- 7 — Pronunciation
- The “Read aloud” line above is the oral reference for “Relative error”. Any subscript, exponent or grouping that changes the meaning of the relation should be spoken explicitly.
- 8 — Units
- e_rel dimensionless; x_calc and x_ref in the same unit
- 9 — Convention
- For “Relative error”, substitute values without changing the reference frame, time basis, system boundary or sign convention halfway through the calculation. Stated units: e_rel dimensionless; x_calc and x_ref in the same unit.
- 10 — Why this operation
- In “Relative error”, division relates a quantity to a reference, duration or capacity; the denominator must belong to the same case and remain non-zero.
- 11 — Assumptions
- The relation “e_rel = |x_calc − x_ref| / |x_ref|” applies here only to the scenario described by the card. Inputs must be mutually consistent and satisfy the physical assumptions associated with “Relative error”.
- 12 — Unit check
- e_rel dimensionless; x_calc and x_ref in the same unit Verify that dimensional reduction reaches the unit of the requested output.
- 13 — Numerical case
- With x_calc = 316.3 and x_ref = 316.0, e_rel = 0.3/316.0 ≈ 0.000949 = 0.0949%.
- 14 — Why the calculation works
- The numerical case applies “e_rel = |x_calc − x_ref| / |x_ref|” directly to the stated values. The calculation is meaningful because the quantities are substituted into the same relation before the result is interpreted for “Relative error”.
- 15 — Independent check
- Quick check: multiplying the result by the denominator should reconstruct the numerator of “Relative error” within rounding.
- 16 — Mental estimate
- Before calculating “Relative error” precisely, round the inputs to one useful digit and predict the sign and order of magnitude. The detailed result should remain consistent with that estimate.
- 17 — Interpretation
- A small relative error does not guarantee that the reference value is exact or decision-relevant.
- 18 — What the result does not prove
- For “Relative error”, the number obtained answers only the model “e_rel = |x_calc − x_ref| / |x_ref|” under the stated scenario. It does not by itself validate the input data or the model outside those conditions.
- 19 — Sensitivity
- Vary one input at a time around the nominal case to identify what drives the result of “Relative error” and whether that variation can change the mission decision.
- 20 — Guided and autonomous exercises
Guided exercise. x_calc = 99.2 and x_ref = 100.0.
Detailed guided correction — open after trying
x_calc = 99.2 and x_ref = 100.0. e_rel = 0.8/100 = 0.008 = 0.8%.
Autonomous exercise. x_calc = 48.5 and x_ref = 50.0.
Autonomous correction — open after trying
x_calc = 48.5 and x_ref = 50.0. e_rel = 1.5/50 = 0.03 = 3%.
- 21 — Mission decision
- Compare error with the engineering tolerance that is actually acceptable, not an arbitrary threshold.
Finite-difference derivative
- 1 — Concrete question
- What does “dx_dt ≈ (x_next − x_now) / dt” compute in “Finite-difference derivative”?
- 2 — Intuition without symbols
- A numerical derivative estimates rate of change from a measured difference over a short interval.
- 3 — Quantities
- dx_dt: estimated rate of change; x_next: next-step value; x_now: current value; dt: time interval
- 4 — Formula
- dx_dt ≈ (x_next − x_now) / dt
- 5 — Read aloud
- Read “dx_dt ≈ (x_next − x_now) / dt” by naming every operation, subscript and grouping explicitly.
- 6 — Symbols and meaning
- dx_dt: estimated rate of change; x_next: next-step value; x_now: current value; dt: time interval
- 7 — Pronunciation
- The “Read aloud” line above is the oral reference for “Finite-difference derivative”. Any subscript, exponent or grouping that changes the meaning of the relation should be spoken explicitly.
- 8 — Units
- dx_dt in x-unit per time; dt in time
- 9 — Convention
- For “Finite-difference derivative”, substitute values without changing the reference frame, time basis, system boundary or sign convention halfway through the calculation. Stated units: dx_dt in x-unit per time; dt in time.
- 10 — Why this operation
- In “Finite-difference derivative”, division relates a quantity to a reference, duration or capacity; the denominator must belong to the same case and remain non-zero.
- 11 — Assumptions
- The relation “dx_dt ≈ (x_next − x_now) / dt” applies here only to the scenario described by the card. Inputs must be mutually consistent and satisfy the physical assumptions associated with “Finite-difference derivative”.
- 12 — Unit check
- dx_dt in x-unit per time; dt in time Verify that dimensional reduction reaches the unit of the requested output.
- 13 — Numerical case
- With x_now = 1,200 kg, x_next = 1,110 kg and dt = 9 h, dx_dt = −90/9 = −10 kg/h.
- 14 — Why the calculation works
- The numerical case applies “dx_dt ≈ (x_next − x_now) / dt” directly to the stated values. The calculation is meaningful because the quantities are substituted into the same relation before the result is interpreted for “Finite-difference derivative”.
- 15 — Independent check
- Quick check: multiplying the result by the denominator should reconstruct the numerator of “Finite-difference derivative” within rounding.
- 16 — Mental estimate
- Before calculating “Finite-difference derivative” precisely, round the inputs to one useful digit and predict the sign and order of magnitude. The detailed result should remain consistent with that estimate.
- 17 — Interpretation
- The result depends on step size and can hide fast dynamics between samples.
- 18 — What the result does not prove
- For “Finite-difference derivative”, the number obtained answers only the model “dx_dt ≈ (x_next − x_now) / dt” under the stated scenario. It does not by itself validate the input data or the model outside those conditions.
- 19 — Sensitivity
- Vary one input at a time around the nominal case to identify what drives the result of “Finite-difference derivative” and whether that variation can change the mission decision.
- 20 — Guided and autonomous exercises
Guided exercise. x_now = 80, x_next = 92, dt = 4 s.
Detailed guided correction — open after trying
x_now = 80, x_next = 92, dt = 4 s. dx_dt = 12/4 = 3 per second.
Autonomous exercise. x_now = 50, x_next = 44, dt = 3 min.
Autonomous correction — open after trying
x_now = 50, x_next = 44, dt = 3 min. dx_dt = −6/3 = −2 per minute.
- 21 — Mission decision
- Reduce the step or compare multiple step sizes when the decision is sensitive to the estimated derivative.
Explicit Euler step
- 1 — Concrete question
- What does “x_next = x_now + dt×f_now” compute in “Explicit Euler step”?
- 2 — Intuition without symbols
- Euler advances the state by adding the estimated change over a small step using the current slope.
- 3 — Quantities
- x_next: estimated next state; x_now: current state; dt: time step; f_now: derivative evaluated at current state
- 4 — Formula
- x_next = x_now + dt×f_now
- 5 — Read aloud
- Read “x_next = x_now + dt×f_now” by naming every operation, subscript and grouping explicitly.
- 6 — Symbols and meaning
- x_next: estimated next state; x_now: current state; dt: time step; f_now: derivative evaluated at current state
- 7 — Pronunciation
- The “Read aloud” line above is the oral reference for “Explicit Euler step”. Any subscript, exponent or grouping that changes the meaning of the relation should be spoken explicitly.
- 8 — Units
- x_next and x_now in state units; dt in time; f_now in state-unit per time
- 9 — Convention
- For “Explicit Euler step”, substitute values without changing the reference frame, time basis, system boundary or sign convention halfway through the calculation. Stated units: x_next and x_now in state units; dt in time; f_now in state-unit per time.
- 10 — Why this operation
- Addition combines contributions expressed on the same basis into one coherent total.
- 11 — Assumptions
- All contributions must use a common unit and scope.
- 12 — Unit check
- x_next and x_now in state units; dt in time; f_now in state-unit per time Verify that dimensional reduction reaches the unit of the requested output.
- 13 — Numerical case
- With x_now = 100, dt = 2 s and f_now = −3/s, x_next = 100 + 2×(−3) = 94.
- 14 — Why the calculation works
- Addition combines contributions expressed on the same basis into one coherent total.
- 15 — Independent check
- Removing one contribution from the total must recover the sum of the others.
- 16 — Mental estimate
- Adding the dominant terms first quickly gives the order of magnitude.
- 17 — Interpretation
- Euler is simple but can become unstable or inaccurate when the step is too large for the dynamics.
- 18 — What the result does not prove
- For “Explicit Euler step”, the number obtained answers only the model “x_next = x_now + dt×f_now” under the stated scenario. It does not by itself validate the input data or the model outside those conditions.
- 19 — Sensitivity
- The total changes linearly with each contribution when the others stay fixed.
- 20 — Guided and autonomous exercises
Guided exercise. x_now = 20, dt = 0.5 s, f_now = 4/s.
Detailed guided correction — open after trying
x_now = 20, dt = 0.5 s, f_now = 4/s. x_next = 20 + 0.5×4 = 22.
Autonomous exercise. x_now = 60, dt = 1.5 s, f_now = −2/s.
Autonomous correction — open after trying
x_now = 60, dt = 1.5 s, f_now = −2/s. x_next = 60 − 3 = 57.
- 21 — Mission decision
- Test convergence by reducing the step before using the result for a critical decision.
Trapezoidal integration over one step
- 1 — Concrete question
- What does “I_step = 0.5×(y_now + y_next)×dt” compute in “Trapezoidal integration over one step”?
- 2 — Intuition without symbols
- The trapezoidal rule uses the average of the two endpoints to approximate area under the curve.
- 3 — Quantities
- I_step: integrated contribution; y_now: starting value; y_next: ending value; dt: step duration
- 4 — Formula
- I_step = 0.5×(y_now + y_next)×dt
- 5 — Read aloud
- Read “I_step = 0.5×(y_now + y_next)×dt” by naming every operation, subscript and grouping explicitly.
- 6 — Symbols and meaning
- I_step: integrated contribution; y_now: starting value; y_next: ending value; dt: step duration
- 7 — Pronunciation
- The “Read aloud” line above is the oral reference for “Trapezoidal integration over one step”. Any subscript, exponent or grouping that changes the meaning of the relation should be spoken explicitly.
- 8 — Units
- I_step in y-unit times time; y in its unit; dt in time
- 9 — Convention
- For “Trapezoidal integration over one step”, substitute values without changing the reference frame, time basis, system boundary or sign convention halfway through the calculation. Stated units: I_step in y-unit times time; y in its unit; dt in time.
- 10 — Why this operation
- In “Trapezoidal integration over one step”, multiplication combines the factors that directly build the requested quantity; the factors must describe the same case.
- 11 — Assumptions
- The relation “I_step = 0.5×(y_now + y_next)×dt” applies here only to the scenario described by the card. Inputs must be mutually consistent and satisfy the physical assumptions associated with “Trapezoidal integration over one step”.
- 12 — Unit check
- I_step in y-unit times time; y in its unit; dt in time Verify that dimensional reduction reaches the unit of the requested output.
- 13 — Numerical case
- With y_now = 10 kW, y_next = 14 kW and dt = 2 h, I_step = 0.5×24×2 = 24 kWh.
- 14 — Why the calculation works
- The numerical case applies “I_step = 0.5×(y_now + y_next)×dt” directly to the stated values. The calculation is meaningful because the quantities are substituted into the same relation before the result is interpreted for “Trapezoidal integration over one step”.
- 15 — Independent check
- Quick check: for any non-zero factor, dividing the result by that factor should recover the other expected contribution in “Trapezoidal integration over one step”.
- 16 — Mental estimate
- Before calculating “Trapezoidal integration over one step” precisely, round the inputs to one useful digit and predict the sign and order of magnitude. The detailed result should remain consistent with that estimate.
- 17 — Interpretation
- Accuracy depends on actual curvature between points; two endpoints do not prove a linear profile.
- 18 — What the result does not prove
- For “Trapezoidal integration over one step”, the number obtained answers only the model “I_step = 0.5×(y_now + y_next)×dt” under the stated scenario. It does not by itself validate the input data or the model outside those conditions.
- 19 — Sensitivity
- Vary one input at a time around the nominal case to identify what drives the result of “Trapezoidal integration over one step” and whether that variation can change the mission decision.
- 20 — Guided and autonomous exercises
Guided exercise. y_now = 5, y_next = 9, dt = 3 s.
Detailed guided correction — open after trying
y_now = 5, y_next = 9, dt = 3 s. I_step = 0.5×14×3 = 21 unit·s.
Autonomous exercise. y_now = 20, y_next = 16, dt = 4 min.
Autonomous correction — open after trying
y_now = 20, y_next = 16, dt = 4 min. I_step = 0.5×36×4 = 72 unit·min.
- 21 — Mission decision
- Refine the mesh when the quantity changes rapidly or contains discontinuities.
Linear interpolation
- 1 — Concrete question
- What does “y = y1 + (x − x1)×(y2 − y1)/(x2 − x1)” compute in “Linear interpolation”?
- 2 — Intuition without symbols
- Between two points, linear interpolation allocates the change in proportion to the target position.
- 3 — Quantities
- y: interpolated value; x: target position; x1: first abscissa; x2: second abscissa; y1: first value; y2: second value
- 4 — Formula
- y = y1 + (x − x1)×(y2 − y1)/(x2 − x1)
- 5 — Read aloud
- Read “y = y1 + (x − x1)×(y2 − y1)/(x2 − x1)” by naming every operation, subscript and grouping explicitly.
- 6 — Symbols and meaning
- y: interpolated value; x: target position; x1: first abscissa; x2: second abscissa; y1: first value; y2: second value
- 7 — Pronunciation
- The “Read aloud” line above is the oral reference for “Linear interpolation”. Any subscript, exponent or grouping that changes the meaning of the relation should be spoken explicitly.
- 8 — Units
- x, x1 and x2 in one unit; y, y1 and y2 in one unit
- 9 — Convention
- For “Linear interpolation”, substitute values without changing the reference frame, time basis, system boundary or sign convention halfway through the calculation. Stated units: x, x1 and x2 in one unit; y, y1 and y2 in one unit.
- 10 — Why this operation
- In “Linear interpolation”, division relates a quantity to a reference, duration or capacity; the denominator must belong to the same case and remain non-zero.
- 11 — Assumptions
- The relation “y = y1 + (x − x1)×(y2 − y1)/(x2 − x1)” applies here only to the scenario described by the card. Inputs must be mutually consistent and satisfy the physical assumptions associated with “Linear interpolation”.
- 12 — Unit check
- x, x1 and x2 in one unit; y, y1 and y2 in one unit Verify that dimensional reduction reaches the unit of the requested output.
- 13 — Numerical case
- Between (x1=0, y1=10) and (x2=100, y2=30), at x=25, y = 10 + 25×20/100 = 15.
- 14 — Why the calculation works
- The numerical case applies “y = y1 + (x − x1)×(y2 − y1)/(x2 − x1)” directly to the stated values. The calculation is meaningful because the quantities are substituted into the same relation before the result is interpreted for “Linear interpolation”.
- 15 — Independent check
- Quick check: multiplying the result by the denominator should reconstruct the numerator of “Linear interpolation” within rounding.
- 16 — Mental estimate
- Before calculating “Linear interpolation” precisely, round the inputs to one useful digit and predict the sign and order of magnitude. The detailed result should remain consistent with that estimate.
- 17 — Interpretation
- Interpolation is reliable only when the function is sufficiently regular between the two points.
- 18 — What the result does not prove
- For “Linear interpolation”, the number obtained answers only the model “y = y1 + (x − x1)×(y2 − y1)/(x2 − x1)” under the stated scenario. It does not by itself validate the input data or the model outside those conditions.
- 19 — Sensitivity
- Vary one input at a time around the nominal case to identify what drives the result of “Linear interpolation” and whether that variation can change the mission decision.
- 20 — Guided and autonomous exercises
Guided exercise. x1=0, x2=10, y1=50, y2=70, x=4.
Detailed guided correction — open after trying
x1=0, x2=10, y1=50, y2=70, x=4. y = 50 + 4×20/10 = 58.
Autonomous exercise. x1=20, x2=40, y1=100, y2=160, x=35.
Autonomous correction — open after trying
x1=20, x2=40, y1=100, y2=160, x=35. y = 100 + 15×60/20 = 145.
- 21 — Mission decision
- Avoid unjustified extrapolation beyond the data bounds.
RSS combination of independent uncertainties
- 1 — Concrete question
- What does “u_total = sqrt(u1^2 + u2^2 + u3^2)” compute in “RSS combination of independent uncertainties”?
- 2 — Intuition without symbols
- Independent contributions do not systematically add in the same direction; root-sum-square reflects that structure.
- 3 — Quantities
- u_total: combined uncertainty; u1: first contribution; u2: second; u3: third
- 4 — Formula
- u_total = sqrt(u1^2 + u2^2 + u3^2)
- 5 — Read aloud
- Read “u_total = sqrt(u1^2 + u2^2 + u3^2)” by naming every operation, subscript and grouping explicitly.
- 6 — Symbols and meaning
- u_total: combined uncertainty; u1: first contribution; u2: second; u3: third
- 7 — Pronunciation
- The “Read aloud” line above is the oral reference for “RSS combination of independent uncertainties”. Any subscript, exponent or grouping that changes the meaning of the relation should be spoken explicitly.
- 8 — Units
- all uncertainty terms in the same unit
- 9 — Convention
- For “RSS combination of independent uncertainties”, substitute values without changing the reference frame, time basis, system boundary or sign convention halfway through the calculation. Stated units: all uncertainty terms in the same unit.
- 10 — Why this operation
- In “RSS combination of independent uncertainties”, the square root brings a quadratic quantity back to the scale of the requested quantity; the combined terms must follow the model assumptions.
- 11 — Assumptions
- The relation “u_total = sqrt(u1^2 + u2^2 + u3^2)” applies here only to the scenario described by the card. Inputs must be mutually consistent and satisfy the physical assumptions associated with “RSS combination of independent uncertainties”.
- 12 — Unit check
- all uncertainty terms in the same unit Verify that dimensional reduction reaches the unit of the requested output.
- 13 — Numerical case
- With u1 = 0.20 mm, u2 = 0.15 mm and u3 = 0.10 mm, u_total = sqrt(0.04+0.0225+0.01) ≈ 0.2693 mm.
- 14 — Why the calculation works
- The numerical case applies “u_total = sqrt(u1^2 + u2^2 + u3^2)” directly to the stated values. The calculation is meaningful because the quantities are substituted into the same relation before the result is interpreted for “RSS combination of independent uncertainties”.
- 15 — Independent check
- Quick check: squaring the result should reconstruct the expected quadratic quantity in “RSS combination of independent uncertainties”.
- 16 — Mental estimate
- Before calculating “RSS combination of independent uncertainties” precisely, round the inputs to one useful digit and predict the sign and order of magnitude. The detailed result should remain consistent with that estimate.
- 17 — Interpretation
- If contributions are correlated, covariance terms must be included instead of this simple form.
- 18 — What the result does not prove
- For “RSS combination of independent uncertainties”, the number obtained answers only the model “u_total = sqrt(u1^2 + u2^2 + u3^2)” under the stated scenario. It does not by itself validate the input data or the model outside those conditions.
- 19 — Sensitivity
- Vary one input at a time around the nominal case to identify what drives the result of “RSS combination of independent uncertainties” and whether that variation can change the mission decision.
- 20 — Guided and autonomous exercises
Guided exercise. u1=3, u2=4, u3=0.
Detailed guided correction — open after trying
u1=3, u2=4, u3=0. u_total = sqrt(9+16) = 5.
Autonomous exercise. u1=1, u2=2, u3=2.
Autonomous correction — open after trying
u1=1, u2=2, u3=2. u_total = sqrt(1+4+4) = 3.
- 21 — Mission decision
- Document independence and correlations before crediting RSS reduction.
1. Vectors and matrices: organize several quantities at once
A vector groups components that belong to one state: position x, y, z; velocity vx, vy, vz; or sensor errors. A matrix describes how several quantities combine. In space problems it can change reference frames, propagate covariance or linearize a system. Dimensional compatibility comes first: a 3×3 matrix can only multiply a compatible object. Writing dimensions before computing prevents many mistakes.
Engineering habit. For “vectors and matrices: organize several quantities at once”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
2. Derivatives and gradients: measure the rate of change
A derivative answers the question ‘how much does the output change when the input changes slightly?’ Velocity is the derivative of position, acceleration the derivative of velocity, and a gradient collects several partial derivatives. In design these ideas become sensitivity analysis: if mass rises by one percent, which mission variable reacts most strongly? A gradient helps rank parameters instead of changing everything blindly.
Engineering habit. For “derivatives and gradients: measure the rate of change”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
3. Differential equations: represent systems that evolve
Many physical laws connect a quantity to its derivative. The equation dv/dt=a says velocity evolves according to acceleration. For a tank, dm/dt can represent an outgoing mass flow; for a battery, dE/dt connects stored energy, generation and demand. A differential equation is therefore an evolution rule, not an abstract decoration. Initial and boundary conditions are as important as the equation itself.
Engineering habit. For “differential equations: represent systems that evolve”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
4. Numerical integration: move in small steps without fooling yourself
When an exact solution does not exist or is impractical, numerical integration advances time step by step. Euler is simple but can accumulate substantial error; Runge–Kutta samples several slopes during a step and generally improves accuracy. Time step is an engineering choice: too large hides dynamics, too small wastes computation. Convergence is checked by repeating the calculation with a finer step.
Engineering habit. For “numerical integration: move in small steps without fooling yourself”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
5. Interpolation, fitting and imperfect data
Measurements do not always arrive exactly when a model needs them. Interpolation estimates a value between samples. Fitting searches for model parameters that best explain a set of observations. Interpolation must be distinguished from extrapolation: predicting outside the measured range is much riskier. A smooth curve is never proof that the model is correct.
Engineering habit. For “interpolation, fitting and imperfect data”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
6. Probability, covariance and uncertainty propagation
A mission does not have a perfectly known position or an exactly constant consumption rate. Uncertainty is therefore represented using quantities such as standard deviations and covariances. Positive covariance means two errors tend to move together; negative covariance means they tend to move in opposite directions. Propagation asks how input uncertainty transforms into output dispersion.
Engineering habit. For “probability, covariance and uncertainty propagation”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
Approfondissement — Covariance: treat uncertainty as part of the state, not a footnote
A position estimate is not merely three coordinates. It should also carry uncertainty and the correlations among variables. These are commonly organized in a covariance matrix P. The symbol P denotes the matrix; diagonal elements contain variances, which are squared standard deviations, while off-diagonal elements describe how errors in two variables vary together. If position error along x tends to grow with velocity error along x, treating them as independent creates false confidence.
Suppose the standard deviation in one position coordinate is σₓ = 120 m, where σₓ means the standard deviation of x. A naïve statement of ±120 m still does not describe a two-dimensional landing ellipse. The ellipse also depends on the y uncertainty, x–y covariance and the chosen confidence level. During descent the covariance is propagated: sensors reduce some uncertainties, models add others and maneuvers rotate the geometry. Precision without an interval and assumptions is therefore incomplete information.
7. Monte Carlo: repeat the scenario to see a distribution
A Monte Carlo simulation randomly samples inputs from defined distributions and runs the model many times. The result is a distribution rather than one answer: median, percentiles and tails. This is powerful for nonlinear systems, but it cannot rescue a bad physical model. Unrealistic input distributions simply produce statistically precise nonsense.
Engineering habit. For “monte carlo: repeat the scenario to see a distribution”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
Approfondissement — Mission Monte Carlo: replace one nominal case with a distribution of outcomes
A mission flies once, but its model can fly thousands of times. In Monte Carlo analysis, uncertain inputs are sampled from distributions: mass, atmospheric density, wind, sensor bias, thrust, software timing and initial state. Each simulation produces an outcome such as landing point, propellant remaining, peak temperature or battery margin. After N trials, where N is the total number of simulations, the engineer sees a distribution rather than one answer and can count constraint violations.
If 18 of 20,000 landing simulations fall outside the safe region, the empirical frequency is 18 ÷ 20,000 = 0.0009, or 0.09%. That does not prove the real risk is exactly 0.09%. It depends on input distributions, correlations and model fidelity. The useful step is to inspect the failure cases, identify dominant variables and rerun after mitigation. Monte Carlo is not an exercise in producing a smooth histogram; it is a method for discovering which mechanisms create rare failures and whether engineering margin can eliminate or only reduce them.
8. Numerical conditioning and plausibility checks
A calculation can be mathematically defined yet numerically fragile. Subtracting nearly equal numbers or inverting an ill-conditioned matrix can amplify rounding errors. Engineers monitor orders of magnitude, units, residuals and stability. A durable rule remains: before trusting many decimal places, estimate the answer by hand and ask whether its sign and scale make physical sense.
Engineering habit. For “numerical conditioning and plausibility checks”, write the inputs, outputs, units and validity range first. Then build one nominal and one degraded case. This two-case approach prevents a correct equation from being mistaken for an operationally robust Mars architecture.
Approfondissement — Conditioning, scale and numbers that look more precise than the data
A numerical computation can be wrong even when every arithmetic operation is correct. The danger appears when a problem is ill-conditioned: a small change in the inputs produces a large change in the answer. Imagine computing a small displacement by subtracting two nearly equal large positions. If those positions are rounded, common significant digits cancel and the relative error in the displacement can become enormous. The first habit is therefore to inspect orders of magnitude before trusting a solver: which variables are around 10⁶, which are around 10⁻³, and which outputs are differences between almost equal values?
Sensitivity is often summarized by a condition number κ, the Greek letter kappa. Here κ measures how strongly relative input error can be amplified in the output. A κ near 1 describes a well-conditioned problem; a very large κ warns that tiny data errors may dominate the result. The number does not replace physics. It warns that carrying more digits in software may not rescue poor information. Navigation, orbit determination and parameter estimation all require the engineer to ask not only “what is the value?” but “how many digits are actually supported by the measurement process?”
Worked example step by step
Progressive exercise
- Choose a simple case and list every input with units.
- Compute the nominal result without margin.
- Vary the most uncertain parameter by ±20% and compare.
- Inject one credible failure and explain which indicator detects it.
- Decide whether the system continues, degrades or stops.
Reasoned solution
Validation mini-project
Prepare a two-to-four-page engineering note on one numerical problem from a Mars subsystem. State the physical question, assumptions and units, solve it by hand, check it with a second numerical method, test sensitivity to the dominant uncertainty, and end with the engineering decision supported by the result.
Common errors to detect
- mixing units or frames without explicit conversion;
- presenting calculated values as measured data;
- ignoring a model’s validity range;
- confusing numerical precision with physical accuracy;
- sizing only the nominal case with no margin or degraded mode.
Mission reasoning laboratory — connect the calculation to a real decision
Define the mathematical object before calculating
Many numerical failures start before the computer is involved. A vector needs a coordinate frame; a matrix needs an ordering of states; a derivative needs the variable with respect to which change is measured; a probability distribution needs a defined random quantity. Writing these meanings beside the symbols prevents correct algebra from answering the wrong physical question. In navigation, for example, subtracting two position vectors expressed in different frames can produce numbers with the correct unit of metres yet no valid geometric meaning.
Use refinement as evidence
A numerical result becomes more credible when it behaves predictably under refinement. Reduce the time step, tighten the solver tolerance or increase the number of samples and examine a mission-relevant output. The goal is not that every printed digit stays identical; it is that the result approaches a stable range at a rate consistent with the method. If halving a time step shifts predicted landing position by kilometres, the earlier result is not ready for operational use no matter how polished its plot looks.
Separate algorithm error from model error
A highly accurate numerical solution can still solve the wrong physical model. Integrating an ideal two-body orbit to machine precision does not capture atmospheric drag, third-body gravity or thrust errors if the mission needs them. Validation therefore has two layers: first show that the algorithm solves the equations accurately enough; then show that the equations and parameters represent reality well enough for the decision. Mixing these layers can lead teams to “improve” step size while ignoring the dominant physical uncertainty.
Respect conditioning and observability
Some problems amplify tiny input errors because the geometry itself provides weak information. Navigation with nearly parallel lines of sight is a classic example. The numerical solver may be perfectly stable, yet the state estimate remains uncertain because many solutions fit the measurements almost equally well. Perturb observations inside realistic noise bounds and examine the output spread. If small measurement changes create huge state changes, adding more decimal precision will not create missing information; a new measurement geometry or sensor may be required.
Treat Monte Carlo as a distribution, not a magic number
Monte Carlo analysis samples uncertain inputs repeatedly and reveals a distribution of outcomes. Its value depends on the input distributions, correlations, model fidelity and number of samples. Reporting only the mean hides tails that may drive mission risk. Plot percentiles, threshold exceedance and failure modes. Also check whether rare but physically possible combinations were excluded by convenient assumptions. A thousand runs of an unrealistic uncertainty model can give false confidence more efficiently than one careful engineering calculation.
Use interpolation inside evidence, extrapolation with caution
Interpolation estimates between known data points and is often reasonably controlled when the underlying function is smooth and sampling is adequate. Extrapolation projects beyond the data and can fail abruptly when regime changes occur. A thermal-property table measured between 250 and 320 K should not be extended casually to 500 K. The numerical method may return a neat value while the material physics has changed. Mark extrapolated regions explicitly and seek a model or data source valid in the new regime.
Keep a numerical credibility record
For every calculation that influences a mission decision, record the governing equations, units, solver, step or tolerance, reference case, sensitivity checks and known numerical limitations. This does not need to become bureaucratic documentation for every quick estimate; it does need to exist for safety-significant results. The record allows another engineer to reproduce the result, distinguish numerical choices from physical assumptions and understand why the chosen precision was sufficient rather than merely convenient.
Progressive exercises — solve first, then open the correction
Synthesis exercise — numerical credibility
A thermal model predicts a critical component temperature of 319.0 K using a 60 s time step, 316.8 K using 20 s and 316.3 K using 10 s. A separate high-fidelity reference for the same case is 316.0 K. Calculate the relative error of the 10 s result, describe the convergence pattern, and decide whether a further step-size check is justified before accepting the model.
Detailed correction — Synthesis exercise — numerical credibility
Relative error. |316.3−316.0|/316.0 ≈ 0.000949, or about 0.095%.
Convergence. The prediction moves toward a stable value as the step is reduced: the 20→10 s change is only 0.5 K compared with 2.2 K for 60→20 s.
Decision. The trend is encouraging but one additional refinement or an error-estimation method is justified when the acceptance limit is close to the predicted temperature.
Beginner vocabulary checkpoint
- vector — Ordered set of components representing a quantity such as position, velocity or force in a defined coordinate system.
- matrix — Rectangular array of numbers used to represent linear transformations, coupled equations or uncertainty relationships.
- derivative — Rate at which one quantity changes with respect to another, often time.
- gradient — Vector of partial derivatives that points toward the direction of greatest increase of a scalar field.
- differential equation — Equation relating a quantity to one or more of its derivatives.
- integration — Accumulation process that reconstructs a quantity from its rate of change over an interval.
- Euler method — First-order numerical integration method that advances a state using the derivative at the start of each step.
- Runge–Kutta method — Family of numerical integration methods using multiple derivative evaluations per step for improved accuracy.
- interpolation — Estimation of a value between known data points.
- extrapolation — Estimation beyond the range of known data; usually riskier than interpolation.
- residual — Difference between observed or required behaviour and the behaviour predicted by a model or current estimate.
- tolerance — Numerical threshold used to decide whether an iterative or verification criterion is sufficiently satisfied.
- iteration — One repeated update in a numerical method.
- convergence rate — Speed at which numerical error decreases as iterations or discretisation refinements proceed.
- round-off error — Error produced by finite numeric precision in computer arithmetic.
- truncation error — Error produced when an infinite or continuous mathematical process is approximated by a finite operation.
- floating-point — Computer representation of real numbers using a finite mantissa and exponent.
- condition number — Measure of how sensitive a mathematical problem is to small changes in its input.
- singular matrix — Matrix that has no ordinary inverse because its rows or columns do not provide independent information.
- covariance — Matrix or quantity describing how uncertainties vary and co-vary among estimated variables.
- Monte Carlo — Method that samples many uncertain cases to build a distribution of possible outcomes.
- random sample — One draw from a defined probability distribution used in statistical simulation.
- reference solution — Higher-confidence solution used to evaluate the accuracy of another numerical result.
- absolute error — Magnitude of the difference between a computed value and its reference.
- relative error — Absolute error scaled by the magnitude of a reference value.
- step-size sensitivity — Change in numerical output caused by changing the integration or discretisation step.
Decision closeout — evidence before acceptance
Acceptance thresholds belong to the decision
Numerical precision should be chosen from the engineering decision, not from the number of decimals a solver can print. If a landing-site exclusion boundary is kilometres wide, sub-millimetre integration precision has no operational value. If a control law changes mode at a narrow threshold, numerical error near that threshold may matter greatly. State the acceptable error on the mission quantity first, then choose solver tolerances and step sizes that demonstrate margin relative to that requirement. This reverses the common habit of choosing a convenient algorithm setting and only afterward asking whether the result was accurate enough.
Compare independent methods when consequences are high
When a result drives a safety-significant decision, use a second method that fails differently. A trajectory can be checked with a simpler analytic approximation, a thermal integration with an energy balance, or a least-squares estimate with a geometry-based uncertainty check. Agreement between methods does not prove truth, but disagreement reveals hidden assumptions quickly. The strongest independent check is often deliberately lower fidelity yet physically transparent, because it is less likely to share the same coding or discretisation defect as the primary model.
Preserve units and scales inside software interfaces
Many numerical failures are interface failures: kilometres passed where metres were expected, degrees treated as radians, seconds mixed with milliseconds, or state components ordered differently between routines. The arithmetic can remain internally consistent while the physical answer is wrong by orders of magnitude. Use explicit unit conversion at boundaries, automated dimensional tests where practical, and small hand-computed cases whose answer is known. For Mars operations, a unit mistake in a stored parameter can propagate through navigation, power or life-support calculations long after the original code was reviewed.
