Bayesian Logical Data Analysis for the Physical Sciences

An important part of the life of any physical scientist is comparing theoretical models to data. We now begin three chapters devoted to the nuts and bolts of model fitting. In this chapter, we focus on linear models. [1] By a linear model, we mean a model that is linear with respect to the model parameters, not (necessarily) with respect to the indicator variables labeling the data. We will encounter the method of linear least-squares, which is so familiar to most undergraduate science students, but we will see it as a special case in a more general Bayesian treatment.
Examples of linear models:
![]()
where A 0, A 1,... are the linear model parameters, and x i is the independent (indicator) variable.
f i , j = A 0 + A 1 x i + A 2 y j + A 3 x i y j
where A 0, A 1,... are the linear model parameters, and x i, y j are a pair of independent variables.
f i = A 1 cos ?t i + A 2 sin ?t i
where A 1, A 2 are the linear model parameters, and ? is a known constant.
T i = Tf i,
where T is the linear parameter, and f i is a Gaussian line shape of the form
, and ?