Skip to content

Commit eceae80

Browse files
authored
Fix minor formatting issues in mathematical equations
1 parent fef2298 commit eceae80

6 files changed

+29
-28
lines changed

docs/book/1 - Introduction.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ Extensive resources, including excellent textbooks covering linear system identi
3030

3131
While most real world systems are nonlinear, you probably should give linear models a try first. Linear models usually serves as a strong baseline and can be good enough for your case, giving satisfactory performance. [Astron and Murray](https://www.cds.caltech.edu/~murray/books/AM05/pdf/am06-complete_16Sep06.pdf) and [Glad and Ljung](https://www.taylorfrancis.com/books/mono/10.1201/9781315274737/control-theory-lennart-ljung-torkel-glad) showed that many nonlinear systems can be well described by locally linear models. Besides, linear models are easy to fit, easy to interpret, and requires less computational resources than nonlinear models, allowing you to experiment fast and gather insights before thinking about gray box models or complex nonlinear models.
3232

33-
Linear models can be very useful, even in the presence of strong nonlinearities, because it is much easier to deal with it. Moreover, the development of linear identification algorithms is still a very active and healthy research field, with many papers being released every year [Sai Li, Linjun Zhang, T. Tony Cai & Hongzhe Li](Sai Li, Linjun Zhang, T. Tony Cai & Hongzhe Li), [Maria Jaenada, Leandro Pardo](https://www.mdpi.com/1099-4300/24/1/123), [Xing Liu; Lin Qiu, Youtong Fang; Kui Wang; Yongdong Li, Jose Rodríguez](https://ieeexplore.ieee.org/abstract/document/10296948), [Alessandro D’Innocenzo and Francesco Smarra](https://www.paperhost.org/proceedings/controls/ECC24/files/0026.pdf). Linear models works well most of the time, and should be
33+
Linear models can be very useful, even in the presence of strong nonlinearities, because it is much easier to deal with it. Moreover, the development of linear identification algorithms is still a very active and healthy research field, with many papers being released every year [Sai Li, Linjun Zhang, T. Tony Cai & Hongzhe Li](Sai Li, Linjun Zhang, T. Tony Cai & Hongzhe Li), [Maria Jaenada, Leandro Pardo](https://www.mdpi.com/1099-4300/24/1/123), [Xing Liu; Lin Qiu, Youtong Fang; Kui Wang; Yongdong Li, Jose Rodríguez](https://ieeexplore.ieee.org/abstract/document/10296948), [Alessandro D’Innocenzo and Francesco Smarra](https://www.paperhost.org/proceedings/controls/ECC24/files/0026.pdf). Linear models work well most of the time and should be the first choice for many applications. However, when dealing with complex systems where linear assumptions don’t hold, nonlinear models become essential.
3434

3535
### Nonlinear Models
3636

docs/book/2 - NARMAX Model Representation.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -1344,7 +1344,7 @@ $$
13441344
\tag{2.34}
13451345
$$
13461346

1347-
where $Xk ~= \{x_{{_1}k}, x_{{_2}k}, \dotsc, x_{{_r}k}\}\in \mathbb{R}^{n^i_{x{_r}}}$ and $\boldsymbol Yk~= \{y_{{_1}k}, y_{{_2}k}, \dotsc, y_{{_s}k}\}\in \mathbb{R}^{n^i_{y{_s}}}$. The number of possibles terms of MIMO NARX model given the $i$-th polynomial degree, $\ell_i$, is:
1347+
where $Xk ~= \{x_{{_1}k}, x_{{_2}k}, \dotsc, x_{{_r}k}\}\in \mathbb{R}^{n^i_{x{_r}}}$ and $Yk~= \{y_{{_1}k}, y_{{_2}k}, \dotsc, y_{{_s}k}\}\in \mathbb{R}^{n^i_{y{_s}}}$. The number of possibles terms of MIMO NARX model given the $i$-th polynomial degree, $\ell_i$, is:
13481348

13491349
$$
13501350
\begin{equation}

docs/book/4 - Model Structure Selection (MSS).md

+3-4
Original file line numberDiff line numberDiff line change
@@ -209,12 +209,10 @@ $$
209209
Thus, the ERR due to the inclusion of the regressor $q_{{_i}}$ is expressed as:
210210

211211
$$
212-
\begin{align}
213-
[\text{ERR}]_i = \frac{g_{_i}^2q_{_i}^\topq_{_i} }{Y^\topY}, \qquad \text{for~} i=1,2,\dotsc, n_\Theta.
214-
\end{align}
215-
\tag{16}
212+
[\text{ERR}]_i = \frac{g_{i}^2 \cdot q_{i}^\top q_{i}}{Y^\top Y}, \qquad \text{for } i=1,2,\dotsc, n_\Theta.
216213
$$
217214

215+
218216
There are many ways to terminate the algorithm. An approach often used is stop the algorithm if the model output variance drops below some predetermined limit $\varepsilon$:
219217

220218
$$
@@ -252,6 +250,7 @@ $$
252250
\left\langle x, y\right\rangle = \left\langle \hat{\theta} x, x\right\rangle = \hat{\theta} \left\langle x, x\right\rangle
253251
\tag{20}
254252
$$
253+
255254
Which implies that
256255

257256
$$

docs/book/5 - Multiobjective Parameter Estimation.md

+17-20
Original file line numberDiff line numberDiff line change
@@ -621,21 +621,19 @@ So
621621
$$
622622
q_i =
623623
\begin{bmatrix}
624-
0 & 0\\
625-
1 & 0\\
626-
2 & 0\\
627-
1 & 1\\
628-
2 & 1\\
624+
0 & 0 \\
625+
1 & 0 \\
626+
2 & 0 \\
627+
1 & 1 \\
628+
2 & 1 \\
629629
\end{bmatrix}
630-
631630
=
632-
633631
\begin{bmatrix}
634-
1\\
635-
\overline{y}\\
636-
\overline{u}\\
637-
\overline{y^2}\\
638-
\overline{u}\:\overline{y}\\
632+
1 \\
633+
\overline{y} \\
634+
\overline{u} \\
635+
\overline{y^2} \\
636+
\overline{u} \cdot \overline{y} \\
639637
\end{bmatrix}
640638
$$
641639

@@ -944,17 +942,16 @@ $$
944942
$$
945943
q_i =
946944
\begin{bmatrix}
947-
0 & 0\\
948-
1 & 0\\
949-
2 & 0\\
950-
2 & 2\\
945+
0 & 0 \\
946+
1 & 0 \\
947+
2 & 0 \\
948+
2 & 2 \\
951949
\end{bmatrix}
952950
=
953-
954951
\begin{bmatrix}
955-
1\\
956-
\overline{y}\\
957-
\overline{u}\\
952+
1 \\
953+
\overline{y} \\
954+
\overline{u} \\
958955
\overline{u^2}
959956
\end{bmatrix}
960957
$$

docs/book/8 - Severely Nonlinear System Identification.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
We have categorized systems into two different classes for now:** linear systems** and **nonlinear** systems. As mentioned, **linear systems** has been extensively studied with several different well-established methods available, while **nonlinear** systems is a very active field with several problems that are still open for research. Besides linear and nonlinear systems, there are the ones called **Severely Nonlinear Systems**. Severely Nonlinear Systems are the ones that exhibit highly complex and exotic dynamic behaviors like sub-harmonics, chaotic behavior and hysteresis. For now, we will focus on system with hysteresis.
1+
We have categorized systems into two different classes for now: **linear systems** and **nonlinear** systems. As mentioned, **linear systems** has been extensively studied with several different well-established methods available, while **nonlinear** systems is a very active field with several problems that are still open for research. Besides linear and nonlinear systems, there are the ones called **Severely Nonlinear Systems**. Severely Nonlinear Systems are the ones that exhibit highly complex and exotic dynamic behaviors like sub-harmonics, chaotic behavior and hysteresis. For now, we will focus on system with hysteresis.
22

33
## Modeling Hysteresis With Polynomial NARX Model
44

docs/book/9 - Validation.md

+6-1
Original file line numberDiff line numberDiff line change
@@ -132,7 +132,12 @@ $$
132132

133133
where $\hat{y}_k \in \mathbb{R}$ the model predicted output and $\bar{y} \in \mathbb{R}$ the mean of the measured output $y_k$. The RRSE gives some indication regarding the quality of the model, but concluding about the best model by evaluating only this quantity may leads to an incorrect interpretation, as shown in following example.
134134

135-
Consider the models $y_{{_a}k} = 0.7077y_{{_a}k-1} + 0.1642u_{k-1} + 0.1280u_{k-2}$ and $y_{{_b}k}=0.7103y_{{_b}k-1} + 0.1458u_{k-1} + 0.1631u_{k-2} -1467y^3_{{_b}k-1} + 0.0710y^3_{{_b}k-2} +0.0554y^2_{{_b}k-3}u_{k-3}$ defined in the [Meta Model Structure Selection: An Algorithm For Building Polynomial NARX Models For Regression And Classification](https://ufsj.edu.br/portal2-repositorio/File/ppgel/225-2020-02-17-DissertacaoWilsonLacerda.pdf). The former results in a $RRSE = 0.1202$ while the latter gives $RRSE~=0.0857$. Although the model $y_{{_b}k}$ fits the data better, it is only a biased representation to one piece of data and not a good description of the entire system.
135+
Consider the models
136+
$$
137+
y_{{_a}k} = 0.7077y_{{_a}k-1} + 0.1642u_{k-1} + 0.1280u_{k-2}
138+
$$
139+
140+
and $y_{{_b}k}=0.7103y_{{_b}k-1} + 0.1458u_{k-1} + 0.1631u_{k-2} -1467y^3_{{_b}k-1} + 0.0710y^3_{{_b}k-2} +0.0554y^2_{{_b}k-3}u_{k-3}$ defined in the [Meta Model Structure Selection: An Algorithm For Building Polynomial NARX Models For Regression And Classification](https://ufsj.edu.br/portal2-repositorio/File/ppgel/225-2020-02-17-DissertacaoWilsonLacerda.pdf). The former results in a $RRSE = 0.1202$ while the latter gives $RRSE~=0.0857$. Although the model $y_{{_b}k}$ fits the data better, it is only a biased representation to one piece of data and not a good description of the entire system.
136141

137142
The RRSE (or any other metric) shows that validations test might be performed carefully. Another traditional practice is split the data set in two parts. In this respect, one can test the models obtained from the estimation part of the data using an specific data for validation. However, the one-step-ahead performance of NARX models generally results in misleading interpretations because even strongly biased models may fit the data well. Therefore, a free run simulation approach usually allows a better interpretation if the model is adequate or not ([Billings, S. A.](https://www.wiley.com/en-us/Nonlinear+System+Identification%3A+NARMAX+Methods+in+the+Time%2C+Frequency%2C+and+Spatio-Temporal+Domains-p-9781119943594)).
138143

0 commit comments

Comments
 (0)