0% found this document useful (0 votes)
12 views12 pages

The Title

The document discusses the Gauss-Newton method for solving nonlinear least squares problems. It explains that the Gauss-Newton method linearizes the nonlinear regression function around the current estimate using a first-order Taylor series expansion, turning the nonlinear minimization problem into a quadratic programming problem. The method is useful for parameter estimation in engineering and scientific applications as it avoids evaluating second derivatives and allows iterative refinement of parameter estimates.

Uploaded by

mamadou.thiam
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
12 views12 pages

The Title

The document discusses the Gauss-Newton method for solving nonlinear least squares problems. It explains that the Gauss-Newton method linearizes the nonlinear regression function around the current estimate using a first-order Taylor series expansion, turning the nonlinear minimization problem into a quadratic programming problem. The method is useful for parameter estimation in engineering and scientific applications as it avoids evaluating second derivatives and allows iterative refinement of parameter estimates.

Uploaded by

mamadou.thiam
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 12

The Title

Firstname Middlename Surname ([email protected])


African Institute for Mathematical Sciences (AIMS), Senegal
Supervised by: Title Firstname Middlename Surname
Institute of Supervisor, Country

June 1, 2024
Submitted in partial fulfilment of the requirements for the award of Master of Science in Mathematical Sciences at AIMS Senegal
DECLARATION
This work was carried out at AIMS Senegal in partial fulfilment of the requirements for a Master
of Science Degree.
I hereby declare that except where due acknowledgement is made, this work has never been
presented wholly or in part for the award of a degree at AIMS Senegal or any other University.

Student: Firstname Middlename Surname

i
ACKNOWLEDGEMENTS
This is optional and should be at most half a page. Thanks Ma, Thanks Pa. One paragraph in
normal language is the most respectful.
Do not use too much bold, any figures, or sign at the bottom.

ii
DEDICATION
This is optional.

iii
Abstract
A short, abstracted description of your essay goes here. It should be about 100 words long. But
write it last.
An abstract is not a summary of your essay: it’s an abstraction of that. It tells the readers why
they should be interested in your essay but summarises all they need to know if they read no
further.
The writing style used in an abstract is like the style used in the rest of your essay: concise, clear
and direct. In the rest of the essay, however, you will introduce and use technical terms. In the
abstract you should avoid them in order to make the result comprehensible to all.
You may like to repeat the abstract in your mother tongue.

iv
Contents
Declaration i

Acknowledgements ii

Dedication iii

Abstract iv

1 Introduction 1
1.1 Section : Moving On . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

2 Gauss Newton Method 2


2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.2 More . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

3 Gauss Newton Method 4


3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
3.2 My Second Section . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
3.2.1 My First SubSection . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
3.2.2 My Second SubSection . . . . . . . . . . . . . . . . . . . . . . . . . . 4

4 Conclusion 5

References 6

v
1. Introduction
Explain the context of your essay topic, so that the topic itself appears motivated, natural and
important.
Paragraphs are separated by blank lines in the LATEX code, Please use the parenthetical citation
format [9] for all of your references.

1.1 Section : Moving On


Let’s demonstrate a figure by looking at Fig. 1.1.

Figure 1.1: Prof. Neil Geoffrey Turok is a South African physicist. He founded AIMS in 2003
and he is currently Chair of the AIMS South Africa Council and Chair of the Board of AIMS-NEI.

Here is an example of inserting a python code by using the listings’ package. You can still include
code with verbatim and to fix the tabs in python in a verbatim environment.

 Listing 1.1: Example of Python code 


1 import numpy as np
2 from lib . analytical import csa
3
4 # This program prints hello
5
6 import Scipy as S
7
8 if __name__ == " __main__ " :
9 print " hello "
 

 Listing 1.2: Here is another example 


1 class example ( object ) :
2 pass
 

1
2. Gauss Newton Method
2.1 Introduction
The Gauss-Newton method was first proposed by Gauss for solving a nonlinear least squares
problem. Its idea is to linearize the nonlinear regression function around the current estimate of
an unknown parameter by the first order Taylor series expansion and hence turn the nonlinear
minimization problem into a simple quadratic programming one. While it is straightforward to
minimize the resulting quadratic function, importantly it avoids the evaluation of the second
derivatives of the regression function, which would be needed by Newton’s method and which
could be both computationally and analytically.
In the context of optimizing the parameters of dynamic system, the Gauss-Newton method
provides an efficient and effective approach. Dynamic system , often involve complex models
where that relationship between the parameters and the system’s behavior is nonlinear. By
applying the Gauss-Newton method, we can iteratively refine the parameter estimates to minimize
the discrepancy between the observed system behavior and the model predictions.
This is achieved by repeatedly linearizing the model around the current parameter estimates,
solving the resulting linear least squares problem, and updating the parameter accordingly, the
absence of the need to compute second derivatives simplifies the optimization process, making it
particularly suitable for real-time and large scale where computational efficiency is crucial.
Moreover, the method’s reliance on the first- order Taylor series expansion means that each
iteration is relatively inexpensive involving the computation of gradient and the solution of a
linear system. As a result, the Gauss-Newton method strikes a balance between computational
feasibility and the ability to handle the nonlinearity inherent in dynamic system, making it a
valuable tool for parameter estimation in various engineering scientific applications.

2.2 More
The rest remains the same but the numbering is now independent. Here’s an example of lemma
Lemma 2.2.1 (My Lemma 1). This is my first lemma.

and here’s the first definition


Definition 2.2.1 (Definition 1). This is my first définition for this section.

here’s a example of stating a conjecture


Conjecture 2.2.1. The washing operation has fixed points.

and here’s the second lemma...


Lemma 2.2.2 (My Lemma 2). This is my second lemma.

2
Section 2.2. More Page 3

here’s the second definition and so on...

Definition 2.2.2 (Definition 2). This is my second definition.


3. Gauss Newton Method
Now you’re demonstrating pure talent and newly acquired skills. Perhaps some persistence.
Definitely some inspiration. What was that about perspiration? Some team work helps, so every
now and then why not browse your friends’ essays and provide some constructive feedback?

3.1 Introduction

3.2 My Second Section


Now you’re demonstrating pure talent and newly acquired skills. Perhaps some persistence.
Definitely some inspiration. What was that about perspiration? Some team work helps, so every
now and then why not browse your friends’ essays and provide some constructive feedback?

3.2.1 My First SubSection

SubSection is now working properly

3.2.1.1 My First SubSubSection

Here’s an example of subsubsection

3.2.1.2 My Second SubSubSection

and here’s another one

3.2.2 My Second SubSection

Now let’s hope that everyone is happy!

4
4. Conclusion
An average essay may contain five chapters, but I didn’t plan my work properly and then ran out of
time. I spent too much time positioning my figures and worrying about my preferred typographic
style, rather than just using what was provided. I wasted days bolding section headings and using
double slash line endings, and had to remove them all again. I spent sleepless nights configuring
manually numbered lists to use the LATEX environments because I didn’t use them from the start
or understand how to search and replace easily with texmaker.

5
References
[1] Alan Adolphson, Steven Sperber, and Marvin Tretkoff, editors. p-adic Methods in Number
Theory and Algebraic Geometry. Number 133 in Contemporary Mathematics. American
Mathematical Society, Providence, RI, 1992.

[2] Alan Beardon. From problem solving to research, 2006. Unpublished manuscript.

[3] Matthew Davey. Error-correction using Low-Density Parity-Check Codes. Phd, University
of Cambridge, 1999.

[4] Leslie Lamport. LATEX: A Document Preparation System. Addison-Wesley, 1986.

[5] D. J. C. MacKay and R. M. Neal. Good codes based on very sparse matrices. Available
from www.inference.phy.cam.ac.uk, 1995.

[6] David MacKay. Statistical testing of high precision digitisers. Technical Report 3971, Royal
Signals and Radar Establishment, Malvern, Worcester. WR14 3PS, 1986.

[7] David MacKay. A free energy minimization framework for inference problems in modulo
2 arithmetic. In B. Preneel, editor, Fast Software Encryption (Proceedings of 1994 K.U.
Leuven Workshop on Cryptographic Algorithms), number 1008 in Lecture Notes in Computer
Science Series, pages 179–195. Springer, 1995.

[8] Claude Shannon. A mathematical theory of communication. Bell Sys. Tech. J., 27:379–423,
623–656, 1948.

[9] Claude Shannon. The best detection of pulses. In N. J. A. Sloane and A. D. Wyner, editors,
Collected Papers of Claude Shannon, pages 148–150. IEEE Press, New York, 1993.

[10] Commercial mobile robot simulation software. Webots, www.cyberbotics.com, Accessed


April 2013.

[11] Black scholes. Wikipedia, the Free Encyclopedia, http://en.wikipedia.org/wiki/Black%E2%


80%93Scholes, Accessed April 2012.

You might also like