Kronecker Products and Matrix Calculus with Applications
()
About this ebook
After the preliminaries of an introductory chapter, the treatment proceeds to examinations of the Kronecker product and its applications. An introduction to matrix calculus is followed by further development of the subject, including an application of Kronecker products. Final chapters explore the derivative of a matrix and some applications of matrix calculus. The text concludes with solutions to the problems that appear at the end of each chapter and helpful tables of formulae and derivatives.
Read more from Alexander Graham
Matrix Theory and Applications for Scientists and Engineers Rating: 0 out of 5 stars0 ratings
Related to Kronecker Products and Matrix Calculus with Applications
Titles in the series (100)
Analytic Inequalities Rating: 5 out of 5 stars5/5Methods of Applied Mathematics Rating: 3 out of 5 stars3/5An Introduction to Lebesgue Integration and Fourier Series Rating: 0 out of 5 stars0 ratingsNumerical Methods Rating: 5 out of 5 stars5/5The Calculus Primer Rating: 0 out of 5 stars0 ratingsFirst-Order Partial Differential Equations, Vol. 2 Rating: 0 out of 5 stars0 ratingsLaplace Transforms and Their Applications to Differential Equations Rating: 5 out of 5 stars5/5Dynamic Probabilistic Systems, Volume II: Semi-Markov and Decision Processes Rating: 0 out of 5 stars0 ratingsFirst-Order Partial Differential Equations, Vol. 1 Rating: 5 out of 5 stars5/5Infinite Series Rating: 4 out of 5 stars4/5Linear Algebra Rating: 3 out of 5 stars3/5A Catalog of Special Plane Curves Rating: 2 out of 5 stars2/5History of the Theory of Numbers, Volume II: Diophantine Analysis Rating: 0 out of 5 stars0 ratingsHow to Gamble If You Must: Inequalities for Stochastic Processes Rating: 0 out of 5 stars0 ratingsAn Adventurer's Guide to Number Theory Rating: 4 out of 5 stars4/5Topology for Analysis Rating: 4 out of 5 stars4/5Introduction to the Theory of Abstract Algebras Rating: 0 out of 5 stars0 ratingsCalculus: An Intuitive and Physical Approach (Second Edition) Rating: 4 out of 5 stars4/5Calculus Refresher Rating: 3 out of 5 stars3/5Elementary Matrix Algebra Rating: 3 out of 5 stars3/5Theory of Approximation Rating: 0 out of 5 stars0 ratingsApplied Multivariate Analysis: Using Bayesian and Frequentist Methods of Inference, Second Edition Rating: 0 out of 5 stars0 ratingsFourier Series and Orthogonal Polynomials Rating: 0 out of 5 stars0 ratingsGeometry: A Comprehensive Course Rating: 4 out of 5 stars4/5Theory of Games and Statistical Decisions Rating: 4 out of 5 stars4/5Counterexamples in Topology Rating: 4 out of 5 stars4/5The History of the Calculus and Its Conceptual Development Rating: 4 out of 5 stars4/5Advanced Calculus: Second Edition Rating: 5 out of 5 stars5/5A History of Mathematical Notations Rating: 4 out of 5 stars4/5Mathematics in Ancient Greece Rating: 5 out of 5 stars5/5
Related ebooks
Special Matrices and Their Applications in Numerical Mathematics: Second Edition Rating: 5 out of 5 stars5/5Vector Spaces and Matrices Rating: 0 out of 5 stars0 ratingsMatrix Operations for Engineers and Scientists: An Essential Guide in Linear Algebra Rating: 0 out of 5 stars0 ratingsComplex Variable Methods in Elasticity Rating: 0 out of 5 stars0 ratingsThe Theory of Matrices in Numerical Analysis Rating: 4 out of 5 stars4/5Applied Complex Variables Rating: 5 out of 5 stars5/5Foundations of Applied Mathematics Rating: 3 out of 5 stars3/5Introduction to Differential Geometry for Engineers Rating: 0 out of 5 stars0 ratingsDifferential Equations for Engineers and Scientists Rating: 0 out of 5 stars0 ratingsLaplace Transforms and Their Applications to Differential Equations Rating: 5 out of 5 stars5/5Advanced Mathematics for Engineers and Scientists Rating: 4 out of 5 stars4/5Matrix Theory Rating: 0 out of 5 stars0 ratingsNonlinear Differential Equations Rating: 0 out of 5 stars0 ratingsIntroductory Complex Analysis Rating: 4 out of 5 stars4/5A First Course in Functional Analysis Rating: 0 out of 5 stars0 ratingsLinear Algebra Rating: 1 out of 5 stars1/5Determinants and Matrices Rating: 3 out of 5 stars3/5Complex Analysis Rating: 3 out of 5 stars3/5Notes on the Quantum Theory of Angular Momentum Rating: 0 out of 5 stars0 ratingsBasic Abstract Algebra: For Graduate Students and Advanced Undergraduates Rating: 4 out of 5 stars4/5Advanced Calculus: Second Edition Rating: 5 out of 5 stars5/5Vector Calculus Using Mathematica Second Edition Rating: 0 out of 5 stars0 ratingsMethods of Applied Mathematics Rating: 3 out of 5 stars3/5Introduction to Abstract Algebra Rating: 3 out of 5 stars3/5Applied Partial Differential Equations Rating: 5 out of 5 stars5/5An Introduction to Linear Algebra and Tensors Rating: 1 out of 5 stars1/5Introduction to Numerical Analysis: Second Edition Rating: 4 out of 5 stars4/5Introduction to the Theory of Abstract Algebras Rating: 0 out of 5 stars0 ratingsMatrices and Linear Algebra Rating: 4 out of 5 stars4/5Dynamical Systems Rating: 4 out of 5 stars4/5
Mathematics For You
My Best Mathematical and Logic Puzzles Rating: 4 out of 5 stars4/5Standard Deviations: Flawed Assumptions, Tortured Data, and Other Ways to Lie with Statistics Rating: 4 out of 5 stars4/5Calculus Made Easy Rating: 4 out of 5 stars4/5Real Estate by the Numbers: A Complete Reference Guide to Deal Analysis Rating: 0 out of 5 stars0 ratingsQuantum Physics for Beginners Rating: 4 out of 5 stars4/5What If?: Serious Scientific Answers to Absurd Hypothetical Questions Rating: 5 out of 5 stars5/5Sneaky Math: A Graphic Primer with Projects Rating: 0 out of 5 stars0 ratingsBasic Math & Pre-Algebra For Dummies Rating: 4 out of 5 stars4/5The Little Book of Mathematical Principles, Theories & Things Rating: 3 out of 5 stars3/5Math Magic: How To Master Everyday Math Problems Rating: 3 out of 5 stars3/5The Everything Guide to Algebra: A Step-by-Step Guide to the Basics of Algebra - in Plain English! Rating: 4 out of 5 stars4/5Algebra - The Very Basics Rating: 5 out of 5 stars5/5Algebra II For Dummies Rating: 3 out of 5 stars3/5Pre-Calculus For Dummies Rating: 5 out of 5 stars5/5Relativity: The special and the general theory Rating: 5 out of 5 stars5/5Alan Turing: The Enigma: The Book That Inspired the Film The Imitation Game - Updated Edition Rating: 4 out of 5 stars4/5Mental Math Secrets - How To Be a Human Calculator Rating: 5 out of 5 stars5/5Logicomix: An epic search for truth Rating: 4 out of 5 stars4/5Algebra I Workbook For Dummies Rating: 3 out of 5 stars3/5The Golden Ratio: The Divine Beauty of Mathematics Rating: 5 out of 5 stars5/5How to Solve It: A New Aspect of Mathematical Method Rating: 4 out of 5 stars4/5Summary of The Black Swan: by Nassim Nicholas Taleb | Includes Analysis Rating: 5 out of 5 stars5/5Statistics: a QuickStudy Laminated Reference Guide Rating: 0 out of 5 stars0 ratingsHow Math Explains the World: A Guide to the Power of Numbers, from Car Repair to Modern Physics Rating: 3 out of 5 stars3/5Flatland Rating: 4 out of 5 stars4/5Calculus For Dummies Rating: 4 out of 5 stars4/5
Reviews for Kronecker Products and Matrix Calculus with Applications
0 ratings0 reviews
Book preview
Kronecker Products and Matrix Calculus with Applications - Alexander Graham
KRONECKER PRODUCTS & MATRIX CALCULUS WITH APPLICATIONS
KRONECKER PRODUCTS & MATRIX CALCULUS WITH APPLICATIONS
ALEXANDER GRAHAM
M.A., M.Sc., Ph.D.
Dover Publications, Inc.
Mineola, New York
Copyright
Copyright © 1981, 2018 by
Alexander Graham All rights reserved.
Bibliographical Note
This Dover edition, first published in 2018, is a slightly corrected republication of the work originally published by Ellis Horwood Limited, Chichester, West Sussex, England, in 1981.
International Standard Book Number
ISBN-13: 978-0-486-82417-8
ISBN-10: 0-486-82417-9
Manufactured in the United States by LSC Communications
82417901 2018
www.doverpublications.com
Table of Contents
Author’s Preface
Symbols and Notation Used
Chapter 1 – Preliminaries
1.1 Introduction
1.2 Unit Vectors and Elementary Matrices
1.3 Decompositions of a Matrix
1.4 The Trace Function
1.5 The Vec Operator
Problems for Chapter 1
Chapter 2 – The Kronecker Product
2.1 Introduction
2.2 Definition of the Kronecker Product
2.3 Some Properties and Rules for Kronecker Products
2.4 Definition of the Kronecker Sum
2.5 The Permutation Matrix associating vec X and vec X ′
Problems for Chapter 2
Chapter 3 – Some Applications of the Kronecker Product
3.1 Introduction
3.2 The Derivative of a Matrix
3.3 Problem 1: solution of AX + XB = C
3.4 Problem 2: solution of AX − XA = μX
3.7 Problem 5: solution of AXB = C
3.8 Problem 6: Pole assignment for a Multivariable System
Chapter 4 – Introduction to Matrix Calculus
4.1 Introduction
4.2 The Derivatives of Vectors
4.3 The Chain rule for Vectors
4.4 The Derivative of Scalar Functions of a Matrix with respect to a Matrix
4.5 The Derivative of a Matrix with respect to one of its Elements and Conversely
4.6 The Derivatives of the Powers of a Matrix
Problems for Chapter 4
Chapter 5 – Further Development of Matrix Calculus including an Application of Kronecker Products
5.1 Introduction
5.2 Derivatives of Matrices and Kronecker Products
5.3 The Determination of ( ∂ vec X )/( ∂ vec Y ) for more complicated Equations
5.4 More on Derivatives of Scalar Functions with respect to a Matrix
5.5 The Matrix Differential
Problems for Chapter 5
Chapter 6 – The Derivative of a Matrix with respect to a Matrix
6.1 Introduction
6.2 The Definition and some Results
6.3 Product Rules for Matrices
6.4 The Chain Rule for the Derivative of a Matrix with respect to Matrix
Problems for Chapter 6
Chapter 7 – Some Applications of Matrix Calculus
7.1 Introduction
7.2 The Problems of Least Squares and Constrained Optimization in Scalar Variables
7.3 Problem 1: Matrix Calculus Approach to the Problems of Least Squares and Constrained Optimization
7.4 Problem 2: The General Least Squares Problem
7.5 Problem 3: Maximum Likelihood Estimate of the Multivariate Normal
7.6 Problem 4: Evaluation of the Jacobians of some Transformations
7.7 Problem 5: To Find the Derivative of an Exponential Matrix with respect to a Matrix
Solution to Problems
Tables of Formulae and Derivatives
Bibliography
Index
Author’s Preface
My purpose in writing this book is to bring to the attention of the reader, some recent developments in the field of Matrix Calculus. Although some concepts, such as Kronecker matrix products, the vector derivative etc. are mentioned in a few specialised books, no book, to my knowledge, is totally devoted to this subject. The interested researcher must consult numerous published papers to appreciate the scope of the concepts involved.
Matrix calculus applicable to square matrices was developed by Turnbull [29, 30] as far back as 1927. The theory presented in this book is based on the works of Dwyer and McPhail [15] published in 1948 and others mentioned in the Bibliography. It is more general than Turnbull’s development and is applicable to non-square matrices. But even this more general theory has grave limitations, in particular it requires that in general the matrix elements are non constant and independent. A symmetric matrix, for example, is treated as a special case. Methods of overcoming some of these limitations have been suggested, but I am not aware of any published theory which is both quite general and simple enough to be useful.
The book is organised in the following way:
Chapter 1 concentrates on the preliminaries of matrix theory and notation which is found useful throughout the book. In particular, the simple and useful elementary matrix is defined. The vec