World Library  
Flag as Inappropriate
Email this Article

Richard E. Bellman

Article Id: WHEBN0000730173
Reproduction Date:

Title: Richard E. Bellman  
Author: World Heritage Encyclopedia
Language: English
Subject: Richard E. Bellman Control Heritage Award, Systems science, Linear search problem, Bellman pseudospectral method, Norbert Wiener Prize in Applied Mathematics
Collection: 1920 Births, 1984 Deaths, 20Th-Century American Mathematicians, American Agnostics, American Jews, Brooklyn College Alumni, Control Theorists, Disease-Related Deaths in California, Fellows of the American Academy of Arts and Sciences, Ieee Medal of Honor Recipients, Jewish Agnostics, John Von Neumann Theory Prize Winners, Princeton University Alumni, Richard E. Bellman Control Heritage Award Recipients, University of Southern California Faculty, University of Wisconsin–madison Alumni
Publisher: World Heritage Encyclopedia
Publication
Date:
 

Richard E. Bellman

Richard E. Bellman
Born Richard Ernest Bellman
(1920-08-26)August 26, 1920
New York City, New York, U.S.
Died March 19, 1984(1984-03-19) (aged 63)
Los Angeles, California, U.S.
Fields Mathematics and Control theory
Institutions University of Southern California;
Rand Corporation;
Stanford University
Alma mater Princeton University
University of Wisconsin–Madison
Brooklyn College
Doctoral advisor Solomon Lefschetz
Known for Dynamic programming
Bellman equation
Hamilton–Jacobi–Bellman equation
Curse of dimensionality
Bellman–Ford algorithm
Notable awards John von Neumann Theory Prize (1976)
IEEE Medal of Honor (1979)
Richard E. Bellman Control Heritage Award (1984)

Richard Ernest Bellman (August 26, 1920 – March 19, 1984) was an American applied mathematician, who introduced dynamic programming in 1953, and important contributions in other fields of mathematics.

Contents

  • Biography 1
  • Work 2
    • Bellman equation 2.1
    • Hamilton–Jacobi–Bellman equation 2.2
    • Curse of dimensionality 2.3
    • Bellman–Ford algorithm 2.4
  • Publications 3
  • References 4
  • Further reading 5
  • External links 6

Biography

Bellman was born in 1920 in New York City to non-practising Jewish parents of Polish and Russian descent, Pearl (née Saffian) and John James Bellman,[1] who ran a small grocery store on Bergen Street near Prospect Park, Brooklyn.[2][3] He attended Abraham Lincoln High School, Brooklyn in 1937,[1] and studied mathematics at Brooklyn College where he earned a BA in 1941. He later earned an MA from the University of Wisconsin–Madison. During World War II he worked for a Theoretical Physics Division group in Los Alamos. In 1946 he received his Ph.D at Princeton under the supervision of Solomon Lefschetz.[4] Beginning 1949 Bellman worked for many years at RAND corporation and it was during this time that he developed dynamic programming.[5]

Later in life, Richard Bellman's interests began to emphasize biology and medicine, which he identified as “the frontiers of contemporary science”. In 1967, he became founding editor of the journal Mathematical Biosciences which specialized in the publication of applied mathematics research for medical and biological topics. In 1985, the Bellman Prize in Mathematical Biosciences was created in his honor, being award biannually to the journal's best research paper.

Bellman was diagnosed with a brain tumor in 1973, which was removed but resulted in complications that left him severely disabled. He was a professor at the University of Southern California, a Fellow in the American Academy of Arts and Sciences (1975),[6] a member of the National Academy of Engineering (1977),[7] and a member of the National Academy of Sciences (1983).

He was awarded the IEEE Medal of Honor in 1979, "for contributions to decision processes and control system theory, particularly the creation and application of dynamic programming".[8] His key work is the Bellman equation.

Work

Bellman equation

A Bellman equation, also known as a dynamic programming equation, is a necessary condition for optimality associated with the mathematical optimization method known as dynamic programming. Almost any problem which can be solved using optimal control theory can also be solved by analyzing the appropriate Bellman equation. The Bellman equation was first applied to engineering control theory and to other topics in applied mathematics, and subsequently became an important tool in economic theory.

Hamilton–Jacobi–Bellman equation

The Hamilton–Jacobi–Bellman equation (HJB) equation is a partial differential equation which is central to optimal control theory. The solution of the HJB equation is the 'value function', which gives the optimal cost-to-go for a given dynamical system with an associated cost function. Classical variational problems, for example, the brachistochrone problem can be solved using this method as well. The equation is a result of the theory of dynamic programming which was pioneered in the 1950s by Richard Bellman and coworkers. The corresponding discrete-time equation is usually referred to as the Bellman equation. In continuous time, the result can be seen as an extension of earlier work in classical physics on the Hamilton-Jacobi equation by William Rowan Hamilton and Carl Gustav Jacob Jacobi.

Curse of dimensionality

The "Curse of dimensionality", is a term coined by Bellman to describe the problem caused by the exponential increase in volume associated with adding extra dimensions to a (mathematical) space. One implication of the curse of dimensionality is that some methods for numerical solution of the Bellman equation require vastly more computer time when there are more state variables in the value function. For example, 100 evenly spaced sample points suffice to sample a unit interval with no more than 0.01 distance between points; an equivalent sampling of a 10-dimensional unit hypercube with a lattice with a spacing of 0.01 between adjacent points would require 1020 sample points: thus, in some sense, the 10-dimensional hypercube can be said to be a factor of 1018 "larger" than the unit interval. (Adapted from an example by R. E. Bellman, see below.) [9]

Bellman–Ford algorithm

Though discovering the algorithm after Ford he is referred to in the Bellman–Ford algorithm, also sometimes referred to as the Label Correcting Algorithm, computes single-source shortest paths in a weighted digraph where some of the edge weights may be negative. Dijkstra's algorithm accomplishes the same problem with a lower running time, but requires edge weights to be non-negative.

Publications

Over the course of his career he published 619 papers and 39 books. During the last 11 years of his life he published over 100 papers despite suffering from crippling complications of brain surgery (Dreyfus, 2003). A selection:[1]

  • 1957. Dynamic Programming
  • 1959. Asymptotic Behavior of Solutions of Differential Equations
  • 1961. An Introduction to Inequalities
  • 1961. Adaptive Control Processes: A Guided Tour
  • 1962. Applied Dynamic Programming
  • 1967. Introduction to the Mathematical Theory of Control Processes
  • 1970. Algorithms, Graphs and Computers
  • 1972. Dynamic Programming and Partial Differential Equations
  • 1982. Mathematical Aspects of Scheduling and Applications
  • 1983. Mathematical Methods in Medicine
  • 1984. Partial Differential Equations
  • 1984. Eye of the Hurricane: An Autobiography, World Scientific Publishing.
  • 1985. Artificial Intelligence
  • 1995. Modern Elementary Differential Equations
  • 1997. Introduction to Matrix Analysis
  • 2003. Dynamic Programming
  • 2003. Perturbation Techniques in Mathematics, Engineering and Physics
  • 2003. Stability Theory of Differential Equations (originally publ. 1953)[10]

References

  1. ^ a b c Salvador Sanabria. Richard Bellman profile at http://www-math.cudenver.edu; retrieved October 3, 2008.
  2. ^ Robert S. Roth, ed. (1986). The Bellman Continuum: A Collection of the Works of Richard E. Bellman. World Scientific. p. 4.  
  3. ^ Bellman biodata at history.mcs.st-andrews.ac.uk; retrieved August 10, 2013.
  4. ^ Mathematics Genealogy Project
  5. ^ Bellman R: An introduction to the theory of dynamic programming RAND Corp. Report 1953 (Based on unpublished researches from 1949. It contained the first statement of the principle of optimality)
  6. ^ "Book of Members, 1780–2010: Chapter B" (PDF).  
  7. ^ "NAE Members Directory - Dr. Richard Bellman profile".  
  8. ^ "IEEE Medal of Honor Recipients" (PDF).  
  9. ^ Richard Bellman (1961). Adaptive control processes: a guided tour. Princeton University Press. 
  10. ^ Haas, F. (1954). , by R. Bellman"Stability theory of differential equations"Review: . Bull. Amer. Math. Soc. 60 (4): 400–401.  

Further reading

  • J.J. O'Connor and E.F. Robertson (2005). Biography of Richard Bellman from the MacTutor History of Mathematics.
  • Stuart Dreyfus (2002). "Richard Bellman on the Birth of Dynamic Programming". In: Operations Research. Vol. 50, No. 1, Jan–Feb 2002, pp. 48–51.
  • Stuart Dreyfus (2003) "Richard Ernest Bellman". In: International Transactions in Operational Research. Vol 10, no. 5, pp. 543–545.

Articles

  • Bellman, R.E, Kalaba, R.E, Dynamic Programming and Feedback Control, RAND Corporation, P-1778, 1959.

External links

  • "IEEE Global History Network - Richard Bellman".  
  • Harold J. Kushner's speech on Richard Bellman, when accepting the Richard E. Bellman Control Heritage Award (click on "2004: Harold J. Kushner")
  • IEEE biography
  • Richard E. Bellman at the Mathematics Genealogy Project
  • Author profile in the database zbMATH
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.
 


Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.