Your continued donations keep Wikipedia running!    

Functional programming

From Wikipedia, the free encyclopedia

Jump to: navigation, search

Functional programming is a programming paradigm that conceives computation as the evaluation of mathematical functions and avoids state and mutable data. Functional programming emphasizes the definition of functions, in contrast to imperative programming, which emphasizes state machines and the execution of sequential commands.

Functional programming is defined more by a set of common concerns and themes than by any single criterial distinction from other paradigms. Often considered important are higher-order and first-class functions, closures, and recursion. Other common features of functional programming languages are continuations, Hindley-Milner type inference systems, non-strict evaluation (i.e. "laziness"), and monads.

Functional programming languages have largely been emphasized in academia rather than in commercial software development. Notable exceptions are Erlang (used in highly-concurrent telecom applications), J and K (which are used in financial analysis), and domain-specific programming languages like XSLT[1][2]. Important influences on functional programming have been the lambda calculus, the APL programming language, the Lisp programming language, and more recently the Haskell programming language.

Contents

History

Lambda calculus, invented by Alonzo Church in the 1930s, provides a theoretical framework for describing functions and their evaluation. Though it is a mathematical abstraction rather than a programming language, lambda calculus forms the basis of almost all functional programming languages today.

Combinatory logic is an equivalent theoretical foundations of functional programming, developed by Moses Schönfinkel and Haskell Curry. Originally, it was developed to achieve a larger goal: a clearer approach to the foundations of mathematics.[3]. Combinatory logic, which is commonly perceived as more abstract than lambda calculus, preceded lambda-calculus in invention.

The first computer-based functional programming language was Information Processing Language (IPL), developed by Newell, Shaw, and Simon at RAND Corporation for the JOHNNIAC computer in the mid-1950s. An early functional-flavored programming language was LISP (now mixed-case "Lisp"), developed by John McCarthy while at MIT for the IBM 700/7000 series scientific computers in the late 1950s[4]. LISP introduced many of the features now found in modern functional programming languages, though LISP is technically a multi-paradigm language. Scheme and Dylan were later attempts to simplify and improve LISP.

Kenneth E. Iverson developed the APL programming language in the early 1960s, described in his 1962 book "A Programming Language." APL was the the primary influence on John Backus's FP programming language. In the early 1990s, Iverson and Roger Hui created a successor to APL, the J programming language. In the mid 1990s, Arthur Whitney, who had previously worked with Iverson, created the K programming language, which is used commercially in financial industries.

John Backus presented the FP programming language in his 1977 Turing Award lecture Can Programming Be Liberated From the von Neumann Style? A Functional Style and its Algebra of Programs. He defines functional programs as being built up in a hierarchical way by means of "combining forms" that allow an "algebra of programs"; in modern language, this means that functional program follow the principle of compositionality. Backus's paper popularized research into functional programming, though it emphasised function-level programming rather than the Lambda-calculus style which has come to be associated with functional programming.

In the 1970s the ML programming language was created by Robin Milner at the University of Edinburgh, and David Turner developed the language Miranda at the University of Kent. ML eventually developed into several dialects, the most common of which are now Objective Caml and Standard ML. The Haskell programming language was released in the late 1980s in an attempt to gather together many ideas in functional programming research.

Concepts

A number of concepts and paradigms are specific to functional programming, and generally unfamiliar within discussions of imperative programming (including within object oriented programming approaches). However, inasmuch as particular programming languages are often hybrids of several programming paradigms, programmers using "mostly imperative" languages may have utilized some of these concepts

Higher-order functions

A powerful mechanism used in functional programming is the notion of higher-order functions. Functions are higher-order when they can take other functions as arguments, and/or return functions as results. (The derivative and antiderivative in calculus are mathematical examples of a function that maps a function to a function.)

Higher-order functions are closely related to first-class functions, in that higher-order functions and first-class functions both allow functions as arguments and results of other functions. The distinction between the two is subtle: "higher-order" describes a mathematical concept of functions that operate on other functions, while "first-class" is a computer science term that describes programming language entities that have no restriction on their use (thus first-class functions can appear anywhere in the program that other first-class entities like numbers can, including as arguments to other functions and as their return values).

Higher-order functions enable currying, a technique in which a function is applied to its arguments one at a time, with each application returning a new (higher-order) function that accepts the next argument.

Pure functions

While not all functional programs or functional programming languages are purely functional, purely functional programs have no side-effects. Since functions do not modify state, no data may be changed by parallel function calls. For this reason, pure functions are always thread-safe, a fact which is exploited by languages that use call-by-future evaluation. Because ordering of side-effects does not have to be preserved in their absence, some languages (such as Haskell) use call-by-need evaluation for pure functions.

"Pure" functional programming languages typically enforce referential transparency, which is the notion that 'equals can be substituted for equals': if two expressions have "equal" values (for some notion of equality), then one can be substituted for the other in any larger expression without affecting the result of the computation. For example, in

y = f(x) * f(x);    

a compiler can factor out f(x) if it is pure, transforming the program to

z = f(x);   
y = z * z;       

and eliminating the second evaluation of the (possibly costly) call to f(x). This optimization is called common subexpression elimination.

However, if a function has effects, the function call cannot be eliminated. Consider the following program fragment:

y = random() * random();    

The second call to random cannot be eliminated, because its return value may be different from that of the first call. Similarly,

y = printf("x") * printf("x");      

cannot be optimized away; even if printf returns the same value both times, failing to make the second call would result in different program output.

Most compilers for imperative programming languages do not perform common subexpression elimination for function calls, because they do not track whether a function is pure. It is possible for an advanced compiler to infer whether a local function has effects and optimize accordingly; however, most pre-compiled libraries do not expose this information, preventing calls to external functions from being optimized away. Some compilers, such as gcc, add extra keywords for a programmer to explicitly mark pure functions so that this optimization can be performed.

Recursion

Iteration (looping) in functional languages is usually accomplished via recursion. Recursive functions invoke themselves, allowing an operation to be performed over and over. Recursion may require maintaining a stack, but tail recursion can be recognized and optimized by a compiler into the same code used to implement iteration in imperative languages. The Scheme programming language standard requires implementations to recognize and optimize tail recursion.

Common patterns of recursion can be factored out using higher order functions, catamorphisms and anamorphisms (or "folds" and "unfolds") being the most obvious examples. Such higher order functions play a role analagous to built-in control structures such as loops in imperative languages.

Functional programming in non-functional languages

It is possible to employ a functional style of programming in languages that are not traditionally considered to be functional languages[5]. Some non-functional languages, such as Tcl, Perl, Python and Ruby, have borrowed features such as lambda functions, higher-order functions, and list comprehensions from functional programming languages, making it easier to adopt a functional style when using these languages. Functional constructs such as higher-order functions and lazy lists are supported in C++ via the FC++ library[6]. In C and C++ one can use function pointers to get some of the effects of higher-order functions, for example one can implement map using function pointers. Widespread declarative "little languages" like SQL and Lex/Yacc, which are not Turing-complete, use many elements of functional programming, especially in eschewing mutable values.[7]

Comparison of functional and imperative programming

Functional programming is very different from imperative programming. The most significant differences stem from the fact that functional programming avoids side effects, which are used in imperative programming to implement state and I/O. Pure functional programming disallows side effects completely. Disallowing side effects provides for referential transparency, which in turn makes it easier to verify, optimize, and parallelize programs, and easier to write automated tools to perform those tasks.

Higher order functions are rarely used in older imperative programming. Where a traditional imperative program might use a loop to traverse a list, a functional style would often use a higher-order function, map, that takes as argument a function and a list, applies the function to each element of the list, and returns a list of the results.

There are tasks—for example, maintaining a bank account balance—that often seem most naturally implemented with state. Pure functional programming performs these tasks, and I/O tasks such as accepting user input and printing to the screen, in a different way.

The pure functional programming language Haskell implements them using monads, derived from category theory in mathematics. Monads are extremely powerful but generally considered hard to understand. [8].

Alternative methods such as Hoare logic have been developed to track side effects in programs. Some modern research languages use effect systems to make explicit the presence of side effects.

Functional programming languages have automatic memory management with garbage collection, in contrast to older imperative languages like C and Pascal which use explicit memory management. Functional programming languages have been perceived as less efficient in their use of CPU and memory than those languages. However, many modern imperative languages such as Java, Perl, Python, and Ruby also perform automatic memory management and are perceived as less efficient.

Functional programming languages have become more efficient over the years. For programs which perform intensive numerical computations, functional languages such as OCaml and Clean are similar in speed to C; for programs that handle large matrices and multidimensional databases, array functional languages (such as J and K) are usually faster than most non-optimized C programs[citation needed]. However, purely functional languages remain slower when manipulating large data structures, due to non-mutable value passing semantics.

See also

Notes

  1. ^ Dimitre Novatchev. The Functional Programming Language XSLT - A proof through examples. TopXML. Retrieved on May 27, 2006.
  2. ^ David Mertz. XML Programming Paradigms (part four): Functional Programming approached to XML processing. IBM developerWorks. Retrieved on May 27, 2006.
  3. ^ Curry, Haskell Brooks; Robert Feys and Craig, William (1958). Combinatory Logic. Volume I. Amsterdam: North-Holland Publishing Company.
  4. ^ McCarthy, John (June 1978). "History of Lisp". In ACM SIGPLAN History of Programming Languages Conference: 173—196. " The implementation of LISP began in Fall 1958."
  5. ^ Hartel, Pieter, Henk Muller and Hugh Glaser (March 2004). "The Functional C experience". The Journal of Functional Programming 14 (2): 129—135.
  6. ^ McNamara, B.. FC++: Functional Programming in C++. Retrieved on 2006-05-28.
  7. ^ Donald D. Chamberlin and Raymond F. Boyce (1974). "SEQUEL: A structured English query language". Proceedings of the 1974 ACM SIGFIDET: 249-264.. In this paper, one of the first formal presentations of the concepts of SQL (and before the name was later abbreviated), Chamberlin and Boyce emphasize that SQL was developed "Without resorting to the concepts of bound variables and quantifiers".
  8. ^ Newbern, J.. All About Monads: A comprehensive guide to the theory and practice of monadic programming in Haskell. Retrieved on 2006-05-27., "The sheer number of different monad tutorials on the internet is a good indication of the difficulty many people have understanding the concept. This is due to the abstract nature of monads and to the fact that they are used in several different capacities, which can confuse the picture of exactly what a monad is and what it is good for."

References

  • Cousineau, Guy and Michel Mauny. The Functional Approach to Programming. Cambridge, UK: Cambridge University Press, 1998.
  • Felleisen, Matthias, Robert Findler, Matthew Flatt, and Shriram Krishnamurthi. How to Design Programs HTDP. MIT Press. 2001. on-line
  • Graham, Paul. ANSI Common LISP. Englewood Cliffs, New Jersey: Prentice Hall, 1996.
  • Curry, Haskell Brooks and Feys, Robert and Craig, William. Combinatory Logic. Volume I. North-Holland Publishing Company, Amsterdam, 1958.
  • Curry, Haskell Brooks and Hindley, J. Roger and Seldin, Jonathan P. Combinatory Logic. Volume II. North-Holland Publishing Company, Amsterdam * London, 1972.
  • Hudak, Paul. "Conception, Evolution, and Application of Functional Programming Languages." ACM Computing Surveys 21, no. 3 (1989): 359-411.
  • MacLennan, Bruce J. Functional Programming: Practice and Theory. Addison-Wesley, 1990.
  • Pratt, Terrence, W. and Marvin V. Zelkowitz. Programming Languages: Design and Implementation. 3rd ed. Englewood Cliffs, New Jersey: Prentice Hall, 1996.
  • Salus, Peter H. Functional and Logic Programming Languages. Vol. 4 of Handbook of Programming Languages. Indianapolis, Indiana: Macmillan Technical Publishing, 1998.
  • Thompson, Simon. Haskell: The Craft of Functional Programming. Harlow, England: Addison-Wesley Longman Limited, 1996.
  • Harrop, Jon. Objective CAML for Scientists. Cambridge, England: Flying Frog Consultancy, 2005.

External links

Personal tools