'Creativity' is one of those words that some computer scientists avoid
at all costs. Part of the reason for this is that detractors of
research into Artificial Intelligence have used it against the
discipline: "computers will never be intelligent because they can't
be creative". Part of the reason is that it is such a mis-used,
poorly understood, loaded word, that it seems bound to cause unease
whenever used in conjunction with machines. Finally, until recently,
it's been difficult to project the word creative onto any existing
programs, for various reasons. However, creativity clearly plays a
part in human intelligence and cannot be ignored if we are to write
programs which exhibit intelligence. I suggest that a mathematical
theory of creativity would provide the basis for the building of
creative programs, just as logic supplies the basis for deductive
programs.
My grand challenge is to devise such a theory. By stating
mathematical rather than a more formal computational
theory of creativity, I am acknowledging the fact that certain aspects
of the theory may not be well suited to implementation in current
computers (and this limitation itself may advance computer science in
non-standard directions such as quantum and DNA computing). I believe
that two important aspects of a mathematical theory of creativity will
be the amalgamation of many forms of reasoning into a theory of
creative reasoning and the separation of creative tasks into problem
solving, discovery and synthesis. This latter aspect will require a
paradigm change whereby Artificial Intelligence is no longer seen as
just a tool for solving problems.
Few people these days say that: "computers will never be intelligent
because they can't reason". This is a sign of the maturity of
automated theorem provers (ATPs), which reason deductively, and
machine learning (ML) programs which reason inductively. However,
generally speaking, ML can discover, but not explain, while ATP can
explain but not discover. The combination of ATP and ML has an
exciting potential: much more creative approaches to the problems
solved by these types of programs. Theorems would be proved by the
invention of new concepts, and the finding of intermediate hypotheses
empirically. Concept learning would be driven as much by theoretical
exploration as empirical pattern discovery, and advantageous
properties of the concepts learned would be explained rather than
demonstrated. There are many technical problems to overcome in order
to combine ATP and ML programs. Part of the problem is inflexibility
in both types of programs. In particular, machine learning programs
would have to discover axioms of the domain which are not necessarily
related to the task they are being employed for. Automated reasoning
programs would have to work with less well formed axioms and possibly
produce unsound explanations.
The combination of inductive and deductive reasoning -- which is
beginning to feature in AI research -- is just the tip of the iceberg,
however. There are many forms of reasoning identified in the
literature on creativity which will need to be firstly understood, and
secondly incorporated into the theory. Other forms of reasoning
include: abduction, invention, reflection, analogy, metaphor,
serendipity, abstraction, experimentation, observation, evaluation,
reparation, justification, exploitation, imagination, innovation and
interpretation. I suggest that the problem of producing a mathematical
theory of creative reasoning requires amalgamation, rather than
combination, of established (and less well established) reasoning
techniques. The notion of ways of reasoning which don't fit into
categories like 'inductive' and 'deductive', etc., but somehow
encapsulate the scope of many different reasoning techniques, is
beyond current thinking. If we add to this the requirement that the
theory takes into account creative teamwork, then we can see that
devising such a theory is indeed a grand challenge, as we will also
have to take into account theories of cooperation and competition.
As a research program, one way of breaking down the challenge of
producing a theory of creativity would be in terms of the tasks being
covered. I would suggest three levels of creative activity: problem
solving (find me a solution), discovery (find me something I wasn't
expecting) and synthesis (build me something special). Problem solving
-- such as theorem proving -- can often be accomplished using one or
two forms of reasoning; discovery -- such as the generation of
scientific hypotheses -- involves a combination of different reasoning
techniques, and requires the solution of many problems along the way;
synthesis -- such as the invention of the vacuum cleaner -- involves
prolonged processes of creative reasoning, and requires many
discoveries along the way.
Artificial Intelligence is so often portrayed as just a set of
techniques for solving problems. For instance, Luger and
Stubblefield's well known AI textbook is subtitled: 'Structures and
Strategies for Complex Problem Solving'. I believe it is naive to
think that all intelligent activity can be characterised in terms of
stating and solving a problem. In many cases, an exploration to find
some artifacts is undertaken without a clear goal in mind, but in the
knowledge that there are plenty of problems available that may end up
being solved at some stage during the exploration. In other cases, the
requirements for the solution to a problem evolve during the problem
solving attempt. At the extreme -- in the case of serendipitous
reasoning -- problems are invented to fit solutions. For example, the
invention of Post-It notes is a classic case of prolonged serendipity:
an attempt to solve one problem (finding a very sticky glue) failed,
but eventually a problem which the artifact resulting from the
original study (a re-usable glue) solved was invented. One could say
that serendipity is just solving the problem of finding a problem
given a solution, but I believe that this kind of shoe-horning is
holding AI research back and we should aim to relax the grip that
goal-directed methods have on AI currently. Exploration (curiosity)
for its own sake surely has a role to play in intelligence. Necessity
may be the mother of invention, but what about the other relatives?
This challenge arises from scientific curiosity about the limits of
formalising human reasoning and the nature of creativity. Both of
these enquiries were formulated long ago, and both still stand. A
paradigm shift may occur if we stop thinking about AI as a set of
reliable but uninspiring problem solving techniques and start to write
programs which explore rather than solve, make mistakes along the way
and evolve past their programming. This aim will not be met purely by
commercially motivated evolutionary advance, and I think that the
amalgamation of reasoning techniques (rather than combination) is
beyond what is initially possible.
A useful decomposition of this challenge is into theories able to
complete different levels of creative tasks: problem solving,
discovery and synthesis, as described above. Of course, problem
solving is certainly underway and has brought enormous benefit to
science, and even if we fail to achieve the second and third aspects,
it seems likely that their study will bring additional scientific
benefit. It may not be entirely obvious to assess how far the
challenge has been met, but we could set down certain markers. For
example, if the same creativity theory could plausibly explain how
musicians compose a sonata and how chemists discover a drug, then we
could claim that the challenge has been met. Less ambitious goals in
terms of problem solving and discovery tasks could be specified along
the way.
It is impossible to imagine this grand challenge being met by anything
other than an international consortium of researchers into Artificial
Intelligence, Cognitive Science, Philosophy, Psychology and other
fields. Research into machine creativity is already an international
effort, but it is certainly held back by a lack of dedicated
scientists of the right calibre and speciality. This is possibly
because of the fact that creativity research does not (yet) have
enthusiastic support from the entire research community, for the
reasons given above, and others. By stating this grand challenge, I
hope to have shown that it is time to reclaim the word creativity and
admit that a thorough understanding of creative reasoning is an
undeniable requirement for the next generation(s) of AI researchers.