The Rich Legacy of Alan Turing

The Rich Legacy of Alan Turing

As today is the birthday of Alan Turing, AIWS House introduces some writings about him. The article can be found here.

The Rich Legacy of Alan Turing by Liat Clark and Ian Steadman, Wired UK

Alan Turing achieved more in the space of a few decades than anyone could hope to achieve in a lifetime. His ability to imagine the unimaginable and put these lofty theories down on paper, and then into practice, show a highly disciplined character capable of becoming an expert in pretty much anything he had an interest in. Turing went from drawing up a basic model for all computers to breaking down the constructs of complex chemical reactions with enviable ease.

Turing’s achievements may not all be war-winning discoveries like the Enigma-cracking Bombe, but each theory or invention paved the way for generations of researchers to develop, adapt and improve upon his ideas. Here, Wired.co.uk breaks down some of the most significant contributions Turing made to modern science.

The Bombe
In 1940 and 1941, German U-boats were decimating Allied supply ships. Thousands of merchant navy vessels were lost during World War Two, and Winston Churchill was to later pen the words: “The only thing that ever really frightened me during the war was the U-boat peril.”

By 1943 the tide had turned – Alan Turing had developed the Naval Bombe, an adaptation of his decryption Bombe device capable of laying bare the secrets of the complex German Naval Enigma. Churchill would later comment that Turing had made the single biggest contribution to Allied victory in the war.

The complexity of the German Enigma – an electromagnetic machine that replaced plain text letters with random letters chosen according to the settings of a series of rotors – lay in the fact that its inner elements could be set in billions of different combinations, meaning it would be virtually impossible to decode text without knowing the original settings. As the war progressed, the German military added more rotors to the machine, making it even more complex.

The Polish Cipher Bureau managed to get hold of an Enigma machine and develop an early prototype of the Bombe. They passed their knowledge on to British intelligence. Turing and his colleague Gordon Welchman built on the Polish machine at Bletchley Park. The machine replicated the rotors of the Enigma and would search through different combinations of rotor positions in order to test potential ciphers.

Turing cracked the system by focusing on the idea of the “crib”. The encrypted German messages often contained predictable words, including the full names and titles of military officers, at the same point in each message. The Enigma would never encipher a letter to itself, therefore Turing could use these terms, or “crib” as a starting point, looking out for where the same letter in a possible crib appeared in the same place in its ciphertext counterpart – much like a codeword puzzle. The machine would automatically search through the possible positions of the Enigma’s wheels, eliminating those combinations ruled out by the crib. Once the mathematical cycle of the rotors relating to the crib was found, it could be used to decipher the rest of the text.

Turing’s design relied heavily on cribs, and it was the follow-up machines developed by peer Gordon Welchman and others that would speed up the process as the war progressed.

__ACE Computer
__ At the tail-end of World War Two, Turing headed to the country and MI6 research centre Hanslope Park, not far from Bletchley Park. Here, he said, he was “building a brain”; a system so advanced it could calculate entire mathematical scenarios for researchers, rather than aid with the odd equation.

His accurate assumption would lead to a paper on the ACE (Automatic Computing Engine) being put to the National Physical Laboratory (NPL) Executive Committee in 1945, which was cast aside for being too complex and having an estimated cost of ₤11,200.

The team at the NPL instead set about building a smaller version of the complex series of circuits Turing presented, which was put into action only on 10 May, 1950. By this time, Turing had left the NPL and was already working on another computer at Manchester University, Manchester Mark 1. The Pilot Model ACE would be the first electronic computer and one of a handful of stored-program computers to be built in Britain.

It was the fastest computer in the world at the time, despite clocking in at what would today be considered a 1 MHz snail’s-pace. Its memory functioned off mercury delay lines, with each one capable of storing data of up to 32 bits. Thirty Pilot Models were sold, but by 1958 the full-sized model had been built. The basic design of Turing’s ACE would be put to use in the MOSAIC (Ministry of Supply Automatic Integrator and Computer), used to calculate aircraft movements during the Cold War. It was also the basis of the Bendix G-15, considered the first personal computer, which was for sale up until 1970.

Turing machine
Despite perhaps being most well-known today for his contributions to codebreaking, no less important are Turing’s insights into the concept of the Turing machine and universal computability. Without going into too much detail, Turing proposed (in collaboration with his doctoral supervisor Alonzo Church) a hypothetical machine (in 1936) that could be used to simulate any algorithmic computation. More of a thought experiment than something that could be constructed in real life, the Turing machine would be fed by a long piece of tape on which would be written single-character instructions. The machine could read each instruction one at a time, process it according to some predetermined coded algorithm, and then move the tape back or forwards as necessary.

This was groundbreaking in the sense that it was the first proposal for a machine with multiple functions determined by a program held within a memory store, rather than by physically altering the machine’s wiring or structure. Turing machines are still used today in computer science as a research and teaching tool, as it’s a simple way to model what happens in a CPU. Turing and Church together hypothesised the idea of a universal Turing machine, a machine which could read and perform any algorithmic function – that is, a Turing machine that can simulate the algorithmic functions of any other Turing machine. “Turing completeness” is now one of the defining features of modern computers; the only practical limit on a machine’s Turing-completeness is the amount of memory it has.

The first fully digital electronic Turing-complete computer was the US ENIAC in 1946 – however (and rather amazingly) Charles Babbage’s Analytical Engine, first described in 1837 but never built, would theoretically have been Turing-complete.

Turing-completeness has several wide-ranging philosophical ramifications, too – much of the philosophy of the mind over the past few decades has been influences by Turing’s ideas.

Speech encryption
Turing’s cracking of the Enigma code wasn’t his only technological breakthrough at Bletchley Park. He also developed a method of securely encoding and decoding telephone conversations in 1944, building on work he had seen at Bell Labs in the US in 1942. Named “Delilah”, it was never used by the government, but Turing fed some of his work back to Bell Labs as they developed SIGSALY – a device which was the first to use many digitally secure speech concepts, and which was used for the most secretive Allied communications.

__Morphogenesis
__ Though he was only just beginning to publish on the subject by the time of his death in 1954 (and it was not until the 1990s that much of his work was finally published), Turing’s contributions to morphogenesis are still relevant to the field today. Morphogenesis is the process by which multi-celled life develops its shape as it grows, and Turing’s 1951 paper The Chemical Basis of Morphogenesis explored how non-uniform biological characteristics (like stripes on a zebra) could arise out of a uniform starting state in the womb. Turing was fascinated his entire life by the structure of plant petals and seeds (phyllotaxis), and how they seemed to adhere to the Fibonacci sequence – especially when it came to sunflowers. You can help complete his unfinished research on this with the Turing’s Sunflowers project, which aims to crowdsource growing thousands of sunflowers around the country in 2012 so we can prove Turing’s thesis once and for all.

Chemistry and physics
Turing’s work on morphogenesis also has applications in chemistry and physics. He was among the first to notice that chemical systems that are otherwise stable become unsettled by diffusion under certain circumstances – in these “reaction-diffusion” systems, diffusion clashes with individual chemical reactions leading to the apparent paradox of the overall system getting more complicated over time. The same process that might lead to spots and patterns on animals also works on the molecular level, and some consider Turing’s work on reaction-diffusion systems to be one of the earliest forays into the field of chaos theory.

Chess computer program
In 1950, Turing wrote the first ever chess computer program as part of his work on artificial intelligence. Calling it “Turbochamp”, he tried to implement it on Manchester University’s Ferranti Mark I without success. Instead, in the summer of 1952, he “played” as the program against his friend and colleague Alick Glennie. Turing would work through each move according to his program on paper, taking around half an hour each time. While it showed that Turbochamp was capable of playing a human at chess, it lost against Glennie in 29 moves. You can watch the game here. It was 1957 before a fully-operational chess program was up and running, created by Alex Bernstein at IBM on an IBM 704.

Frank Ramsey becomes a Figure in the History of AI

Frank Ramsey becomes a Figure in the History of AI

Professor Judea Pearl wrote: “Ramsey was definitely one of the clearest forerunners of subjective probabilities and the revival of Bayes statistics in the 20th century, which influenced the 1970-90 debate on how to represent uncertainty in AI systems.”

Professor Cheryl Misak, author of the book “Frank Ramsey: A Sheer Excess of Powers”, presented at AIWS House, the History of AI:

“1926, a few years before de Finetti, Ramsey figured out how to measure partial belief; put forward a theory of probability as subjective degree of belief; and showed that rationality could be understood as expected utility. These results play a prominent role in contemporary economics and Bayesian statistics, as well as much of psychology, artificial intelligence, etc.”

Frank Ramsey was recognized as a historical figure in AI under the category: Meaningful and Influential Pioneer.

Criteria of AI Chronicle at AIWS.net

Criteria of AI Chronicle at AIWS.net

I. Scope: includes 3 fields

  1. Ideas, Theories, Concepts, and Methodologies for AI through applying AI.
  2. Inventions and Innovations in AI science and technology.
  3. AI applications, iniatives in politics, governments, society, economy, business, industry.

Types of contents: documents, pictures, video, voice, evidences, products, software, apps, stories etc.

 

II. Criteria to identify events, figures, achieveents as historical significances in the AI Chronicle: they are either 1. Meaningful, influential pioneer (satisfy both 3 requirements: Pioneering, Meaningful, and Influential), or 2. Changing the world.

Here are the details:

 

1. Meaningful and influential pioneer: they have to satisfy all 3 requirements below

a. Pioneering

Pioneering of meaningful and helpful ideas, theories, methodologies, principles, concepts, initiatives, or applications.

These should be officially announced by press releases of credible organizations, newspapers, or media first, before any other launching in these issues

b. Meaningful and helpful:

Satisfies one of requirements below:

–   Creating greater efficiency for politics, government, economics, business, and society with AI.

–   Innovating politics, government, economics, business, and society with AI.

–   Creating more productivity in life: pioneer products and services to help improve quality of life worldwide with AI.

c. Influence:

Satisfies one of requirements below:

– Connect, deliver, and discuss with top centers of intellectual and high influences such as Harvard, MIT, Columbia, Princeton, Yale, University of Chicago, Brown, University of Pennsylvania, Stanford, Berkeley, UCLA, Cambridge, Oxford, etc.

– Connect and deliver to the UN, governments of G7, OECD, or governments that respect and apply the Social Contract 2020, A New Social Contract in the Age of AI.

– Connect, deliver, and discuss with highly respected leaders, distinguished thinkers, or have them involved in this event or achievement (ideas, concepts, principles, initiative, solutions).

– Coverage by at least two major newspapers, magazine, or media.

– Publish books with publishing companies of high credibility.

– Recommended and introduced at conferences of high credit organizations that respect and apply the Social Contract 2020, A New Social Contract in the Age of AI.

– Applied by governments, or large, worldwide organizations, institutions.

2. Impact on the world:

 

 

Achievements or events that changed the world to better or worse.

Eg. the Internet and the Turing Test changed the world; open AI concepts, Deep learning, Bayesian networks changed machine learning.

 

III. Relation to AI:

They may be directly or indirectly related to AI.

  1. Direct to AI

Ideas, theories, methodologies, concepts to AI science, technology, governance, governments, politics, society, business, industry, cultures: Turing Test, Bayesian networks, Causality (Causal and Inference), The Book of Why, the Society of Mind of Marvin Minsky, etc.

Concepts, Principles:

Eg. AI World Society, AI-politician (New Zealand), AI-government, AI-citizen.

  1. Indirect to AI:

Eg. The Internet creates connection between computer systems, increasing computational powers; the smart powers, future of power by Joseph Nye; Stephen Hawking, Max Tegmark, Frank Ramsey.

 

IV. Process of the AI Chronicles:

Anyone can send historical documents, achievements, events, evidences to AI Chronicles (email: [email protected]). The assistant group will review and arrange, then the History of AI Board will review and identify.

The History of AI: Professor Cheryl Misak spoke about Frank Ramsey

The History of AI: Professor Cheryl Misak spoke about Frank Ramsey

The first event of the AIWS House, the History of AI, is the talk by University Professor of University of Toronto Cheryl Misak.

Professor Judea Pearl, Chancellor’s Professor of UCLA, Turing Award, Member of the History of AI Board, advised and raised questions to discuss with Professor Cheryl Misak.

Professor Nazli Choucri, MIT, Member of the History of AI Board, gave opening remarks and conclusion. Ms. Ta Bich Loan, Chief of Vietnam National Television 3 (VTV3), moderated the event.

Here are some interesting notes from Cheryl’s talk about Frank Ramsey:

Undergraduate thesis: ‘The Foundations of Mathematics

Tried to repair a problem in Russell and Whitehead’s Principia Mathematica and improve on the theory of types. It didn’t win the Smith’s Prize.

He became a Superstar in 4 disciplines, at least:

  1. Pure Mathematics
  2. Economics
  3. Subjective Probability/Expected Utility Theory
  4. Philosophy

Pure Mathematics:

Ramsey Theory: the conditions under which order must occur

Economics:

Published two papers in Keynes’s Economic Journal

‘A Mathematical Theory of Saving’

‘A Contribution to the Theory of Taxation’

Influence on Artificial Intelligence:

Subjective Probability/Expected Utility Theory

1926, a few years before de Finetti, Ramsey figured out how to measure partial belief; put forward a theory of probability as subjective degree of belief; and showed that rationality could be understood as expected utility.

These results play a prominent role in contemporary economics and Bayesian statistics, as well as much of psychology, artificial intelligence, etc.

Philosophy

Many things are named for him: Ramsey Sentences, the Ramsey Test for Conditionals, and on and on.

The Ramsey Effect: discovering that your exciting and apparently original philosophical discovery has been already presented, and presented more elegantly, by Frank Ramsey when he was 26 years old.

The video of the talk can be found here.

The presentation can be found here.

The Artificial Intelligence Chronicle – Open to feedback

The Artificial Intelligence Chronicle – Open to feedback

The History of AI, a part of Michael Dukakis Institute for Leadership and Innovation, starts post content of the AI Chronicle on AI World Society Network (AIWS.net). This content is the AI Chronicle – Open to Feedback: we encourage to receive comments, feedbacks from today June 6, 2020 to June 27, 2020, then the History of AI Board will review, approve and the AI Chronicle – Official will be posted on July 1, 2020. The History of AI Board will review the AI Chronicle biannual. Our approach is open-ended: based on our findings, we will develop research on the History of AI’s criteria, and we are open to invite individuals and organizations to contribute, comment to the project by gathering documents, stories and participating in analysis.

The Artificial Intelligence Chronicle article can be downloaded here 

Any feedback is welcome! Please send email to us!