Generative AI

5th May 2023

Dr Detlef Nauck
Distinguished Engineer and
Head of AI & Data Science Research
 Generative AI (Detlef Nauck, BT) - 2

The race to release LLMs – AI has never changed so fast

Google
BARD
Google shares
fall by 8%
Geoffrey
MS event: FLI Open Hinton Sam Altman
OpenAI:
New Bing Letter leaves Google Senate Hearing
ChatGPT

Dec Jan Feb Mar Apr May June

Bing & Google: OpenAI: 1st vote on

Bard GPT4 EU AI Act
GPT4
Google event
in Paris
 Generative AI (Detlef Nauck, BT) - 3

Where it all comes from: GANs, LLMs & Diffusers

This Person Does Not Exist
Generative Adversarial
Networks (2014)
The Generator creates
deep fakes to train the
Discriminator.

Diffusers (since 2020) – Example from DALLE2 (Open AI, 2022)

Large language models perform sequence-to-sequence "Teddy bears mixing sparkling chemicals as mad scientists in a
prediction and generate the next word in a sentence. steampunk style“ – create images from text and by de-noising.
(Transformer networks, since 2018)
 Generative AI (Detlef Nauck, BT) - 4

How ChatGPT from Open AI was trained

https://openai.com/blog/chatgpt
Videos are next
Generative AI (Detlef Nauck, BT) - 5

Google Imagen Video with prompt: “Teddy bear washing the dishes”

https://imagen.research.google/
Taking Stock – LLMs today
Generative AI (Detlef Nauck, BT) - 6

Capabilities in a nutshell
• Statistical text prediction.
• Impressive text generation capabilities.
• Interesting applications scenarios if carefully controlled.

Caveats in a nutshell
• Foundation models are expensive to build and run.
• Built from largely uncurated training data.
• No control over output quality (hallucinations, bias).
• Outputs must be validated.

https://www.theatlantic.com/technology/archive/2023/01/chatgpt-ai-language-human-
computer-grammar-logic/672902/
GenAI Use Cases
Generative AI (Detlef Nauck, BT) - 7

Guiding principle:
difficult to create, but easy to check

Code
Task sequences

Easier to check
Short text (copywriting)
Document search
Summarisation
Templated text
Contribute to complex text

Images, Video – creation and editing

Ethical Checks
Generative AI (Detlef Nauck, BT) - 8

How was the GenAI built?

Curation of training data – e.g. has bias been

addressed, good quality, relevant?
Performance benchmarks – how good/useful is the
GenAI?
Ethical sourcing – was cheap labour involved, has
copyright been breached?
Carbon footprint – how much compute was used to
build it and how much will be required to run it?
 Generative AI (Detlef Nauck, BT) - 9

AI-mediated Communications
Many opportunities, but how do we embed trust?

Actual Camera Image Reconstructed Image

Select any
image generator
Transmit
embedding

Select any
language synthesiser

NVIDIA Maxine: Reinventing Real-Time Video Communications with AI - YouTube

Outlook: The Dark Horse of GenAI
Generative AI (Detlef Nauck, BT) - 10

Scientific Discovery, Optimisation and Configuration

Deep Mind’s Alpha Tensor

discovers more efficient matrix multiplication
Deep Mind’s Alpha Fold and Meta’s Evolutionary Scale Modelling
predict 3D shape of proteins
Yoshua Bengio’s Generative Flow Networks (Yoshua Bengio)
GT4SD: Generative Toolkit for Scientific Discovery (IBM)
Myth: Making LLMs bigger and bigger will lead to AGI Generative AI (Detlef Nauck, BT) - 11

No, it won’t.

“A system trained on language alone will never

approximate human intelligence, even if trained
from now until the heat death of the universe.”
Yann LeCun, 2022

https://www.noemamag.com/ai-and-the-limits-of-language/
The AI Control Problem
Generative AI (Detlef Nauck, BT) - 12

We need effective guardrails

If controlling an LLM means making it

provide accurate, truthful and appropriate responses to questions
then they are all out of control.
Developers don’t understand the deep networks they build:
too much alchemy, not enough science & engineering.
The tech industry needs to be better:
implement guardrails and be open about the data used for training.
We need more well-funded dedicated AI Safety research.
Future innovation will come from open source.
There are massive efforts underway in making
models smaller and more efficient.
The future is in combining models (e.g. LangChain)
which is even harder to control.
The Impact of GenAI
Generative AI (Detlef Nauck, BT) - 13

We are witnessing an unprecedented social experiment on a global scale

If we want it or not, we need to get our head around

GenAI because we all will be exposed to it.

GenAI will change the way we create and consume

information.

We need to encourage responsible use of GenAI.

We need a debate to support the creation of

helpful regulatory frameworks.
Some Recommended Reading
Generative AI (Detlef Nauck, BT) - 14

Matteo Wong: The Difference Between Speaking and Thinking. The Atlantic, 31 Jan 2023.
Elizabeth Weil: You Are Not a Parrot. New York Magazine, 1 Mar 2023.
Kate Crawford: Atlas of AI. Yale University Press, 2021.
Melanie Mitchell: Artificial Intelligence. A Guide for Thinking Humans. Pelican Book, 2019.
Samuel R Bowman: Eight Things to Know about Large Language Models. arXiv:2304.00612, 2 Apr 2023.
15 Generative AI (Detlef Nauck, BT) -