Poetic Dream

A.I. Poetry Imagery Visualizer

12th grade self-directed project

Yu-Teng Li

Maker Self-Intro Video (2 min) - https://youtu.be/1iLNJpTLJyY

ML Code & Demo Webpage: https://github.com/Curiouskid0423/Poetic_Dream

PART ONE

Poetic Dream is an AI poetry imagery visualizer project

based on Deep Learning, analyzing a poem and
composing corresponding artistically-styled image/painting

What is Poetic Dream

PART ONE

Motivation
Can text inspire artworks?

. 22 - 2 1 2 - 2 8
2 8 8 8 2 . 8
0

8 8 88 8 . - . 88
“How Images Inspire Poems”
PART ONE A

Paper Research
: : A A A -AE: 2 GF ) J )D N F
- C F 3 JJAB JA &

A :( : -AE: -
: A 0K JBF 0GAF GF )D N F )D AB 2B . B . B

C A : : A E
CA ) E AC 2BFDB K 2B F 0B F (

A A A A A A -
7GE 3BCGDGL 1 B A F G G 0 , F

A A EC DA A
5G -F D , E GMD 8
PART ONE (

Problem Analysis
What is poetry imagery, what is arts ?

(
, ) ) - ) ) ) ) (
- , - ) - ( )

) )
) , ) ) - ( )
) ( ) ) - ( ) ,
,
PART ONE

Flow Chart
PART ONE )

B D D IAD E JF A EAD9 AI -G BJ BJ

(
- FGD G DA EE A ADF D ADJ
C E C ( A2 -G D F AD 2

( ( (
- GD FJ D E9 D
Framework 2(( BD FD A

Tools
) D 1 EB E )

AG ( 1 D (AA A AD FADJ

1E D ) F D9 E I B E AAFEFD B D BF
PART ONE )91 1

Natural Language Processing

33 ) ) ) ) 3 1 1
(1 (1 9 (( 9 9 1 1 9 A

Image Captioning / API Search

- ) , 3 3 - ) ( ,
) 3 - ( ) , 3 3 - ( )

Neural Style Transfer

3 ( ) 3 - - 9 9 9
(1 (1 9 (( 3

Graphics Interface / Webpage

- ) ( -
) )) - Procedure Overview
PROJECT ONE
ML Code: https://github.com/Curiouskid0423/Poetic_Dream

Preprocessing- Photo OCR

/ / / / / /
PROJECT ONE
ML Code: https://github.com/Curiouskid0423/Poetic_Dream

Step 1 - NLP

A / / E A A >B , >B (
B A /A A B A/ / / A A A/ B /
A A A / A A/ B/ AA / A

A / A B A A / )) / , ( )) /
)) / A/ A A A A /A
B / G , ( / B/ AA B A A / A /A A EA
/ A/ A A /A B /A /A Γu A /A Γf / BA BA
/A Γo
, (B A / /

)/AB / / B/ / , / ) B / ,A / / A / . /
PART ONE &

-
- - -B - -. -/ - -
- - .- . --
- /
/ / - -B

D / / .
/ -

- - - - / - -/ - B - - / -/ . -
PART ONE

CA C:E A:I C: A C:E C

GCA C:E A:I C: A C
: :5 CC A A :C :5 A C:
C A C A C :
: 5:E:5 A5
, 5 CA : 5 C C
E: A E: C C
A E C5 C C : 5 A E A

5 C C

- C A .A : / A ( : - A /C 0A A )A : C A 1
PART ONE

/ >A A : A A> A A
>A >E A E I> A E A> ( >
A I > > >
AI > >A > A A I >
> E ’ A
>

A E > > : “
( ) ” G A
A E A
A > >A K
> > A ) A A AI > ) >
> AA A > E > >

A > , ( >A >

A ) A> - A A - .A A A A
PROJECT ONE

/ 1 1F 1 1: 1 ./
1 C 1
1

1 1F ( E
1 1 1 F 1 1
1 C1 F 1 1 1 )
1 E 11

,1 C 1 1 C1 ( 1 . 1 , C1 .F /1 1 ( 1 0 1
PART ONE

/ /
/
/ / / / /
/ / / /

/ / / (/ / / ( /) / / / / /
PART ONE

Step 2 – IMG Search

C CA . A A (
C A A A A CA
CB C BE B B A B A
B B A CB C A C B B
CB B C BE ( B AA B ! .A
B B AB B A B AC BA

BC ) C AA ( , C ,B - A ( B /
PART ONE
ML Code: https://github.com/Curiouskid0423/Poetic_Dream

Step 3 - NST

(
, ,
/ . / . /

)
, , . / , /
/ / , . / / ,
/ / .

/ / / / / . . /
PART ONE

E 5 I 9 C 6 5 5E Jcontent & Jstyle 5 5E

C (E 5 G 9 6 66

/ C5 E I 6 6
6 1)) C 6 ) C’
6 / C ( G G F
9 C 6 C
) 9 E6 ) 0 F

5 5 5 6 C 9 Jcontent & Jstyle

E 9E 9 5 CC 9 9 . 5 9 E . / C ) 5 5 2 9
PART ONE /

/
/ / J.
/ /

Credit: MYSTERIOUS RAIN PRINCESS —By Leonid Afremov

/ / /
PART ONE

Step 4 - GUI Design

/ / / ./ --/ / /
/ /. / / -- - /
/ - / - / . . . //
./ / / . / /

/ -/ / / - / / / / - / -/ / /
PART ONE

Step 4 - GUI Design

/

( / ) / )A / /
 Page 1

, , .
,

Page 2

,
 , ,( , ,, , ( -

, (-, ,( (

Page 3

(-, (-, ,( - ,
,, ) ( , ( -, -(
( ()( , ( , - ), (-, ( ( (
, ( , , -, , ( , ,
, , ,( )( ( ), ( ( ( -,
 Redirect Page

- 1 -. B 5 1 1 1 -15 - 1
1 01 -5 5 -. - ) 1

Page 4

- )- 1 C (1 - 1 - 1
)1 ( .- 10 1 1 - 0 1 5 - 1
1 1 10 5 1 1 5 1 5 51 1 -
5 1 1 .- 5 1 11 1- 5
 Neural Style Transfer

Artwork of Imagery

Style Image

Content Image

POEM TEXT
Natural Language Processing
Keyword:
road diverged
yellow woods
TESSEARCT
Photo OCR Analysis Sentiment: Negative Flow of Data
PROJECT ONE

2 + 0 2 ) 0

1 0 40 . 0 . 0 . 0 1 40 . 0 0 . 0

(02 0
+ 0 . 0 0

Other artworks displayed in my Creative Writing Portfolio

PART ONE

+ . 5 1

0 .5 0 5 1 0 0 5 .35 . 5 0 .4 0

) 55
+ +4 . -. (. . 5
PART ONE

+ 4 4 51 + 15

1 1 1 1 . 51 1 5 1 1 542 1

) 44 1
1 21 51 1 1 5 01 ( 1
PART ONE

A
B B B B A

, ) C A

) ) ( A A
B B B B

A ( A A+
PROJECT ONE

E A E A A A A AE
A A AA A E A A A E AE
A - !.
) A A , ) A AE

, ) EA E A , A A A A
E A E A E C (
A A C A A A A A ! A AC
A A A A A A A A C E
“ ” ! A A A

ML Code: https://github.com/Curiouskid0423/Poetic_Dream
PROJECT ONE

Data Limitation
1D8 (IB8 8 8 Computational cost
E8 8G E E A 88 E AE -,. - 0D 8 D A E 8 A B E EA
A E D A ) EJD’s A DA ’D B B8 8IB8 D8 5 E E D8E DD 8D 8 -,. 8G8 A 8
8DB8 E G8 J BB A 8 E 8 - 0 A 8 E 8 E E 8 A ED8E A G8
A8 8I 5 EJ 5 E DA 8 A B E EA 8 EA E8 J E E D8E -,.

E8D A ).1 EA 8 8 I E A 8E E8 E 8 8D8 D E 8 J8E DE E ED

E 8 DB88 A - 0 D EA 58 8 8 A 58EE8 E DE 8 E D B EA ABE 8E 8B A

D8 8IB8 8 8 E JA 58 8 E8 E 8 E D8E E 8 E 8
A A 8D ED EA J 8D ED

. ( B E 8A
88B ,8
. 8 D A A -,.
D DE E E DE 8A 8D8
8 . . . A & .
AB8 EA B 5 D E EA E 8 B 5 EA B A AE8
EA E8 B 8E BA8 D EA A 8J A
E 8 8 A E8 AA J E E E 8 G 8A
8IE EA D B A5 5 J A E 8 58DE DA E A
E 8D 8E E D BJE 8D E D 8 A D EA
A E 8 J 8D8 A . . A 8 8
EE E 8 58DE 8D E E 8 8 B E 8A 88B
8 E8 EA A E 8 8D8
A 8 8

ML Code: https://github.com/Curiouskid0423/Poetic_Dream
 Poetic Dream
A.I. Poetry Imagery Visualizer

12th grade self-directed project

Maker Self-Intro Video (2 min) - https://youtu.be/1iLNJpTLJyY

ML Code & Demo Webpage: https://github.com/Curiouskid0423/Poetic_Dream