ArtWalks via Latent Diffusion Models
dc.contributor.author
Pennino, Alberto
dc.contributor.author
El Helou, Majed
dc.contributor.author
Vera Nieto, Daniel
dc.contributor.author
Zünd, Fabio
dc.date.accessioned
2024-09-04T07:42:04Z
dc.date.available
2024-09-03T15:31:35Z
dc.date.available
2024-09-04T07:42:04Z
dc.date.issued
2024-09-04
dc.identifier.uri
http://hdl.handle.net/20.500.11850/692112
dc.identifier.doi
10.3929/ethz-b-000692112
dc.description.abstract
ArtWalks presents a creative application of multiple techniques in image and video generation. We explore the creation of a dynamic bridge between between two paintings, seamlessly transitioning between artworks adding motion to static images. We build a two stage generative process, creating both abstract-conceptual interpo lation as well as spatio-temporal interpolation. We first hallucinate intermediate artworks using a generative diffusion model, then interpolate between resulting frames using a motion generation network, thus obtaining a complete video out of static paintings.
en_US
dc.format
application/pdf
en_US
dc.language.iso
en
en_US
dc.publisher
ETH Zürich
en_US
dc.rights.uri
http://rightsstatements.org/page/InC-NC/1.0/
dc.subject
Generative models
en_US
dc.subject
Motion generation
en_US
dc.subject
Diffusion models
en_US
dc.subject
Concept interpolation
en_US
dc.subject
Image interpolation
en_US
dc.subject
Applied computer vision
en_US
dc.subject
Art
en_US
dc.subject
Computational art
en_US
dc.title
ArtWalks via Latent Diffusion Models
en_US
dc.type
Other Conference Item
dc.rights.license
In Copyright - Non-Commercial Use Permitted
ethz.size
3 p.
en_US
ethz.event
16th Annual ACM SIGGRAPH Conference on Motion, Interaction and Games (MIG 2023)
en_US
ethz.event.location
Rennes, France
en_US
ethz.event.date
November 15-17, 2023
en_US
ethz.notes
Poster presentation on November 15, 2023
en_US
ethz.publication.place
Zürich
en_US
ethz.publication.status
published
en_US
ethz.leitzahl
ETH Zürich::00002 - ETH Zürich::00012 - Lehre und Forschung::00007 - Departemente::02150 - Dep. Informatik / Dep. of Computer Science::02154 - Media Technology Center (MTC) / Media Technology Center (MTC)
en_US
ethz.date.deposited
2024-09-03T15:31:35Z
ethz.source
FORM
ethz.eth
yes
en_US
ethz.availability
Open access
en_US
ethz.rosetta.installDate
2024-09-04T07:42:05Z
ethz.rosetta.lastUpdated
2024-09-04T07:42:05Z
ethz.rosetta.exportRequired
true
ethz.rosetta.versionExported
true
ethz.COinS
ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.atitle=ArtWalks%20via%20Latent%20Diffusion%20Models&rft.date=2024-09-04&rft.au=Pennino,%20Alberto&El%20Helou,%20Majed&Vera%20Nieto,%20Daniel&Z%C3%BCnd,%20Fabio&rft.genre=unknown&rft.btitle=ArtWalks%20via%20Latent%20Diffusion%20Models
Files in this item
Publication type
-
Other Conference Item [19350]