Scribd Logo
Upload

Welcome to Scribd!

  • 11 views

    Toolkit For Pure Data: Topos

    Uploaded by

    Luiz Naveda
    The document introduces the Topos Tool Kit, an open-source library written in Pure Data for analyzing motion capture data from dance and music performances. It extracts high-level spatial and relational features using topological gesture analysis and windows topological gesture analysis. The Topos library contains objects for importing motion data, visualizing data, extracting features describing trajectories, geometry, and relationships between points/regions, and exporting feature data. Case studies are described where it was used for interactive music applications analyzing Kinect skeleton data from dance performances.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content

    You might also like

    Toolkit For Pure Data: Topos

    Uploaded by

    Luiz Naveda
    11 views18 pages
    The document introduces the Topos Tool Kit, an open-source library written in Pure Data for analyzing motion capture data from dance and music performances. It extracts high-level spatial and relational features using topological gesture analysis and windows topological gesture analysis. The Topos library contains objects for importing motion data, visualizing data, extracting features describing trajectories, geometry, and relationships between points/regions, and exporting feature data. Case studies are described where it was used for interactive music applications analyzing Kinect skeleton data from dance performances.

    Original Description:

    Presentation ICMC2014

    Original Title

    SMC-ICMC-14main

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document introduces the Topos Tool Kit, an open-source library written in Pure Data for analyzing motion capture data from dance and music performances. It extracts high-level spatial and relational features using topological gesture analysis and windows topological gesture analysis. The Topos library contains objects for importing motion data, visualizing data, extracting features describing trajectories, geometry, and relationships between points/regions, and exporting feature data. Case studies are described where it was used for interactive music applications analyzing Kinect skeleton data from dance performances.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    11 views18 pages

    Toolkit For Pure Data: Topos

    Uploaded by

    Luiz Naveda
    The document introduces the Topos Tool Kit, an open-source library written in Pure Data for analyzing motion capture data from dance and music performances. It extracts high-level spatial and relational features using topological gesture analysis and windows topological gesture analysis. The Topos library contains objects for importing motion data, visualizing data, extracting features describing trajectories, geometry, and relationships between points/regions, and exporting feature data. Case studies are described where it was used for interactive music applications analyzing Kinect skeleton data from dance performances.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 18

    TOPOS TOOL KI T FOR PURE DATA

    L UI Z NAVEDA
    STATE UNI VERSI TY OF MI NAS
    GERAI S ( BRAZI L )
    I CMC | SMC 2014 - ATHENS GREECE
    I VANI SANTANA
    FEDERAL UNI VERSI TY OF
    BAHI A ( BRAZI L )
    exploring the spatial features of dance gestures for interactive musical applications
    SEPT/ 2014
    CONTEXT
    <100 USD <300 USD >5000 USD
    MOTI ON
    CAPTURE
    SYSTEMS
    MOTI ON
    CAPTURE
    DATA
    accelerometers
    infrared
    3D image
    infrared
    3D marker
    PROBL EMS
    How to extract realtime high-level information from
    motion capture data of music and dance performances?
    Imposed Cartesian coordinates ! meaningful feature
    descriptors for dance and music?
    Complex full body datasets ! simple and accessible
    motion descriptors
    Ad-hoc programming routines ! fast prototyping and
    mapping
    Becking curves
    1928
    Truslit
    1938
    Dahl
    2000
    REPRESENTATI ON OF MUSI C AND
    DANCE GESTURE
    REPRESENTATI ON OF MUSI C AND
    DANCE GESTURE
    Becking curves
    1928
    Truslit
    1938
    Dahl
    2000
    COGNI TI ON OF SPACE AND GESTURE
    Paillard (1991)
    Morphokinetic:
    Deals with shape or form regardless of spatial
    location
    Topokinetic:
    Deals with spatial location and spatial
    intentionality regardless of shape
    COGNI TI ON OF SPACE AND GESTURE
    Paillard (1991)
    Morphokinetic:
    Deals with shape or form regardless of
    spatial location
    Topokinetic:
    Deals with spatial location and spatial
    intentionality regardless of shape
    Leman & Naveda (2010)
    Naveda & Leman (2010)
    Topokinetic:
    Deals with spatial location and spatial
    intentionality regardless of shape
    TGA
    TOPOL OGI CAL GESTURE ANALYSI S
    Naveda & Leman (2010)
    WTGA
    WI NDOWED TGA ANALYSI S
    Topologies are dened by previous and next movement trajectories
    X

    Y

    Z
    +0.5 sec -0.5 sec
    Intentionality
    Upcoming gesture
    Short-Term Memory
    Preceding gesture
    +0.5 sec
    -0.5 sec
    Naveda & Santana (2010)
    TOPOS AL GORI THM
    gemhead
    Second inlet:
    x y z floats
    pack f f f
    First inlet: gemlist
    6
    topos ID XYZ 100 10
    C
    l
    o
    c
    k
    new sample
    Code: Projection onto a point cloud (ID)
    2
    1
    ...
    3
    5
    6
    4
    point cloud
    topos.skeleton 1
    topos.quality
    topos.rec topos.rec.slave
    topos.geo.2 ID xyz1 xyz2
    topos.geo.4 ID xyz1 xyz2 xyz3 xyz4
    topos.rel.points ID xyz1 xyz2 0.3
    topos.rel.pointRegion ID xyz1 IDtopos 0.3
    topos.features ID
    topos ID xyz1 100 20
    topos.rel.regions ID IDtopos1 IDtopos2 0.3
    Transformation
    Feature
    extraction
    Description of
    relationships
    Tools
    xyz
    trajectories
    [topos]
    Transformations
    Topos-Feature
    extraction
    Geom-Feature
    extraction
    Relationship
    features
    Symbolic link
    3D data
    Sampling period
    number of points
    TOPOS FEATURES
    TOPOS L I BRARY
    DATA FL OW AND
    MANAGEMENT
    VI SUAL I ZATI ON
    FEATURE
    DESCRI PTI ON
    REL ATI ONSHI PS
    synapse
    osceleton
    skeleton
    Point clouds
    Points (2,4)
    Point clouds
    points and point clouds
    points
    TOPOS L I BRARY
    PL AY/ REC
    VI SUAL I ZATI ON
    ANALYSI S
    FEATURE RETRI EVAL
    topos.skeleton 1
    topos.quality
    topos.rec topos.rec.slave
    topos.geo.2 ID xyz1 xyz2
    topos.geo.4 ID xyz1 xyz2 xyz3 xyz4
    topos.rel.points ID xyz1 xyz2 0.3
    topos.rel.pointRegion ID xyz1 IDtopos 0.3
    topos.features ID
    topos ID xyz1 100 20
    topos.rel.regions ID IDtopos1 IDtopos2 0.3
    Transformation
    Feature
    extraction
    Description of
    relationships
    Tools
    xyz
    trajectories
    [topos]
    Transformations
    Topos-Feature
    extraction
    Geom-Feature
    extraction
    Relationship
    features
    I NPUTS: KI NECT
    ( OSCEL ETON, SYNAPSE) ,
    MOCAPTOOL BOX* OR
    RECORDED DATA
    11 ABSTRACTI ONS/ OBJ ECTS
    ENTI RELY WRI TTEN I N PURE
    DATA
    SYNTHESI S
    gemhead
    freeze $1
    route velocity distanceFrom
    topos rhand1 1/r_hand/pos 30 50
    topos.rel.pointRegion hands l_hand/pos rhand1 0.3
    list-math / 3
    t b f
    random 24
    pack f f
    + 60
    dac~
    mtl/additive~
    d(n)
    d
    n points
    Distances from lhand to the
    point cloud of rhand are used
    as magnitudes of oscilators
    in addirive synthesis
    CASE: DARMSTAD 5 8 ' ( 2 0 1 3 - 1 4 )
    BRAZI L
    MEXI CO
    SPAI N
    AUDI O, VI DEO, CONTROL
    Receiving 2 skeletons
    Sending 1 skeleton
    CASE: MI RADAS DO CAOS I I ( 2 0 1 4 )
    kinect
    blob detection
    (pix_freenect)
    Topos Library
    FI NAL CONSI DERATI ONS
    Contributions
    Minimal set of tools for high-level
    descriptors
    Provide access to a number of features and
    gestural relationships
    Problems
    Contextual features X strict synchronisation
    Dance traditions X expertise in controlling
    sound
    Library, tutorials and documentation
    www.naveda.info
    Thanks!

    You might also like