POETICON Multisensory and Multimedia Recordings of Everyday Interaction

Instance of: Dataset
Description Πρόκειται για καταγραφές διάδρασης ζευγαριών για την επίτευξη μιας καθημερινής δουλειάς στο σπίτι (π.χ. καθαρίσματος, μαγειρέματος κτλ.). Οι καταγραφές έχουν γίνει σε δύο διαφορετικά σκηνικά, που εξυπηρετούν διαφορετικές ερευνητικές ανάγκες: (α) φυσικό σκηνικό: πρόκειται για οπτικο-ακουστικές καταγραφές με 5 κάμερες (multiview recordings) σε σκηνικό απόλυτα φυσικό (β) σκηνικό υψηλής τεχνολογίας: πρόκειται για καταγραφή της διάδρασης με βίντεο (3 κάμερες - multiview), και παράλληλα, πλήρης καταγραφή των κινήσεων του ζευγαριού με χρήση motion suits καθώς και καταγραφή της μετακίνησης στο χώρο συγκεκριμένων αντικειμένων (object tracking). Βίντεο και δεδομένα κίνησης είναι πλήρως συγχρονισμένα. Επίσης, έχουν παραχθεί 3D animation videos που απεικονίζουν όλες τις μετρήσεις κίνησης. Ο πόρος αναπτύχθηκε σε συνεργασία με το Max Planck Institute of Biological Cybernetics, Tuebingen, Germany όπου έγιναν όλες οι καταγραφές.
A corpus of language use and sensorimotor experience recordings in everyday human:human interaction, in which spontaneous language communication has been recorded along with corresponding multiview video recordings, recordings of 3D full body kinematics, and 3D tracking of objects in focus. It is a twelve-hour corpus which comprises six everyday human:human interaction scenes, each one performed 3 times by 4 different English-speaking couples (interaction between a male and a female actor), each couple acting each scene in two settings: a fully naturalistic setting in which 5-camera multi-view video recordings take place, and a high-tech setting, with full body motion capture for both individuals, a 2-camera multiview video recording, and 3D tracking of focus objects. Video animations of the motoric data supplement the corpus.
Language en
Language English
Rights CC-BY-NC-SA
See Also http://metashare.elda.org/repository/browse/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b/
Source META-SHARE
Subject everydayScenes
human human interaction
Title POETICON Multisensory and Multimedia Recordings of Everyday Interaction
Σώμα Πολυαισθητηριακών και Πολυμεσικών Καταγραφών Καθημερινής Διάδρασης POETICON
Type Resource Info
Type Corpus

Contact Point

Communication Info
Address Spemannstr. 38
City Tübingen
Country Germany
Email Christian.Wallraven@tuebingen.mpg.de
Type Communication Info
Zip Code 72076
Gender male
Given Name Christian
Surname Wallraven
Type Contact Person
Person
Person Info Type

Corpus Info

Corpus Audio Info
Audio Size Info
Size Info
Size 12
Size Unit Hours
Type Size Info Type
Type Audio Size Info
Capture Info
Person Source Set Info
Age Of Persons Adult
Number Of Persons 8 Int
Origin Of Persons Non Native
Sex Of Persons Mixed
Type Person Source Set Info
Type Capture Info
Language Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#language Info
Linguality Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#linguality Info
Link To Other Media Info
Media Type Details dialogues of the video
Other Media Video
Synchronized With Video true Boolean
Type Link To Other Media Info
Media Type Audio
Modality Info
Modality Type Facial Expression
Body Gesture
Spoken Language
Type Modality Info
Setting Info
Audience No
Conversational Type Dialogue
Interaction human-human
Interactivity Interactive
Naturality Semi Planned
Scenario Type Role Play
Type Setting Info
Type Corpus Audio Info
Corpus Text Info
Domain Info
Domain everyday scenes
Type Domain Info
Language Info
Language English
Language en
Language Name English
Type Language Info
Linguality Info
Linguality Type Monolingual
Type Linguality Info
Link To Other Media Info
Other Media Text Numerical
Synchronized With Text false Boolean
Type Link To Other Media Info
Other Media Video
Synchronized With Video false Boolean
Type Link To Other Media Info
Media Type Text
Size Info
Size 6
Size Unit Files
Type Size Info Type
Text Classification Info
Type Text Classification Info
Type script
Text Format Info
Mime Type application/pdf
Type Text Format Info
Type Corpus Text Info
Corpus Text Numerical Info
Capture Info
Capturing Device Type Other
Capturing Device Type Details 2 Moven motion capture suits (Xsens technologies) and 2 helmets with tracking markers (Vicon motion capture system)
Type Capture Info
Link To Other Media Info
Media Type Details animated version; synchronization between the camera videos and the kinematic recordings of both Moven and Vicon data was achieved by cutting the data according to the audio track and the start of the actions for the kinematic recordings
Other Media Video
Synchronized With Video true Boolean
Type Link To Other Media Info
Media Type Details low tech video; synchronization between the camera videos and the kinematic recordings of both Moven and Vicon data was achieved by cutting the data according to the audio track and the start of the actions for the kinematic recordings
Other Media Video
Synchronized With Video true Boolean
Type Link To Other Media Info
Media Type Details high tech video; synchronization between the camera videos and the kinematic recordings of both Moven and Vicon data was achieved by cutting the data according to the audio track and the start of the actions for the kinematic recordings
Other Media Video
Synchronized With Video true Boolean
Type Link To Other Media Info
Media Type Text Numerical
Modality Info
Modality Type Body Gesture
Type Modality Info
Size Info
Size 148
Size Unit Files
Type Size Info Type
Text Numerical Content Info
Type Text Numerical Content Info
Type Of Text Numerical Content motion capture data
Type Corpus Text Numerical Info
Corpus Video Info
Capture Info
Person Source Set Info
Age Of Persons Adult
Number Of Persons 8 Int
Sex Of Persons Mixed
Type Person Source Set Info
Type Capture Info
Creation Info
Creation Mode Mixed
Creation Mode Details computer animated versions of selected POETICON motion capture data (TextNumerical corpus)
Type Creation Info
Domain Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#domain Info
Language Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#language Info
Linguality Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#linguality Info
Link To Other Media Info
Media Type Details computer animated versions of selected POETICON motion capture data (TextNumerical corpus)
Other Media Text Numerical
Synchronized With Text Numerical true Boolean
Type Link To Other Media Info
Media Type Details original high-quality video
Other Media Video
Synchronized With Video true Boolean
Type Link To Other Media Info
Media Type Video
Modality Info
Modality Type Spoken Language
Facial Expression
Combination Of Modalities
Body Gesture
Type Modality Info
Setting Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#setting Info
Size Info
Size 12
Size Unit Hours
Type Size Info Type
Type Corpus Video Info
Video Classification Info
Subject everydayScenes
Type Video Classification Info
Video Genre animatedVideo
Video Content Info
Text Included In Video None
Type Video Content Info
Type animatedVideo
Video Format Info
Mime Type video/mp4
Type Video Format Info
Visual Modelling 3D
Capture Info
Capturing Device Type Other
Camera
Capturing Device Type Details 2 synchronized wide-angle HD camcorders
Person Source Set Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#person Source Set Info
Type Capture Info
Domain Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#domain Info
Language Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#language Info
Linguality Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#linguality Info
Link To Other Media Info
Media Type Details computer animated versions of selected POETICON motion capture data
Other Media Text Numerical
Synchronized With Text Numerical true Boolean
Type Link To Other Media Info
Media Type Details synchronised with the naturalistic video (high tech version)
Other Media Video
Synchronized With Video true Boolean
Type Link To Other Media Info
Media Type Video
Modality Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#modality Info
Recording Info
Source Channel Camcorder
Type Recording Info
Setting Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#setting Info
Size Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#size Info3
Type Corpus Video Info
Video Classification Info
Subject everydayScenes
Type Video Classification Info
Video Genre videotapedEvent
Video Content Info
Text Included In Video None
Type Video Content Info
Type videotapedEvent
Video Format Info
Mime Type video/mp4
Resolution Info
Size Height 1400 Int
Size Width 1960 Int
Type Resolution Info
Type Video Format Info
Capture Info
Capturing Details 5-camera multi-view video recording
Capturing Device Type Camera
Capturing Device Type Details 5 HD camcorders (Canon HF100)
Person Source Set Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#person Source Set Info
Scene Illumination Fix
Type Capture Info
Domain Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#domain Info
Language Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#language Info
Linguality Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#linguality Info
Media Type Video
Modality Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#modality Info
Recording Info
Recording Environment Studio
Source Channel Camcorder
Type Recording Info
Setting Info
Audience No
Conversational Type Dialogue
Interactivity Interactive
Naturality Semi Planned
Scenario Type Role Play
Type Setting Info
Size Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#size Info3
Type Corpus Video Info
Video Classification Info
Subject human human interaction
Type Video Classification Info
Video Genre videotapedEvent
Video Content Info
Text Included In Video None
Type Video Content Info
Type enacting of everyday scenes
Video Format Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#video Format Info
Resource Type Corpus
Type Corpus Info

Distribution Info

Availability Available-restricted Use
License
Attribution Text The creation of this resource has been funded by the European Union, Framework Programme 7, within the framework of the POETICON project (http://www.poeticon.eu).
Delivery Channel Downloadable
Distribution Rights Holder
Organization Info Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#organization Info
Type Actor
Licensor
Organization Info
Communication Info
Email Christian.Wallraven@tuebingen.mpg.de
Type Communication Info
Department Name Human Perception, Cognition and Action
Organization Name Max Planck Institute for Biological Cybernetics
Organization Short Name MPG
Type Organization Info Type
Type Actor
Permission
Action http://creativecommons.org/ns/ShareALike
http://creativecommons.org/ns/CommercialUse
http://creativecommons.org/ns/Distribution
http://creativecommons.org/ns/Attribution
Constraint Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#permission
Duty Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#permission
Operator Eq
Purpose Academic Use
Type Constraint
Prohibition
Permission
Restrictions Of Use
Duty
Prohibition Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#permission
Same As https://creativecommons.org/licenses/by-nc-sa/4.0/
Type Licence Info
Type Distribution
Distribution Info

Identification Info

Description A corpus of language use and sensorimotor experience recordings in everyday human:human interaction, in which spontaneous language communication has been recorded along with corresponding multiview video recordings, recordings of 3D full body kinematics, and 3D tracking of objects in focus. It is a twelve-hour corpus which comprises six everyday human:human interaction scenes, each one performed 3 times by 4 different English-speaking couples (interaction between a male and a female actor), each couple acting each scene in two settings: a fully naturalistic setting in which 5-camera multi-view video recordings take place, and a high-tech setting, with full body motion capture for both individuals, a 2-camera multiview video recording, and 3D tracking of focus objects. Video animations of the motoric data supplement the corpus.
Πρόκειται για καταγραφές διάδρασης ζευγαριών για την επίτευξη μιας καθημερινής δουλειάς στο σπίτι (π.χ. καθαρίσματος, μαγειρέματος κτλ.). Οι καταγραφές έχουν γίνει σε δύο διαφορετικά σκηνικά, που εξυπηρετούν διαφορετικές ερευνητικές ανάγκες: (α) φυσικό σκηνικό: πρόκειται για οπτικο-ακουστικές καταγραφές με 5 κάμερες (multiview recordings) σε σκηνικό απόλυτα φυσικό (β) σκηνικό υψηλής τεχνολογίας: πρόκειται για καταγραφή της διάδρασης με βίντεο (3 κάμερες - multiview), και παράλληλα, πλήρης καταγραφή των κινήσεων του ζευγαριού με χρήση motion suits καθώς και καταγραφή της μετακίνησης στο χώρο συγκεκριμένων αντικειμένων (object tracking). Βίντεο και δεδομένα κίνησης είναι πλήρως συγχρονισμένα. Επίσης, έχουν παραχθεί 3D animation videos που απεικονίζουν όλες τις μετρήσεις κίνησης. Ο πόρος αναπτύχθηκε σε συνεργασία με το Max Planck Institute of Biological Cybernetics, Tuebingen, Germany όπου έγιναν όλες οι καταγραφές.
Distribution
Access URL http://poeticoncorpus.kyb.mpg.de/
Type Distribution
URL
Meta Share Id NOT_DEFINED_FOR_V2
Resource Short Name POETICON Recordings
Title POETICON Multisensory and Multimedia Recordings of Everyday Interaction
Σώμα Πολυαισθητηριακών και Πολυμεσικών Καταγραφών Καθημερινής Διάδρασης POETICON
Type Identification Info

Resource Creation Info

Creation End Date 2010-12-31 Date
Creation Start Date 2008-01-01 Date
Creator
Organization Info
Communication Info
Address Artemidos 6 & Epidavrou
City Athens
Country Greece
Distribution
Access URL http://www.ilsp.gr
Type Distribution
URL
Email www@ilsp.athena-innovation.gr
Region Maroussi
Type Communication Info
Zip Code GR-151 25
Organization Name Institute for Language and Speech Processing
Organization Short Name ILSP
Type Organization Info Type
Type Actor
Organization Info
Communication Info
Email Christian.Wallraven@tuebingen.mpg.de
Type Communication Info
Department Name Human Perception, Cognition and Action
Organization Name Max Planck Institute for Biological Cybernetics
Organization Short Name MPG
Type Organization Info Type
Type Actor
Funding Project
Distribution
Access URL http://www.poeticon.eu/
Type Distribution
URL
Funding Type Eu Funds
Project End Date 2010-12-31 Date
Project ID ICT-215843
Project Name POETICON: The Poetics of Everyday Life: Grounding Resources and Mechanisms for Artificial Agents
Project Short Name POETICON
Project Start Date 2008-01-01 Date
Type Project Info Type
Type Resource Creation Info

Resource Documentation Info

Documentation
Document Info
Distribution
Access URL http://poeticoncorpus.kyb.mpg.de/pub/LREC-2010-v3.pdf
Type Distribution
URL
Language en
Language English
Language Name English
Type http://swrc.ontoware.org/ontology#InProceedings
Document Info
http://swrc.ontoware.org/ontology#booktitle Proceedings of the Seventh conference on International Language Resources and Evaluation\" (LREC'10)
http://swrc.ontoware.org/ontology#conference Seventh conference on International Language Resources and Evaluation\" (LREC'10)
http://swrc.ontoware.org/ontology#creator Katerina Pastra and Christian Wallraven and Michael Schultze and Argiro Vatakis and Kathrin Kaulard
http://swrc.ontoware.org/ontology#title The POETICON corpus: Capturing language use and sensorimotor experience in everyday interaction
Type Documentation Info Type
Document Info
Distribution
Access URL http://poeticoncorpus.kyb.mpg.de/pub/fg2011.pdf
Type Distribution
URL
Language en
Language English
Language Name English
Type http://swrc.ontoware.org/ontology#InProceedings
Document Info
http://swrc.ontoware.org/ontology#conference The 9th IEEE Conference on Automatic Face and Gesture Recognition (FG '11)
http://swrc.ontoware.org/ontology#creator Christian Wallraven and Michael Schultze and Betty Mohler and Argiro Vatakis and Katerina Pastra
http://swrc.ontoware.org/ontology#title The POETICON enacted scenario corpus - a tool for human and computational experiments on action understanding
Type Documentation Info Type
Type Resource Documentation Info

Usage Info

Foreseen Use Info
Foreseen Use Nlp Applications
Type Foreseen Use Info
Type Usage Info

Version Info

Has Version 1.0
Type Version Info

Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#metadata Creator

Instance of: Actor
Is Creator of Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#metadata Info

Metashare/33e0098e177c11e2bc05842b2b6a04d7365c11457d854e17a8331a6ec735305b#Header

Instance of: Catalog Record
Issued 2014-09-23T00:31:04Z Date
Primary Topic POETICON Multisensory and Multimedia Recordings of Everyday Interaction
Set Spec corpus:audio:video
corpus:text
corpus:audio
corpus:audio:video:textnumerical
corpus:text:textnumerical
corpus:textnumerical
corpus:text:video:textnumerical
corpus:video
corpus
corpus:video:textnumerical
corpus:text:audio:video
corpus:text:audio:textnumerical
corpus:audio:textnumerical
corpus:text:video
corpus:text:audio:video:textnumerical
corpus:text:audio