SOAP: Difference between revisions

From IDSwiki
Jump to navigationJump to search
No edit summary
 
(5 intermediate revisions by one other user not shown)
Line 1: Line 1:
[[IRIS Wiki]] - [[IS Systems]] - '''{{PAGENAME}}'''
[[IRIS Wiki]] - [[IS Systems]] - '''{{PAGENAME}}'''
===Availability===
===Availability===
Currently the system is not directly available for download, but parts of the system architecture, such as the ''Virtual Beergarden'' [http://hcm-lab.de/projects/iris/index.php/Virtual_Beergarden] and ''SceneMaker'' [http://hcm-lab.de/projects/iris/index.php/SceneMaker] are available for download. The developers are working on a version which is available for download. The tool in the recent finished version is available on request by first contacting the developers. Please contact the main author Birgit Endrass [http://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/endrass/] for more information.
The SOAP scenario was developed as a research prototype. It is not available for download. Nevertheless, you can get most of the technical components used for implementing the system for download, such as the ''Virtual Beergarden'' [http://hcm-lab.de/projects/iris/index.php/Virtual_Beergarden] and ''SceneMaker'' [http://hcm-lab.de/projects/iris/index.php/SceneMaker].  


===Technical Description===
===Technical Description===
In the soap-like story, the user can interact with a set of virtual characters. Through dialog interactions, the progress and outcome of the story can be influenced. For the realization of the SOAP scenario, several components were needed such as language understanding that parses the user's text input into abstract dialog utterances, a dialog model that controls the narrative flow of the story and a graphical representation holding the virtual characters as well as the user avatar.
In the soap-like story, the user can interact with a set of virtual characters. Through dialog interactions, the progress and outcome of the story can be influenced. For the realization of the SOAP scenario, several components were needed such as language understanding that parses the user's text input into abstract dialog utterances, a dialog model that controls the narrative flow of the story and a graphical representation holding the virtual characters as well as the user avatar. The Figure below shows the main components of the system architecture and their responsibilities.
 
[[File:SOAP.png|400px|System Architecture of SOAP.]]


===Result Description ===
===Result Description ===
In the scenario, the characters are involved in a romantic conflict. The user, who is represented by an avatar can approach the different characters, listen to their conversations and interact with them. In that manner, the user can either approach a group of girls, a group of guys, or a waitress that is working in a virtual beer garden. In order to save resources, dialogs take place only if the user is near the characters, otherwise idle dialog behavior is presented. Through observation and interaction, the user will learn that there is a love story secretly going on. Dependent on the user's interactions, the characters will reveal their love, ask for help and follow the user's advice. Different scenario endings were modeled, while the user can make a match between two persons of his choice.
In the scenario, the characters are involved in a romantic conflict. The user, who is represented by an avatar can approach the different characters, listen to their conversations and interact with them. In that manner, the user can either approach a group of girls, a group of guys, or a waitress that is working in a virtual beer garden. In order to save resources, dialogs take place only if the user is near the characters, otherwise idle dialog behavior is presented. Through observation and interaction, the user will learn that there is a love story secretly going on. Dependent on the user's interactions, the characters will reveal their love, ask for help and follow the user's advice. Different scenario endings were modeled, while the user can make a match between two characters.


===Authoring Description===
===Authoring Description===
The tools used for the authoring process are
The tools used for the authoring process are
* ''SceneMaker'': Dialog modeling and the flow of the scenario is done using the ''SceneMaker'' [http://hcm-lab.de/projects/iris/index.php/SceneMaker] tool.
* ''SceneMaker'': Dialog modeling and the flow of the scenario is done using the ''SceneMaker'' [http://hcm-lab.de/projects/iris/index.php/SceneMaker] tool which relies on [[Sceneflows]] as computational model.
* ''SPIN'': The user's typed text input is parsed into abstract dialog utterances using the semantic parser ''SPIN''.
* ''SPIN'': The user's typed text input is parsed into abstract dialog utterances using the semantic parser ''SPIN''.


===Main Publications===
===Main Publications===
* Birgit Endrass, Christoph Klimmt, Gregor Mehlmann, Elisabeth André, and Christian Roth, Exploration of User Reactions to Different Dialog-based Interaction Style, Proceedings of the 4th International Conference on Interactive Digital Storytelling (ICIDS 2011), 2011 <br>
* Endrass, B., Klimmt, C. Mehlmann, G., André, E. and Roth, C. (2011) Exploration of User Reactions to Different Dialog-based Interaction Style, Proceedings of the 4th International Conference on Interactive Digital Storytelling (ICIDS 2011)
* Gregor Mehlmann, Birgit Endrass, Elisabeth André, Modeling and Interpretation of Multithreaded and Multimodal Dialogue, Proceedings of the 13th International Conference on Multimodal Interaction (ICMI 2011), 2011.
* Mehlmann, G:, Endrass, B., André, E. (2011) Modeling and Interpretation of Multithreaded and Multimodal Dialogue, Proceedings of the 13th International Conference on Multimodal Interaction (ICMI 2011).


===Computational Model===
===Computational Model===
Line 25: Line 27:
* Input modalities: typed-text
* Input modalities: typed-text
* Output modalities: text-to-speech & nonverbal behavior of virtual characters
* Output modalities: text-to-speech & nonverbal behavior of virtual characters
===Contact===
For further information please contact Birgit Endrass [http://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/endrass/].

Latest revision as of 11:37, 12 January 2012

IRIS Wiki - IS Systems - SOAP

Availability

The SOAP scenario was developed as a research prototype. It is not available for download. Nevertheless, you can get most of the technical components used for implementing the system for download, such as the Virtual Beergarden [1] and SceneMaker [2].

Technical Description

In the soap-like story, the user can interact with a set of virtual characters. Through dialog interactions, the progress and outcome of the story can be influenced. For the realization of the SOAP scenario, several components were needed such as language understanding that parses the user's text input into abstract dialog utterances, a dialog model that controls the narrative flow of the story and a graphical representation holding the virtual characters as well as the user avatar. The Figure below shows the main components of the system architecture and their responsibilities.

System Architecture of SOAP.

Result Description

In the scenario, the characters are involved in a romantic conflict. The user, who is represented by an avatar can approach the different characters, listen to their conversations and interact with them. In that manner, the user can either approach a group of girls, a group of guys, or a waitress that is working in a virtual beer garden. In order to save resources, dialogs take place only if the user is near the characters, otherwise idle dialog behavior is presented. Through observation and interaction, the user will learn that there is a love story secretly going on. Dependent on the user's interactions, the characters will reveal their love, ask for help and follow the user's advice. Different scenario endings were modeled, while the user can make a match between two characters.

Authoring Description

The tools used for the authoring process are

  • SceneMaker: Dialog modeling and the flow of the scenario is done using the SceneMaker [3] tool which relies on Sceneflows as computational model.
  • SPIN: The user's typed text input is parsed into abstract dialog utterances using the semantic parser SPIN.

Main Publications

  • Endrass, B., Klimmt, C. Mehlmann, G., André, E. and Roth, C. (2011) Exploration of User Reactions to Different Dialog-based Interaction Style, Proceedings of the 4th International Conference on Interactive Digital Storytelling (ICIDS 2011)
  • Mehlmann, G:, Endrass, B., André, E. (2011) Modeling and Interpretation of Multithreaded and Multimodal Dialogue, Proceedings of the 13th International Conference on Multimodal Interaction (ICMI 2011).

Computational Model

The tool was designed without any background of narrative theories but uses Sceneflows as the main mean for dialogue and interaction modeling.

Type of Interaction

  • Interaction devices: keyboard, mouse
  • Input modalities: typed-text
  • Output modalities: text-to-speech & nonverbal behavior of virtual characters

Contact

For further information please contact Birgit Endrass [4].