SOAP: Difference between revisions

From IDSwiki
Jump to navigationJump to search
No edit summary
 
(7 intermediate revisions by one other user not shown)
Line 1: Line 1:
[[IRIS Wiki]] - [[IS Systems]] - '''{{PAGENAME}}'''
[[IRIS Wiki]] - [[IS Systems]] - '''{{PAGENAME}}'''
===Availability===
===Availability===
Currently the system is not directly available for download, but parts of the system architecture , such as the [[Virtual Beergarden]] and [SceneMaker] are available for download. The developers are working on a version which is available for download. The tool in the recent finished version is available on request by first contacting the developers. Please contact the main author Birgit Endrass [http://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/endrass/] for more information.
The SOAP scenario was developed as a research prototype. It is not available for download. Nevertheless, you can get most of the technical components used for implementing the system for download, such as the ''Virtual Beergarden'' [http://hcm-lab.de/projects/iris/index.php/Virtual_Beergarden] and ''SceneMaker'' [http://hcm-lab.de/projects/iris/index.php/SceneMaker].  


===Technical Description===
===Technical Description===
In the soap-like story, the user can interact with a set of virtual characters. Through dialog interactions, the progress and outcome of the story can be influenced. For the realization of the SOAP scenario, several components were needed such as language understanding that parses the user's text input into abstract dialog utterances, a dialog model that controls the narrative flow of the story and a graphical representation holding the virtual characters as well as the user avatar.
In the soap-like story, the user can interact with a set of virtual characters. Through dialog interactions, the progress and outcome of the story can be influenced. For the realization of the SOAP scenario, several components were needed such as language understanding that parses the user's text input into abstract dialog utterances, a dialog model that controls the narrative flow of the story and a graphical representation holding the virtual characters as well as the user avatar. The Figure below shows the main components of the system architecture and their responsibilities.


===Result Description (end user perspective)===
[[File:SOAP.png|400px|System Architecture of SOAP.]]
In the scenario, the characters are involved in a romantic conflict. The user, who is represented by an avatar can approach the different characters, listen to their conversations and interact with them. In that manner, the user can either approach a group of girls, a group of guys, or a waitress that is working in a Virtual Beergarden. In order to save resources, dialogs take place only if the user is near the characters, otherwise idle dialog behavior is presented. Through observation and interaction, the user will learn that there is a love story secretly going on. Dependent on the user's interactions, the characters will reveal their love, ask for help and follow the user's advice. Different scenario endings were modeled, while the user can make a match between two persons of his choice.


Utterances of all parties in the conversation can influence parameter states in the game, two of which are the most important: The ‘Killer Phrase Level’ as kind of a stress level of the whole debate, and an ‘Agreement Level’. In the best case, the player can influence the stress level in a negative way so that the chances for constructive arguments are higher. Certain arguments increase the ‘Agreement Level’, and the game can end successfully for the moderator. In the worst case, the increasing ‘Killer Phrase Level’ reaches a threshold value that makes the discussion end with an escalation.
===Result Description ===
In the scenario, the characters are involved in a romantic conflict. The user, who is represented by an avatar can approach the different characters, listen to their conversations and interact with them. In that manner, the user can either approach a group of girls, a group of guys, or a waitress that is working in a virtual beer garden. In order to save resources, dialogs take place only if the user is near the characters, otherwise idle dialog behavior is presented. Through observation and interaction, the user will learn that there is a love story secretly going on. Dependent on the user's interactions, the characters will reveal their love, ask for help and follow the user's advice. Different scenario endings were modeled, while the user can make a match between two characters.


===Authoring Description===
===Authoring Description===
Authoring of the conversations is supported by a graphical interface, and can also be accomplished by directly writing AIML code (an XML-dialect, see www.alicebot.org). Single utterances are defined on 2 levels: an abstract dialogue act, such as "PARKING COMPLAINT", and a concrete wording of the utterance, such as "You should try coming home in the afternoons, you'd be hard pressed to find a parking space." Possible abstract dialogue acts of one character (bot) are then arranged to form either sequences or reaction possibilities to utterances coming from either another bot or the user. In order to accomplish sequences of turn-taking between 2 bots, the output of one utterance of Bot A has to be input as a pattern for another utterance of Bot B.
The tools used for the authoring process are
 
* ''SceneMaker'': Dialog modeling and the flow of the scenario is done using the ''SceneMaker'' [http://hcm-lab.de/projects/iris/index.php/SceneMaker] tool which relies on [[Sceneflows]] as computational model.
Dialogue sequences / utterances are groups within dialogue graphs, which are associated to an actor in a scene. Several scenes can be combined as a high-level plot graph, defining the overall structure of the conversation.
* ''SPIN'': The user's typed text input is parsed into abstract dialog utterances using the semantic parser ''SPIN''.
 
===Strong Points===
Scenejo enables the definition of multi-partner conversations with high-frequency interaction possibilities for users. A strong point is its accessibility for authors stemming from non-programming areas, who can quickly experiment with creating small conversations that can be directly experienced, without knowledge in programming.  Therefore, it is well suited for people making their first steps in experiencing typical authoring issues in Interactive Storytelling.
 
===Limitations===
Scenejo is currently limited to the design of verbal interaction with "talking heads" by typing text-chat. As it is based on the ALICE chatbot philosophy, combined with a low-level dialogue manager, recognition of user utterances is limited to author-defined patterns, the design of which is challenging.


===Main Publications===
===Main Publications===
* Birgit Endrass, Christoph Klimmt, Gregor Mehlmann, Elisabeth André, and Christian Roth, Exploration of User Reactions to Different Dialog-based Interaction Style, Proceedings of the 4th International Conference on Interactive Digital Storytelling (ICIDS 2011), 2011 <br>
* Endrass, B., Klimmt, C. Mehlmann, G., André, E. and Roth, C. (2011) Exploration of User Reactions to Different Dialog-based Interaction Style, Proceedings of the 4th International Conference on Interactive Digital Storytelling (ICIDS 2011)
* Gregor Mehlmann, Birgit Endrass, Elisabeth André, Modeling and Interpretation of Multithreaded and Multimodal Dialogue, Proceedings of the 13th International Conference on Multimodal Interaction (ICMI 2011), 2011.
* Mehlmann, G:, Endrass, B., André, E. (2011) Modeling and Interpretation of Multithreaded and Multimodal Dialogue, Proceedings of the 13th International Conference on Multimodal Interaction (ICMI 2011).
 
===Supporting Narrative Theories===
The tool was designed without any background of narrative theories.


===Computational Model===
===Computational Model===
* [[Virtual Beergarden]]: The graphical representation is done in the Virtual Beergarden application which holds the characters and the virtual scenario. <br>
The tool was designed without any background of narrative theories but uses [[Sceneflows]] as the main mean for dialogue and interaction modeling.
* [[SceneMaker]]: Dialog modeling and the flow of the scenario is done using the SceneMaker tool.  <br>
* [[SPIN]]: The user's typed text input is parsed into abstract dialog utterances using the semantic parser SPIN. <br>


=== Type of Interaction ===
=== Type of Interaction ===
Line 38: Line 27:
* Input modalities: typed-text
* Input modalities: typed-text
* Output modalities: text-to-speech & nonverbal behavior of virtual characters
* Output modalities: text-to-speech & nonverbal behavior of virtual characters
===Contact===
For further information please contact Birgit Endrass [http://www.informatik.uni-augsburg.de/lehrstuehle/hcm/staff/endrass/].

Latest revision as of 11:37, 12 January 2012

IRIS Wiki - IS Systems - SOAP

Availability

The SOAP scenario was developed as a research prototype. It is not available for download. Nevertheless, you can get most of the technical components used for implementing the system for download, such as the Virtual Beergarden [1] and SceneMaker [2].

Technical Description

In the soap-like story, the user can interact with a set of virtual characters. Through dialog interactions, the progress and outcome of the story can be influenced. For the realization of the SOAP scenario, several components were needed such as language understanding that parses the user's text input into abstract dialog utterances, a dialog model that controls the narrative flow of the story and a graphical representation holding the virtual characters as well as the user avatar. The Figure below shows the main components of the system architecture and their responsibilities.

System Architecture of SOAP.

Result Description

In the scenario, the characters are involved in a romantic conflict. The user, who is represented by an avatar can approach the different characters, listen to their conversations and interact with them. In that manner, the user can either approach a group of girls, a group of guys, or a waitress that is working in a virtual beer garden. In order to save resources, dialogs take place only if the user is near the characters, otherwise idle dialog behavior is presented. Through observation and interaction, the user will learn that there is a love story secretly going on. Dependent on the user's interactions, the characters will reveal their love, ask for help and follow the user's advice. Different scenario endings were modeled, while the user can make a match between two characters.

Authoring Description

The tools used for the authoring process are

  • SceneMaker: Dialog modeling and the flow of the scenario is done using the SceneMaker [3] tool which relies on Sceneflows as computational model.
  • SPIN: The user's typed text input is parsed into abstract dialog utterances using the semantic parser SPIN.

Main Publications

  • Endrass, B., Klimmt, C. Mehlmann, G., André, E. and Roth, C. (2011) Exploration of User Reactions to Different Dialog-based Interaction Style, Proceedings of the 4th International Conference on Interactive Digital Storytelling (ICIDS 2011)
  • Mehlmann, G:, Endrass, B., André, E. (2011) Modeling and Interpretation of Multithreaded and Multimodal Dialogue, Proceedings of the 13th International Conference on Multimodal Interaction (ICMI 2011).

Computational Model

The tool was designed without any background of narrative theories but uses Sceneflows as the main mean for dialogue and interaction modeling.

Type of Interaction

  • Interaction devices: keyboard, mouse
  • Input modalities: typed-text
  • Output modalities: text-to-speech & nonverbal behavior of virtual characters

Contact

For further information please contact Birgit Endrass [4].

Retrieved from "https://tecfalabs.unige.ch/mediawiki-narrative/index.php?title=SOAP&oldid=16099"