{"id":68,"date":"2017-01-29T19:12:40","date_gmt":"2017-01-29T19:12:40","guid":{"rendered":"https:\/\/projects-old.etc.cmu.edu\/campfire\/?p=68"},"modified":"2017-01-29T19:12:40","modified_gmt":"2017-01-29T19:12:40","slug":"weeks-1-2-117-128-project-campfire","status":"publish","type":"post","link":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/2017\/01\/29\/weeks-1-2-117-128-project-campfire\/","title":{"rendered":"Weeks 1&#038; 2: 1\/17-1\/28: Project Campfire!"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">In weeks 1 and 2, the project, formally known as \u201cBard,\u201d renamed itself Campfire, and jumped into building both a technological foundation for our planned interactions as well as exploration into audio focused interactions. \u00a0Roy and Phan focused on the technology development, and Seth worked with Sarabeth on jumping into design.<\/span><\/p>\n<figure id=\"attachment_71\" aria-describedby=\"caption-attachment-71\" style=\"width: 300px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-71 size-medium\" src=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0320-e1485716881393-300x225.jpg\" width=\"300\" height=\"225\" \/><figcaption id=\"caption-attachment-71\" class=\"wp-caption-text\">Roy and Phan brainstorm interaction foundation<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">On the <\/span><b>technology<\/b><span style=\"font-weight: 400;\"> side, Roy and Phan started by putting together a high-level architecture on how the AI would accept user input, and output a response. \u00a0This involves taking in an input, and finding keywords, and finding intent from it in an initial encoding phase. \u00a0A hidden phase would next take these values from an encoding phase, and generate answer keywords and intent from the story to pass on to a decoding phase. \u00a0The decoding phase would initiate a query-based response system and dynamically generated responses on a neural network, to test the effectiveness of both.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In addition, Roy tested out various machine learning libraries and APIs: Theano, TensorFlow, Keras and Chainer. \u00a0He and Phan decided to move ahead with TensorFlow + Keras. \u00a0Roy also spent time this week researching papers and learning more about the capabilities of RNNs and LSTMs, for developing language models, testing out a simple LSTM in generating text based on keyword inputs.<\/span><\/p>\n<figure id=\"attachment_69\" aria-describedby=\"caption-attachment-69\" style=\"width: 300px\" class=\"wp-caption alignright\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-69 size-medium\" src=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-300x225.jpg\" width=\"300\" height=\"225\" srcset=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-300x225.jpg 300w, https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-768x576.jpg 768w, https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-1024x768.jpg 1024w, https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-830x623.jpg 830w, https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-230x173.jpg 230w, https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-350x263.jpg 350w, https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/IMG_0318-e1485716854333-480x360.jpg 480w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><figcaption id=\"caption-attachment-69\" class=\"wp-caption-text\">Prototyping out necessary information for the first playtest<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">For the <\/span><b>design<\/b><span style=\"font-weight: 400;\"> side, Phan developed a \u201cWizard of Oz\u201d Alexa setup for Sarabeth and Seth to test initial designs, in order to quickly prototype interaction cases. \u00a0Seth and Sarabeth spent the first week investigating story types, examples and scenarios, e.g. short stories, poems, fables, news, politics and sports. \u00a0They settled on starting with a recap interaction of the Pittsburgh Steelers AFC Championship game against the New England Patriots, which tragically (for Steelers nation) ended in defeat. \u00a0Their strategy for week 2 involved creating a library of information to pull from during a test with a few football fans in the ETC building. \u00a0The goal of this first playtest was to see how open ended questions, option based questions, prompts, responses, suggestions, trivia and fail cases affect the flow of conversation. \u00a0Though we ultimately want to develop an experience using a linear story, we started with a sports topic to start identifying what common threads we see in audio interactions. \u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">With our first playtest (Thank you Cody (Pats fan), Mike (Bills fan) and Erika (not a fan)) we have several takeaways:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Users expect Alexa to know and readily provide stats or fact heavy questions <\/span>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">For this interaction, we need to have a way to lengthen the conversation past the transaction<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Surprising moments that play off Alexa\u2019s dry tone, or the contradiction of unexpected fact retrieval give the most rewarding moments of humor<\/span>\n<ul>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">\u201cTom Brady is the GOAT\u201d &#8211; Alexa retrieves a commentator&#8217;s opinion, and delivers with same tone as a \u201cfact\u201d<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Question about the Steeler\u2019s hotel fire alarm incident, Alexa responds with a quote from the perpetrator \u201cI got drunk and did something stupid.\u201d (not immediately clear at start of the sentence &#8211; surprise at the connection at the end<\/span><\/li>\n<li style=\"font-weight: 400;\">Below are some clips from our playtest:<\/li>\n<\/ul>\n<\/ul>\n<p><!--[if lt IE 9]><script>document.createElement('audio');<\/script><![endif]-->\n<audio class=\"wp-audio-shortcode\" id=\"audio-68-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/mpeg\" src=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/HesTheGoat.mp3?_=1\" \/><a href=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/HesTheGoat.mp3\">https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/HesTheGoat.mp3<\/a><\/audio><br \/>\n<audio class=\"wp-audio-shortcode\" id=\"audio-68-2\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/mpeg\" src=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/WhatTheGuySaid.mp3?_=2\" \/><a href=\"https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/WhatTheGuySaid.mp3\">https:\/\/projects-old.etc.cmu.edu\/campfire\/wp-content\/uploads\/2017\/01\/WhatTheGuySaid.mp3<\/a><\/audio><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Canned jokes are not as effective as above examples because they are not based on <\/span><b><b>humor from the interaction itself<\/b><\/b><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Silences are awkward, esp in a group, maybe not a problem solo<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Clips are too long, need to be shorter (max 15-20 sec)<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Context of the setup creates a certain mood<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Connection based on a \u201cshared understanding\u201d &#8211; what \u201cbaggage\u201d does the user bring to the interaction, and how might this affect the experience?<\/span>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">E.G. Venting session vs Celebration of the game<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Found that questions like \u201cwho were you rooting for\u201d allowed Alexa the opportunity to join a side- creates a connection to the user, and allows for more curated conversation<\/span>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">This goes into \u201cbranching\u201d territory<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">After going through our notes from the playtest, Phan noted that we should focus on how to reduce the complexity and vastness of answer, by creating an environment where Alexa may teach the guest how to better interact with her, integrated into the main experince. \u00a0From here, we would expand the experience (because our goal is to have the interaction with users be as natural as possible).<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">For our purposes begin by teaching computer-friendly keywords to identify tasks and simplify \/ specify interactions.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Once we understand the process, begin nuancing the language to be more human-friendly.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">In addition to the playtest, Seth spent time investigating other story-based Alexa \u201cskills\u201d currently available (Ear Play, Wayne Investigations, The Magic Door). \u00a0He also started researching what kinds of audio we might integrate, in particular thinking about the kind of delay that will exist between the guest and Alexa interaction &#8211; what audio can gracefully fill this space?<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For project production needs, Campfire began developing branding concepts for next week\u2019s branding walkarounds, as well as team processes (core hours, Scrum, stretch goals). \u00a0Sarabeth attended the Playtesting for Explore workshop earlier this past week, and shared with her team the new project requirements for 1\/4s, which included brainstorming techniques, composition box, and strategies for initial testing. \u00a0Campfire worked to fill out our project Metrics Matrix, keeping in mind our project goals of design discovery as well as technical prototyping. \u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Looking ahead this week, the team plans to define our next prototyping goals (both design and technical) as well as complete our branding materials.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In weeks 1 and 2, the project, formally known as \u201cBard,\u201d renamed itself Campfire, and jumped into building both a technological foundation [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-68","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/posts\/68"}],"collection":[{"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/comments?post=68"}],"version-history":[{"count":1,"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/posts\/68\/revisions"}],"predecessor-version":[{"id":74,"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/posts\/68\/revisions\/74"}],"wp:attachment":[{"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/media?parent=68"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/categories?post=68"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/projects-old.etc.cmu.edu\/campfire\/index.php\/wp-json\/wp\/v2\/tags?post=68"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}