{"id":863,"date":"2022-03-06T18:15:43","date_gmt":"2022-03-06T18:15:43","guid":{"rendered":"https:\/\/ethicsandvideogames.com\/?p=863"},"modified":"2022-10-21T16:06:52","modified_gmt":"2022-10-21T16:06:52","slug":"episode-40-the-ethics-of-video-games-research-with-ashley-guajarado-and-ann-johnson","status":"publish","type":"post","link":"https:\/\/ethicsandvideogames.com\/?p=863","title":{"rendered":"Episode 40 &#8211; The Ethics of Video Games Research (with Ashley Guajarado and Ann Johnson)"},"content":{"rendered":"\n<p>[Release Date: April 12, 2022]\u00a0There\u2019s lots of research going on about video games.\u00a0 Some of it involves product testing like VR games or the effectiveness of interfaces.\u00a0 Some of it looks at the impact of gaming on players for things like violence, sexism, and addiction.\u00a0 What ethical concerns come into play when doing research like this on live human beings like you and I?<\/p>\n\n\n\n<iframe loading=\"lazy\" style=\"border-radius:12px\" src=\"https:\/\/open.spotify.com\/embed\/episode\/4d3yUTcYyaO9vBMd7dyHfJ?utm_source=generator&#038;theme=0\" width=\"100%\" height=\"232\" frameBorder=\"0\" allowfullscreen=\"\" allow=\"autoplay; clipboard-write; encrypted-media; fullscreen; picture-in-picture\"><\/iframe>\n\n\n\n<p class=\"has-text-align-center\"><strong>SHOW TRANSCRIPT<\/strong><\/p>\n\n\n\n<p><br>00:11:37.620 &#8211;&gt; 00:11:48.390<br>Shlomo Sher: Today this is our first episode, with two guests, our first four person episodes we&#8217;re going to talk about essentially the ethics of video game research, a topic.<\/p>\n\n\n\n<p>126<br>00:11:49.050 &#8211;&gt; 00:12:07.290<br>Shlomo Sher: That is incredibly interesting and one that we&#8217;ve never remotely touched on, and I think that most people know very, very little about this is one of those things that I think kind of a takes place behind the scenes, as far as most of us who play video games are concerned.<\/p>\n\n\n\n<p>127<br>00:12:08.610 &#8211;&gt; 00:12:09.060<br>Shlomo Sher: So.<\/p>\n\n\n\n<p>128<br>00:12:10.200 &#8211;&gt; 00:12:11.520<br>Shlomo Sher: Ashley can call you Ashley.<\/p>\n\n\n\n<p>129<br>00:12:11.820 &#8211;&gt; 00:12:12.840<br>Professor_Ashley: Is that&#8217;s perfect.<\/p>\n\n\n\n<p>130<br>00:12:13.110 &#8211;&gt; 00:12:29.040<br>Shlomo Sher: Great so Ashley is an associate Professor well let&#8217;s do our official introductions so Ashley gallardo is associate professor of entertainment arts and engineering at the University of utah we love the University of utah, can you tell how many guess what we had for the.<\/p>\n\n\n\n<p>131<br>00:12:29.040 &#8211;&gt; 00:12:33.000<br>Shlomo Sher: University of utah you guys are awesome you do such cool things.<\/p>\n\n\n\n<p>132<br>00:12:33.120 &#8211;&gt; 00:12:34.020<br>Professor_Ashley: For people.<\/p>\n\n\n\n<p>133<br>00:12:34.440 &#8211;&gt; 00:12:35.670<br>Shlomo Sher: and your party people.<\/p>\n\n\n\n<p>134<br>00:12:37.020 &#8211;&gt; 00:12:46.680<br>Shlomo Sher: where she teaches game design and game user research when she isn&#8217;t researching twitch streamers or twitch streaming herself she serves on the institutional review board.<\/p>\n\n\n\n<p>135<br>00:12:47.160 &#8211;&gt; 00:12:57.660<br>Shlomo Sher: Which is what we&#8217;re here for and his curse currently co directing the hashtag games, you are summit 2020 the largest conference for games users researchers.<\/p>\n\n\n\n<p>136<br>00:12:59.070 &#8211;&gt; 00:13:00.660<br>Shlomo Sher: And and.<\/p>\n\n\n\n<p>137<br>00:13:02.100 &#8211;&gt; 00:13:09.840<br>Shlomo Sher: When people ask me what her dream job would be your answer is always the same, making one of a kind clothes and she&#8217;s here to do that for you.<\/p>\n\n\n\n<p>138<br>00:13:11.730 &#8211;&gt; 00:13:20.130<br>Shlomo Sher: Maybe not but she loves the creativity and artistry that pours out of her when designing and sewing clothes and yet she&#8217;s a scientist at heart, and by profession.<\/p>\n\n\n\n<p>139<br>00:13:20.670 &#8211;&gt; 00:13:29.910<br>Shlomo Sher: She has degrees in biology chemistry by biology chemistry and public health wow I gotta say i&#8217;m you know I i&#8217;m pretty impressed by that.<\/p>\n\n\n\n<p>140<br>00:13:30.870 &#8211;&gt; 00:13:31.170<br>me too.<\/p>\n\n\n\n<p>141<br>00:13:32.220 &#8211;&gt; 00:13:49.740<br>Shlomo Sher: and her career is making sure people who volunteered to be in research studies are a safe and as respected as possible she&#8217;s a director of the University of utah&#8217;s IRB and you&#8217;ve been research protection program wow you guys sound amazing Ashley and and welcome to the show yeah.<\/p>\n\n\n\n<p>142<br>00:13:52.830 &#8211;&gt; 00:14:06.900<br>Shlomo Sher: Okay, so we are here to talk about IRB boards and IRB is institutional review board but that still means absolutely nothing to the majority of our listeners so let&#8217;s just start with this what is an IRB board.<\/p>\n\n\n\n<p>143<br>00:14:10.230 &#8211;&gt; 00:14:11.850<br>Professor_Ashley: That sounds like a great question for him.<\/p>\n\n\n\n<p>144<br>00:14:13.170 &#8211;&gt; 00:14:13.590<br>and go.<\/p>\n\n\n\n<p>145<br>00:14:15.150 &#8211;&gt; 00:14:18.450<br>Shlomo Sher: By the way, guys so remember, we can always edit everything it&#8217;s.<\/p>\n\n\n\n<p>146<br>00:14:18.450 &#8211;&gt; 00:14:19.710<br>Shlomo Sher: so easy to do that stuff.<\/p>\n\n\n\n<p>147<br>00:14:19.920 &#8211;&gt; 00:14:20.850<br>Professor_Ashley: and make us sound smart.<\/p>\n\n\n\n<p>148<br>00:14:22.500 &#8211;&gt; 00:14:22.950<br>A Ashcraft: wow.<\/p>\n\n\n\n<p>149<br>00:14:23.910 &#8211;&gt; 00:14:35.070<br>Ann Johnson: That the soft answer for what an institutional review board is is we&#8217;re an ethics committee and we review research for ethical thinks so and it&#8217;s not just.<\/p>\n\n\n\n<p>150<br>00:14:35.520 &#8211;&gt; 00:14:44.490<br>Ann Johnson: Any research it&#8217;s actually only the research that&#8217;s done on people on living human beings so clearly there&#8217;s a lot of research out there in the world that&#8217;s done on a lot of different things.<\/p>\n\n\n\n<p>151<br>00:14:44.760 &#8211;&gt; 00:15:00.930<br>Ann Johnson: With the IRB cares about is the stuff that&#8217;s done on people, and so we look at the ethical constructs the ethical practices of research and we make sure that the research is as safe and as fair as possible when people participate.<\/p>\n\n\n\n<p>152<br>00:15:02.010 &#8211;&gt; 00:15:03.780<br>Shlomo Sher: Fair sounds interesting.<\/p>\n\n\n\n<p>153<br>00:15:04.920 &#8211;&gt; 00:15:14.760<br>A Ashcraft: I I frequently asked my students, when I have when I have brand new students, I asked them to write me a short essay about what fair means and it&#8217;s and of course it&#8217;s always different.<\/p>\n\n\n\n<p>154<br>00:15:16.560 &#8211;&gt; 00:15:21.270<br>A Ashcraft: yeah you know, nobody can quite define everybody knows what farias but nobody can define it.<\/p>\n\n\n\n<p>155<br>00:15:23.880 &#8211;&gt; 00:15:28.020<br>A Ashcraft: In the in the in the context of this, and these IRB.<\/p>\n\n\n\n<p>156<br>00:15:30.090 &#8211;&gt; 00:15:31.590<br>A Ashcraft: What is fair.<\/p>\n\n\n\n<p>157<br>00:15:33.330 &#8211;&gt; 00:15:38.550<br>Ann Johnson: that&#8217;s a really great question and, just as you said, the concept of fair is always changing.<\/p>\n\n\n\n<p>158<br>00:15:39.210 &#8211;&gt; 00:15:52.140<br>Ann Johnson: And we&#8217;re all different people and things I think are fair things you might think are unfair so we&#8217;re living in the subjective reality, but in research, we really think about fair in terms of who is.<\/p>\n\n\n\n<p>159<br>00:15:53.250 &#8211;&gt; 00:15:59.880<br>Ann Johnson: Who is bearing the burden of the research and then, who is getting the benefit of the research so just, for example.<\/p>\n\n\n\n<p>160<br>00:16:00.300 &#8211;&gt; 00:16:11.460<br>Ann Johnson: In history we&#8217;ve done a lot of terrible things to people in the name of research and they bore the burden of that research, so the rest of us could benefit that&#8217;s not really fair and so.<\/p>\n\n\n\n<p>161<br>00:16:12.240 &#8211;&gt; 00:16:20.970<br>Ann Johnson: We are always trying as an IRB to make sure that the people who are bearing the weight of the research that are being tested on that are contributing of themselves.<\/p>\n\n\n\n<p>162<br>00:16:21.510 &#8211;&gt; 00:16:31.050<br>Ann Johnson: are also potentially the people that are going to benefit and that we&#8217;re not targeting people unfairly to be in research, but that we&#8217;re also not excluding people unfairly.<\/p>\n\n\n\n<p>163<br>00:16:31.380 &#8211;&gt; 00:16:37.530<br>Ann Johnson: When it comes to being a researcher, and that is a balance, and that is hard to find, but that is the goal and that&#8217;s the ideal.<\/p>\n\n\n\n<p>164<br>00:16:38.160 &#8211;&gt; 00:16:44.070<br>Shlomo Sher: Can Can you give us an example, this so let&#8217;s say Okay, I want to do a research project involving video games.<\/p>\n\n\n\n<p>165<br>00:16:45.300 &#8211;&gt; 00:16:50.670<br>A Ashcraft: i&#8217;m Sorry, I have one moment please, I have had some technical difficulties hang on just a second i&#8217;ll be right back.<\/p>\n\n\n\n<p>166<br>00:16:53.250 &#8211;&gt; 00:16:55.440<br>Shlomo Sher: Andy what we&#8217;re going to pause right.<\/p>\n\n\n\n<p>167<br>00:17:00.960 &#8211;&gt; 00:17:03.150<br>Shlomo Sher: we&#8217;ll come back to this in a moment.<\/p>\n\n\n\n<p>168<br>00:17:06.870 &#8211;&gt; 00:17:11.910<br>Shlomo Sher: And Andy let me know if you were starting something do need to be rethink.<\/p>\n\n\n\n<p>169<br>00:17:15.240 &#8211;&gt; 00:17:18.270<br>Shlomo Sher: Actually, by the way, I listened to the podcast for working out to.<\/p>\n\n\n\n<p>170<br>00:17:20.250 &#8211;&gt; 00:17:29.340<br>Shlomo Sher: it&#8217;s usually like I got I got I go on a bike ride and that&#8217;s where I test, listen to the podcast and I have to stop and record notes on.<\/p>\n\n\n\n<p>171<br>00:17:29.490 &#8211;&gt; 00:17:30.150<br>My phone.<\/p>\n\n\n\n<p>172<br>00:17:31.740 &#8211;&gt; 00:17:32.850<br>Shlomo Sher: As as I do it.<\/p>\n\n\n\n<p>173<br>00:17:33.300 &#8211;&gt; 00:17:39.510<br>A Ashcraft: i&#8217;m so sorry I realized that while I have my headphones on the sound was actually coming out of my computer.<\/p>\n\n\n\n<p>174<br>00:17:41.040 &#8211;&gt; 00:17:52.620<br>A Ashcraft: And so I fixed that now, but the we might want to start over just for that that first question, because otherwise we&#8217;re going to hear your voices through my microphone.<\/p>\n\n\n\n<p>175<br>00:17:53.460 &#8211;&gt; 00:17:54.420<br>Shlomo Sher: Is that OK and.<\/p>\n\n\n\n<p>176<br>00:17:54.570 &#8211;&gt; 00:17:55.890<br>Ann Johnson: You absolutely.<\/p>\n\n\n\n<p>177<br>00:17:56.100 &#8211;&gt; 00:17:56.760<br>Ann Johnson: i&#8217;m so sorry.<\/p>\n\n\n\n<p>178<br>00:17:58.500 &#8211;&gt; 00:17:59.370<br>A Ashcraft: My apologies.<\/p>\n\n\n\n<p>179<br>00:18:00.570 &#8211;&gt; 00:18:01.830<br>Professor_Ashley: for stopping the recording.<\/p>\n\n\n\n<p>180<br>00:18:02.550 &#8211;&gt; 00:18:04.080<br>Shlomo Sher: No, no, no, no continue.<\/p>\n\n\n\n<p>181<br>00:18:04.440 &#8211;&gt; 00:18:05.100<br>Professor_Ashley: I was keep going.<\/p>\n\n\n\n<p>182<br>00:18:05.580 &#8211;&gt; 00:18:06.990<br>A Ashcraft: we&#8217;re just going to ask the question again.<\/p>\n\n\n\n<p>183<br>00:18:07.170 &#8211;&gt; 00:18:08.190<br>Professor_Ashley: Oh yeah perfect.<\/p>\n\n\n\n<p>184<br>00:18:08.610 &#8211;&gt; 00:18:12.060<br>Shlomo Sher: cool okay so i&#8217;m just going back to the question when in fact i&#8217;ll do the whole question what.<\/p>\n\n\n\n<p>185<br>00:18:13.470 &#8211;&gt; 00:18:22.110<br>Shlomo Sher: Okay, so okay so uh and let&#8217;s start with you, what is an IRB board right, so I want to do a research project involving video games.<\/p>\n\n\n\n<p>186<br>00:18:23.370 &#8211;&gt; 00:18:25.770<br>Shlomo Sher: What does that have to do with you how do I encounter you.<\/p>\n\n\n\n<p>187<br>00:18:26.850 &#8211;&gt; 00:18:32.280<br>Ann Johnson: yeah so an IRB institutional review board the easy way of saying that is we&#8217;re an ethics committee.<\/p>\n\n\n\n<p>188<br>00:18:32.790 &#8211;&gt; 00:18:44.430<br>Ann Johnson: And we&#8217;re an ethics committee that looks at the ethics of research and we don&#8217;t look at the ethics of any just any research it&#8217;s only the research that&#8217;s done on human beings so living human beings.<\/p>\n\n\n\n<p>189<br>00:18:44.730 &#8211;&gt; 00:19:04.170<br>Ann Johnson: So there&#8217;s clearly a lot of research out there that could be done on a lot of different things, but we are looking at it in the context of humans, and so we are trying our best as a group of people to decide if research is keeping people safe but it&#8217;s also being done fairly.<\/p>\n\n\n\n<p>190<br>00:19:05.820 &#8211;&gt; 00:19:13.650<br>Shlomo Sher: And okay So what does that mean, and so i&#8217;m doing a research projects and video games, what kind of things don&#8217;t need to worry about.<\/p>\n\n\n\n<p>191<br>00:19:13.860 &#8211;&gt; 00:19:22.680<br>Shlomo Sher: let&#8217;s let&#8217;s talk about safety first and then let&#8217;s talk about fairness and i&#8217;m sure me i&#8217;m assuming fairness is going to be a lot more complicated and safety, but what do I know i&#8217;ve never actually.<\/p>\n\n\n\n<p>192<br>00:19:22.710 &#8211;&gt; 00:19:24.150<br>Shlomo Sher: had anything goes to IRB.<\/p>\n\n\n\n<p>193<br>00:19:25.530 &#8211;&gt; 00:19:27.300<br>Professor_Ashley: So i&#8217;m i&#8217;m sorry, no.<\/p>\n\n\n\n<p>194<br>00:19:28.290 &#8211;&gt; 00:19:29.820<br>Ann Johnson: No go ahead, actually you started.<\/p>\n\n\n\n<p>195<br>00:19:30.270 &#8211;&gt; 00:19:31.410<br>Professor_Ashley: I was going to give.<\/p>\n\n\n\n<p>196<br>00:19:32.880 &#8211;&gt; 00:19:35.700<br>Professor_Ashley: The insight from someone who studies games.<\/p>\n\n\n\n<p>197<br>00:19:37.050 &#8211;&gt; 00:19:49.950<br>Professor_Ashley: Specifically, first, and then we can dive into the more official IRB answer so when, in terms of safety, we have safety designations at the institutional review board that.<\/p>\n\n\n\n<p>198<br>00:19:51.210 &#8211;&gt; 00:20:00.150<br>Professor_Ashley: determine whether or not the study is minimal risk or greater than minimal risk for the most part, video game studies tend to be minimal risk, meaning that we&#8217;re not like.<\/p>\n\n\n\n<p>199<br>00:20:00.630 &#8211;&gt; 00:20:06.120<br>Professor_Ashley: poking people with needles we&#8217;re not like injecting them with stuff to see what happens.<\/p>\n\n\n\n<p>200<br>00:20:06.810 &#8211;&gt; 00:20:15.510<br>Professor_Ashley: we&#8217;re not necessarily exposing them to things that they would encounter outside of their daily life, most of the time when we are researching games, we are.<\/p>\n\n\n\n<p>201<br>00:20:15.960 &#8211;&gt; 00:20:23.460<br>Professor_Ashley: researching groups of people that would already play games not always but most the time, so this is nothing outside of their ordinary day.<\/p>\n\n\n\n<p>202<br>00:20:24.330 &#8211;&gt; 00:20:30.360<br>Professor_Ashley: So in that case we were classified as minimal risk, but it is still human subjects research with some exceptions.<\/p>\n\n\n\n<p>203<br>00:20:30.780 &#8211;&gt; 00:20:40.740<br>Professor_Ashley: If we&#8217;re doing like what my games user research lab does we&#8217;re actually doing product research and so that doesn&#8217;t meet the federal guidelines for human subjects research and quite the same way.<\/p>\n\n\n\n<p>204<br>00:20:41.220 &#8211;&gt; 00:20:51.540<br>Professor_Ashley: we&#8217;re not studying to make generalizable data about a population, we are studying just a product and the product and development and we&#8217;re trying to make that product better.<\/p>\n\n\n\n<p>205<br>00:20:51.990 &#8211;&gt; 00:20:57.690<br>Professor_Ashley: So it kind of it&#8217;s similar to like student emails right Sunni value of your classes are a type of research but.<\/p>\n\n\n\n<p>206<br>00:20:58.290 &#8211;&gt; 00:21:12.570<br>Professor_Ashley: you&#8217;re not going to go and write research papers based off that data you&#8217;re going to use it to improve your pedagogy and your teaching, so in that case we&#8217;re video games are pretty minimal risk, but if you&#8217;re asking people questions you definitely need to seek IRB approval.<\/p>\n\n\n\n<p>207<br>00:21:13.650 &#8211;&gt; 00:21:22.500<br>Professor_Ashley: outside of product development because we want to make sure that you&#8217;re not causing harm, so in this case, if your video game happened to have.<\/p>\n\n\n\n<p>208<br>00:21:22.980 &#8211;&gt; 00:21:34.260<br>Professor_Ashley: A component which might bring up emotional feelings that would not necessarily be encountered in daily life or adults with topics that folks might find disturbing.<\/p>\n\n\n\n<p>209<br>00:21:34.590 &#8211;&gt; 00:21:43.680<br>Professor_Ashley: Then at the minimum we would want you to tell people so that they can make an informed choice and consent to that research, rather than just kind of springing out on them.<\/p>\n\n\n\n<p>210<br>00:21:44.550 &#8211;&gt; 00:21:56.910<br>Professor_Ashley: covertly, but of course covered research can happen, and it can happen ethically but we there their safety protocols in place to ensure that people are not harmed as a process to gather data.<\/p>\n\n\n\n<p>211<br>00:21:57.360 &#8211;&gt; 00:22:01.020<br>A Ashcraft: So both physically and or and or emotionally harmed.<\/p>\n\n\n\n<p>212<br>00:22:01.410 &#8211;&gt; 00:22:15.300<br>Professor_Ashley: yeah so physically we don&#8217;t I mean with most games Asterix course exceptions we&#8217;re not doing a whole lot of physical research, of course, the exception being virtual reality and then there&#8217;s physical concerns about.<\/p>\n\n\n\n<p>213<br>00:22:16.560 &#8211;&gt; 00:22:31.380<br>Professor_Ashley: running into things losing balance falling over, especially when we get into vr studies and physiology not not looking at, can we make a really cool vr game, but can we use vr for phantom limb pain right can we use vr to truth.<\/p>\n\n\n\n<p>214<br>00:22:32.640 &#8211;&gt; 00:22:42.000<br>Professor_Ashley: In place of an analgesic or an anesthetic can we use vr to manage pain right that&#8217;s a question that if you do a quick library search it comes up in a lot of medical journals.<\/p>\n\n\n\n<p>215<br>00:22:42.390 &#8211;&gt; 00:22:49.320<br>Professor_Ashley: and pain management journals and it&#8217;s a really interesting question, but you know what kind of physical concerns do we have with with vr.<\/p>\n\n\n\n<p>216<br>00:22:50.700 &#8211;&gt; 00:22:54.600<br>Professor_Ashley: And if you if you read the headset I didn&#8217;t i&#8217;m not gonna lie.<\/p>\n\n\n\n<p>217<br>00:22:55.650 &#8211;&gt; 00:23:05.640<br>Professor_Ashley: We have an htc vr kit here, I think we have htc index my house and I never read the safety warning because you know i&#8217;m going to.<\/p>\n\n\n\n<p>218<br>00:23:07.500 &#8211;&gt; 00:23:18.210<br>Professor_Ashley: Like I that&#8217;s when you should read the safety board exam so I sat down to read them because I actually prepare the presentation for this for the IRB and there are things that I never considered.<\/p>\n\n\n\n<p>219<br>00:23:19.350 &#8211;&gt; 00:23:34.710<br>Professor_Ashley: So in addition to the balance stuff which, like or hitting a ceiling fan right those those things I considered but vr has been correlated I don&#8217;t know that we&#8217;ve established a causation relationship with it, but with myopia so nearsightedness, particularly in.<\/p>\n\n\n\n<p>220<br>00:23:34.710 &#8211;&gt; 00:23:54.120<br>Professor_Ashley: kids having a screen so close to their eyes, with light is showing developmental problems with with eyesight and of course motion sickness I anticipated, but I didn&#8217;t know this so because the headset rests on your sinuses it can actually exacerbate cold and flu and sinus something of.<\/p>\n\n\n\n<p>221<br>00:23:54.510 &#8211;&gt; 00:23:55.530<br>Professor_Ashley: Interest, so if you&#8217;re.<\/p>\n\n\n\n<p>222<br>00:23:55.740 &#8211;&gt; 00:24:02.670<br>Professor_Ashley: If you&#8217;re getting sick and you use vr you can feel more sick or it can it doesn&#8217;t give you a cold right so for a while people are thinking.<\/p>\n\n\n\n<p>223<br>00:24:03.060 &#8211;&gt; 00:24:14.460<br>Professor_Ashley: Oh it&#8217;s because we&#8217;re sharing headsets we&#8217;re all getting sick, but actually what we think is actually happening is that it&#8217;s just putting pressure on your sinuses so it&#8217;s making your nose run more and so they&#8217;re like some minor safety concerns like that.<\/p>\n\n\n\n<p>224<br>00:24:15.450 &#8211;&gt; 00:24:21.330<br>Shlomo Sher: So, is that the sort of thing that if you know if i&#8217;m doing research on you know, on vr and i&#8217;m you know.<\/p>\n\n\n\n<p>225<br>00:24:21.840 &#8211;&gt; 00:24:30.120<br>Shlomo Sher: On a vr game and i&#8217;m going to have them wear a headset I should let them know ahead of time, if you have a cold, this is going to potentially aggravate your systems and.<\/p>\n\n\n\n<p>226<br>00:24:30.540 &#8211;&gt; 00:24:40.230<br>Shlomo Sher: Do I need to let them know that long term use of the our devices have been shown to increase myopia and kids is that the idea something like that.<\/p>\n\n\n\n<p>227<br>00:24:40.530 &#8211;&gt; 00:24:51.210<br>Professor_Ashley: yeah so that becomes a really interesting question and, in the past i&#8217;ve i&#8217;ve defaulted to advising the researchers to read, but it varies by headset right but, for example.<\/p>\n\n\n\n<p>228<br>00:24:51.810 &#8211;&gt; 00:24:59.790<br>Professor_Ashley: I want to say the oculus says no one under the age of eight should be using the headset and that&#8217;s because of these studies on ocular development.<\/p>\n\n\n\n<p>229<br>00:25:00.960 &#8211;&gt; 00:25:02.040<br>Professor_Ashley: Ironically oculus.<\/p>\n\n\n\n<p>230<br>00:25:02.130 &#8211;&gt; 00:25:03.960<br>Shlomo Sher: Can I just say Ashley that uh.<\/p>\n\n\n\n<p>231<br>00:25:04.050 &#8211;&gt; 00:25:08.430<br>Shlomo Sher: i&#8217;ve been looking for an excuse to not let my son use my oculus and.<\/p>\n\n\n\n<p>232<br>00:25:08.970 &#8211;&gt; 00:25:12.960<br>Professor_Ashley: that&#8217;s the worst part right because you have this shiny piece of tech that kids want and you&#8217;re like.<\/p>\n\n\n\n<p>233<br>00:25:13.020 &#8211;&gt; 00:25:14.580<br>Professor_Ashley: No your eyesight.<\/p>\n\n\n\n<p>234<br>00:25:15.150 &#8211;&gt; 00:25:25.470<br>Shlomo Sher: Right, yes, well you know now got my excuse that I needed, which is, which is great there&#8217;s plenty of other games, he can play that are fantastic for him, he doesn&#8217;t need us by vr headset.<\/p>\n\n\n\n<p>235<br>00:25:27.270 &#8211;&gt; 00:25:40.800<br>Professor_Ashley: So the advisory I give to research teams is to adopt the language that&#8217;s used in the headset devices themselves so if the company is saying hey look we don&#8217;t think that people of this age should be using this product, then.<\/p>\n\n\n\n<p>236<br>00:25:41.040 &#8211;&gt; 00:25:45.270<br>Professor_Ashley: You have to take that into consideration when when conducting research with that product.<\/p>\n\n\n\n<p>237<br>00:25:45.990 &#8211;&gt; 00:25:47.190<br>A Ashcraft: yeah that makes perfect sense.<\/p>\n\n\n\n<p>238<br>00:25:48.000 &#8211;&gt; 00:25:53.340<br>Shlomo Sher: So to go back to the other sort of content warning right so let&#8217;s say.<\/p>\n\n\n\n<p>239<br>00:25:54.360 &#8211;&gt; 00:26:00.420<br>Shlomo Sher: i&#8217;m I want to measure reactions to games like ethnic cleansing right.<\/p>\n\n\n\n<p>240<br>00:26:02.670 &#8211;&gt; 00:26:12.630<br>Shlomo Sher: You know, do I need to let so at the cleansing we&#8217;ve talked about before this game right essentially it&#8217;s a racist game it if if it doesn&#8217;t sound like a racist game I don&#8217;t know what those.<\/p>\n\n\n\n<p>241<br>00:26:13.740 &#8211;&gt; 00:26:15.060<br>Shlomo Sher: Right and it&#8217;s part of.<\/p>\n\n\n\n<p>242<br>00:26:15.390 &#8211;&gt; 00:26:16.830<br>A Ashcraft: The title of a game by the lesson.<\/p>\n\n\n\n<p>243<br>00:26:16.830 &#8211;&gt; 00:26:17.250<br>Shlomo Sher: Title a.<\/p>\n\n\n\n<p>244<br>00:26:17.790 &#8211;&gt; 00:26:19.470<br>A Ashcraft: cleansing is the title of again.<\/p>\n\n\n\n<p>245<br>00:26:20.010 &#8211;&gt; 00:26:20.880<br>Shlomo Sher: Right right.<\/p>\n\n\n\n<p>246<br>00:26:21.900 &#8211;&gt; 00:26:36.810<br>Shlomo Sher: Right do I have to inform my my studies subjects ahead of time that you are playing a game that will have racist elements do I need to give up the title, how much do I need to protect them kind of against this.<\/p>\n\n\n\n<p>247<br>00:26:38.490 &#8211;&gt; 00:26:42.330<br>Ann Johnson: I think that&#8217;s a really good question when we look at.<\/p>\n\n\n\n<p>248<br>00:26:43.080 &#8211;&gt; 00:26:56.820<br>Ann Johnson: You know harm we&#8217;ve just talked about, like all these physical harm to people but there&#8217;s also like that whole vast array of like psychological harm social harm harm within you know relationships and maybe legal harm.<\/p>\n\n\n\n<p>249<br>00:26:57.450 &#8211;&gt; 00:27:09.300<br>Ann Johnson: That could come to you, depending on you know certain things that you do in life and potentially in research and so when we look at harm that could come to research subjects we&#8217;ve got to take all of that into account.<\/p>\n\n\n\n<p>250<br>00:27:10.470 &#8211;&gt; 00:27:21.150<br>Ann Johnson: And I think we could all agree that there&#8217;s a difference in the new harm that&#8217;s introduced in a research, study from someone who&#8217;s never played let&#8217;s say this race this game before.<\/p>\n\n\n\n<p>251<br>00:27:21.570 &#8211;&gt; 00:27:34.830<br>Ann Johnson: versus someone who&#8217;s been playing it prior to ever being in a research, study so that&#8217;s something for us to think about too is should we expose new people to playing this race escape it, or should we maybe recruit.<\/p>\n\n\n\n<p>252<br>00:27:36.300 &#8211;&gt; 00:27:41.580<br>Ann Johnson: Even playing it they&#8217;re already doing that harm to themselves whether they perceive it as harm or not.<\/p>\n\n\n\n<p>253<br>00:27:42.930 &#8211;&gt; 00:27:51.750<br>Ann Johnson: And so, picking the right population that is going to receive less harm from our research is something that we would want to consider as well.<\/p>\n\n\n\n<p>254<br>00:27:52.110 &#8211;&gt; 00:28:05.160<br>Ann Johnson: But then, just as you said, we would want to be able to talk about any harms that are going to come from being in our study with the person before they say yes or no to doing whatever we&#8217;re asking them to do.<\/p>\n\n\n\n<p>255<br>00:28:05.970 &#8211;&gt; 00:28:15.150<br>Shlomo Sher: You know, it strikes me that in play in having my studies subjects a play a game like this i&#8217;m kind of looking to see if it harms them.<\/p>\n\n\n\n<p>256<br>00:28:15.840 &#8211;&gt; 00:28:30.450<br>Shlomo Sher: Is you know and i&#8217;m assuming lots of studies, I mean that&#8217;s kind of the point of the study to see if the product or the subject matter or something harms my subjects, but your job is to make sure I don&#8217;t harm my subjects, how does How does that work.<\/p>\n\n\n\n<p>257<br>00:28:31.800 &#8211;&gt; 00:28:40.560<br>Ann Johnson: I think that that is also really fundamental is an understanding what IRB do is we can&#8217;t always get rid of all the harm.<\/p>\n\n\n\n<p>258<br>00:28:40.950 &#8211;&gt; 00:28:56.370<br>Ann Johnson: Of a research, study right some studies are just risky so if we took the example of, say, a new medical drugs that was going to treat some new condition that those doctors are also trying to see if this new drug harms you because it might.<\/p>\n\n\n\n<p>259<br>00:28:57.450 &#8211;&gt; 00:29:06.060<br>Ann Johnson: But they&#8217;re also trying to see if it benefits, you and I think that is the other key component, that we can apply over to video game research as well.<\/p>\n\n\n\n<p>260<br>00:29:06.390 &#8211;&gt; 00:29:16.050<br>Ann Johnson: Yes, it is important to understand a certain video games, or certain contexts that we play within are harming people but what&#8217;s the benefit.<\/p>\n\n\n\n<p>261<br>00:29:16.680 &#8211;&gt; 00:29:21.870<br>Ann Johnson: Is there is there some benefit you&#8217;re trying to get out of the research like are you trying to show that.<\/p>\n\n\n\n<p>262<br>00:29:22.380 &#8211;&gt; 00:29:35.940<br>Ann Johnson: This harm is bad, that we should limit harm in society, you know that&#8217;s a benefit to society potentially right right, but if we&#8217;re just trying to see if things harm people just for the sake of seeing if they harm people perhaps that&#8217;s.<\/p>\n\n\n\n<p>263<br>00:29:36.030 &#8211;&gt; 00:29:45.390<br>Ann Johnson: Not ethical right so it&#8217;s that risk benefit balance that we&#8217;re trying to assess and it&#8217;s not just to me as a person, but it&#8217;s just two people around me.<\/p>\n\n\n\n<p>264<br>00:29:45.810 &#8211;&gt; 00:29:53.910<br>Ann Johnson: Not just the benefits to me as a person, but also the benefits to society around me so we&#8217;ve got away all of that which can get really complicated.<\/p>\n\n\n\n<p>265<br>00:29:54.990 &#8211;&gt; 00:29:56.430<br>Ann Johnson: But we&#8217;ve got a considerable sites.<\/p>\n\n\n\n<p>266<br>00:29:56.820 &#8211;&gt; 00:30:10.920<br>Shlomo Sher: Do you have any kind of systematic ways of weighing that I mean you know it seems like a really tough challenge to to figure it stuff like this out, and you can again feel free to use the the racist gain example I just gave you is.<\/p>\n\n\n\n<p>267<br>00:30:11.490 &#8211;&gt; 00:30:17.610<br>Shlomo Sher: What would you do with that I have no idea what I would do with that you know, but then again i&#8217;m not you know i&#8217;m not in your position.<\/p>\n\n\n\n<p>268<br>00:30:19.980 &#8211;&gt; 00:30:29.430<br>Ann Johnson: Right, so I think you know, one of the one of the things that actually makes medical research easy, as we can measure harm a lot better.<\/p>\n\n\n\n<p>269<br>00:30:30.030 &#8211;&gt; 00:30:38.190<br>Ann Johnson: Once a better, but maybe unquantifiable ways so like I can see if, like, I give you this drug or I do the surgery on you, I can see, like a how it affects your.<\/p>\n\n\n\n<p>270<br>00:30:38.550 &#8211;&gt; 00:30:43.860<br>Ann Johnson: Your heart rate, I can see how it affects your blood chemistry like I can measure those things right.<\/p>\n\n\n\n<p>271<br>00:30:44.850 &#8211;&gt; 00:31:03.000<br>Ann Johnson: When we&#8217;re talking about other kinds of harm the harm is actually really subjective so if we take like a racist video game right you could argue, and this is a very i&#8217;m going to say this in a you know very simple way because there&#8217;s a lot of complexity to racism, I am a white woman.<\/p>\n\n\n\n<p>272<br>00:31:04.140 &#8211;&gt; 00:31:06.060<br>Ann Johnson: I don&#8217;t experience racism.<\/p>\n\n\n\n<p>273<br>00:31:07.920 &#8211;&gt; 00:31:08.370<br>Right.<\/p>\n\n\n\n<p>274<br>00:31:10.590 &#8211;&gt; 00:31:12.120<br>Ann Johnson: Experience racism at all.<\/p>\n\n\n\n<p>275<br>00:31:14.550 &#8211;&gt; 00:31:23.130<br>Ann Johnson: So the population that we&#8217;re studying actually matters and the harm could be different, depending on who you are.<\/p>\n\n\n\n<p>276<br>00:31:23.910 &#8211;&gt; 00:31:41.760<br>Ann Johnson: And so that&#8217;s something that we have to take into account as well when we&#8217;re doing the research there&#8217;s also the benefit to me could be different than the benefit to say a black woman for studying this, so I think thinking about it in that way as important to.<\/p>\n\n\n\n<p>277<br>00:31:43.650 &#8211;&gt; 00:31:44.370<br>Shlomo Sher: Okay, great.<\/p>\n\n\n\n<p>278<br>00:31:45.960 &#8211;&gt; 00:31:51.180<br>Shlomo Sher: Let me, let me go now back to the issue of fairness right.<\/p>\n\n\n\n<p>279<br>00:31:52.590 &#8211;&gt; 00:32:00.810<br>Shlomo Sher: Right, you talked about fairness and in in two ways so yeah I had is fairness, I want to do something about.<\/p>\n\n\n\n<p>280<br>00:32:01.920 &#8211;&gt; 00:32:03.870<br>Shlomo Sher: You know let&#8217;s keep it simple, I want to know if.<\/p>\n\n\n\n<p>281<br>00:32:05.310 &#8211;&gt; 00:32:20.790<br>Shlomo Sher: Have a sub two players will be to this new ask this this new game mechanics i&#8217;ve introduced to vr games why, why not vr games seems like such a great area of study right, what do I need to consider in terms of fairness.<\/p>\n\n\n\n<p>282<br>00:32:22.080 &#8211;&gt; 00:32:27.060<br>Professor_Ashley: So now, this is a product development right, so this is, for me, this is really interesting because.<\/p>\n\n\n\n<p>283<br>00:32:28.080 &#8211;&gt; 00:32:41.790<br>Professor_Ashley: For some reason we have this idea that if research doesn&#8217;t meet the federal guideline for what researches and you don&#8217;t have to go through an IRB, then you can just do what you want, which is not true, like.<\/p>\n\n\n\n<p>284<br>00:32:42.240 &#8211;&gt; 00:32:56.070<br>Professor_Ashley: These these principles of research ethics should still apply, regardless of whether or not you need to go and fill out a form with an institutional review board, so I see this quite often in terms of.<\/p>\n\n\n\n<p>285<br>00:32:57.660 &#8211;&gt; 00:33:05.310<br>Professor_Ashley: play testing, so we know that there is a week okay I shouldn&#8217;t say we know because I don&#8217;t know of any.<\/p>\n\n\n\n<p>286<br>00:33:06.990 &#8211;&gt; 00:33:19.830<br>Professor_Ashley: quantifiable peer reviewed study on this, but as someone who directs a research summit for at least for this year and has been to the research summit for user research and product research on video games.<\/p>\n\n\n\n<p>287<br>00:33:20.730 &#8211;&gt; 00:33:39.540<br>Professor_Ashley: We there&#8217;s been a historical bias and who is selected for for play testing being usually white and male when there&#8217;s there&#8217;s anecdotal examples of us, but you know stories that people tell about even from the other side of.<\/p>\n\n\n\n<p>288<br>00:33:40.980 &#8211;&gt; 00:33:49.290<br>Professor_Ashley: going in for play testing and assuming that the boyfriend was there to play test and and the woman wasn&#8217;t interested in play test she just drove her boyfriend or something when.<\/p>\n\n\n\n<p>289<br>00:33:49.320 &#8211;&gt; 00:33:50.760<br>Professor_Ashley: When she was in fact the person.<\/p>\n\n\n\n<p>290<br>00:33:51.090 &#8211;&gt; 00:34:01.200<br>Professor_Ashley: Who was selected to do the play testing, so in this case we have this issue of justice, which is one of the principles I think I mentioned previously, of the belmont report.<\/p>\n\n\n\n<p>291<br>00:34:02.490 &#8211;&gt; 00:34:10.350<br>Professor_Ashley: which was the belmont report and and my details on this or bit shaky it was written 1972 something like that.<\/p>\n\n\n\n<p>292<br>00:34:11.790 &#8211;&gt; 00:34:20.550<br>Professor_Ashley: which grew out of this desire to have a formalized government document that says what is what is good research in terms of ethics.<\/p>\n\n\n\n<p>293<br>00:34:21.300 &#8211;&gt; 00:34:30.720<br>Professor_Ashley: One of the principles, there is justice which hence that what and was saying previously about participant selection so while you may be.<\/p>\n\n\n\n<p>294<br>00:34:31.110 &#8211;&gt; 00:34:41.340<br>Professor_Ashley: You may have a really good reason for selecting a certain group of participants, even in video games students right, so if, for example, you want to see if your new game is colorblind friendly.<\/p>\n\n\n\n<p>295<br>00:34:42.210 &#8211;&gt; 00:34:51.330<br>Professor_Ashley: It makes sense to pick participants who have colorblind right like that&#8217;s that&#8217;s you are excluding people, yes, but are you excluding people for a good reason.<\/p>\n\n\n\n<p>296<br>00:34:51.930 &#8211;&gt; 00:35:02.160<br>Professor_Ashley: Also, yes, because you want to make your game more accessible, so in that case the most just thing to do would be to pick people with colorblindness to make your game or colorblind accessible.<\/p>\n\n\n\n<p>297<br>00:35:02.880 &#8211;&gt; 00:35:10.200<br>Professor_Ashley: But if you&#8217;re excluding people because of convenience, which is problem we see I think across research studies.<\/p>\n\n\n\n<p>298<br>00:35:12.150 &#8211;&gt; 00:35:14.790<br>Professor_Ashley: And I know and has more to say later.<\/p>\n\n\n\n<p>299<br>00:35:15.870 &#8211;&gt; 00:35:24.420<br>Professor_Ashley: But when you&#8217;re excluding people because it&#8217;s difficult to reach them because they don&#8217;t speak English as a primary language, because.<\/p>\n\n\n\n<p>300<br>00:35:25.020 &#8211;&gt; 00:35:30.840<br>Professor_Ashley: They might live far away because you&#8217;re you&#8217;re a game studio that&#8217;s located in a city and.<\/p>\n\n\n\n<p>301<br>00:35:31.530 &#8211;&gt; 00:35:38.730<br>Professor_Ashley: People that you might want to research are out in the suburbs and so transportation is difficult, should you exclude them because it&#8217;s difficult.<\/p>\n\n\n\n<p>302<br>00:35:39.630 &#8211;&gt; 00:35:47.280<br>Professor_Ashley: Probably not you should probably try and work out a way that they can still participate because you&#8217;re interested in a diversity of opinions right so.<\/p>\n\n\n\n<p>303<br>00:35:48.120 &#8211;&gt; 00:36:07.110<br>Professor_Ashley: The idea of justice is that the barriers to entry to participate in racial research should be lowered and or equal for everyone, your race your gender your faith your economic status shouldn&#8217;t inhibit you from participating in research, even if it&#8217;s just just quote unquote product research.<\/p>\n\n\n\n<p>304<br>00:36:08.190 &#8211;&gt; 00:36:23.580<br>Ann Johnson: Rather than if I if I could add to that as just like some thoughts about society in general, one of the questions that comes up for IRB is how much do we need to try to make research fair when the world is unfair.<\/p>\n\n\n\n<p>305<br>00:36:23.820 &#8211;&gt; 00:36:24.900<br>Shlomo Sher: Right right.<\/p>\n\n\n\n<p>306<br>00:36:25.050 &#8211;&gt; 00:36:29.850<br>Ann Johnson: And so, are we holding ourselves to a standard to try to correct the world&#8217;s and justices.<\/p>\n\n\n\n<p>307<br>00:36:31.320 &#8211;&gt; 00:36:38.790<br>Ann Johnson: In a way, that maybe isn&#8217;t realistic, but I think one of the things that is really important to think about is.<\/p>\n\n\n\n<p>308<br>00:36:39.300 &#8211;&gt; 00:36:49.080<br>Ann Johnson: There have been research studies that have perpetuated injustices and often the reasons why something is inconvenient to do.<\/p>\n\n\n\n<p>309<br>00:36:49.440 &#8211;&gt; 00:36:58.470<br>Ann Johnson: In research is because it&#8217;s inconvenient in society, and so are we just continuing to perpetuate that inconvenience perpetuate that injustice.<\/p>\n\n\n\n<p>310<br>00:36:58.980 &#8211;&gt; 00:37:12.000<br>Ann Johnson: That comes and so research definitely has to consider conveniences we can&#8217;t there&#8217;s not a lot of money, all the time to study all the things and perfectly just wave and yet.<\/p>\n\n\n\n<p>311<br>00:37:12.390 &#8211;&gt; 00:37:17.760<br>Ann Johnson: If the goal is to put benefit out into society based on the research that you&#8217;re doing.<\/p>\n\n\n\n<p>312<br>00:37:18.690 &#8211;&gt; 00:37:26.700<br>Ann Johnson: The goal probably also should be to make society, a little bit better a little more just alongside of that, so I think that this has.<\/p>\n\n\n\n<p>313<br>00:37:27.060 &#8211;&gt; 00:37:36.870<br>Ann Johnson: hit IRB is a little harder in the last decade, with with renewed Social justice movements that have gone on in the United States and internationally.<\/p>\n\n\n\n<p>314<br>00:37:37.320 &#8211;&gt; 00:37:55.530<br>Ann Johnson: Where we can&#8217;t sit back and not listen to these voices anymore, we need to actually care about that social injustice that that certain communities are experiencing so that, as we do research, we can help in football ways we can&#8217;t do it all but helping smaller ways.<\/p>\n\n\n\n<p>315<br>00:37:56.580 &#8211;&gt; 00:37:59.610<br>Ann Johnson: For those injustices to be overcome in our society.<\/p>\n\n\n\n<p>316<br>00:38:00.120 &#8211;&gt; 00:38:12.600<br>A Ashcraft: So an example like that would be like you know we run our we run these tests only during work hours, and so you know and we&#8217;re when we&#8217;re looking to.<\/p>\n\n\n\n<p>317<br>00:38:13.980 &#8211;&gt; 00:38:19.980<br>A Ashcraft: To test people who are you know 20 to 30 years old that&#8217;s probably when they&#8217;re working.<\/p>\n\n\n\n<p>318<br>00:38:21.270 &#8211;&gt; 00:38:23.850<br>A Ashcraft: or their or their you know rich.<\/p>\n\n\n\n<p>319<br>00:38:27.270 &#8211;&gt; 00:38:34.200<br>Shlomo Sher: yeah I was thinking of classic stuff like you know it&#8217;s it&#8217;s it&#8217;s it&#8217;s harder for me to translate to video games i&#8217;m hoping.<\/p>\n\n\n\n<p>320<br>00:38:34.530 &#8211;&gt; 00:38:40.800<br>Shlomo Sher: You know Ashley you could help translate the videos but I was thinking about classic things like medical research that ends up being only on men.<\/p>\n\n\n\n<p>321<br>00:38:41.490 &#8211;&gt; 00:38:54.780<br>Shlomo Sher: and thereby essentially you know the product is released, and then you know, women are not really protected in the same way as men are because they were never included as part of the study.<\/p>\n\n\n\n<p>322<br>00:38:55.080 &#8211;&gt; 00:38:56.790<br>Professor_Ashley: Well that&#8217;s that&#8217;s vr baby.<\/p>\n\n\n\n<p>323<br>00:38:58.350 &#8211;&gt; 00:39:01.020<br>Professor_Ashley: virtual reality is a really fun example of that because.<\/p>\n\n\n\n<p>324<br>00:39:01.110 &#8211;&gt; 00:39:03.900<br>Professor_Ashley: Motion sickness disproportionately impacts women.<\/p>\n\n\n\n<p>325<br>00:39:04.320 &#8211;&gt; 00:39:05.520<br>Professor_Ashley: I think it&#8217;s something like.<\/p>\n\n\n\n<p>326<br>00:39:06.150 &#8211;&gt; 00:39:10.710<br>Professor_Ashley: 50% of women, I should not I should look up the actual number.<\/p>\n\n\n\n<p>327<br>00:39:12.000 &#8211;&gt; 00:39:14.670<br>Professor_Ashley: But the proportion, maybe it&#8217;s like 40% hold on.<\/p>\n\n\n\n<p>328<br>00:39:15.090 &#8211;&gt; 00:39:19.170<br>A Ashcraft: But even so, I had no idea that it was that it was gender related at all.<\/p>\n\n\n\n<p>329<br>00:39:20.550 &#8211;&gt; 00:39:29.460<br>Professor_Ashley: yeah yeah it&#8217;s so some some studies say that estrogen is like the cause of motion sickness or can increase feelings emotions sickness.<\/p>\n\n\n\n<p>330<br>00:39:30.480 &#8211;&gt; 00:39:41.010<br>Professor_Ashley: But anyway, I can look up the exact number later, women are disproportionately affected by motion sickness and we know that that&#8217;s exacerbated by certain factors and games like.<\/p>\n\n\n\n<p>331<br>00:39:41.580 &#8211;&gt; 00:39:51.270<br>Professor_Ashley: You know movement if you&#8217;re seated vr game versus standing vr game, and then, if you have a frame rate drop so if your your game is.<\/p>\n\n\n\n<p>332<br>00:39:51.870 &#8211;&gt; 00:40:05.100<br>Professor_Ashley: jarring or glitchy at all that&#8217;s going to really trigger motion sickness and so you&#8217;re making a product that about a quarter of the population cannot access will just be incredibly sick if they access it and.<\/p>\n\n\n\n<p>333<br>00:40:06.060 &#8211;&gt; 00:40:12.510<br>Professor_Ashley: it&#8217;s like either people don&#8217;t know that right which it&#8217;s not common knowledge or people are like Oh well, you know.<\/p>\n\n\n\n<p>334<br>00:40:13.560 &#8211;&gt; 00:40:20.850<br>Professor_Ashley: Oh well, it&#8217;s like you&#8217;re excluding this massive percentage of the population from your product right.<\/p>\n\n\n\n<p>335<br>00:40:20.940 &#8211;&gt; 00:40:25.410<br>Shlomo Sher: And, and if you&#8217;re testing obviously doesn&#8217;t include women, you will never find this out.<\/p>\n\n\n\n<p>336<br>00:40:25.800 &#8211;&gt; 00:40:30.960<br>Professor_Ashley: yeah exactly exactly so in a lot of ways it&#8217;s very similar to the medical research is only.<\/p>\n\n\n\n<p>337<br>00:40:32.010 &#8211;&gt; 00:40:32.730<br>Professor_Ashley: studied man.<\/p>\n\n\n\n<p>338<br>00:40:33.420 &#8211;&gt; 00:40:46.470<br>Shlomo Sher: Right yeah that&#8217;s really interesting right i&#8217;m a woman, I you know I get my oculus quest you know i&#8217;m a you know I want to play my game and I can&#8217;t figure out why I can&#8217;t do this, and so I made to suffer.<\/p>\n\n\n\n<p>339<br>00:40:47.940 &#8211;&gt; 00:40:53.280<br>Shlomo Sher: Simply because, when the researcher did the you did their study, they just didn&#8217;t include people like me.<\/p>\n\n\n\n<p>340<br>00:40:53.910 &#8211;&gt; 00:41:02.730<br>Professor_Ashley: yeah and there&#8217;s some really great just as an aside, so if there are women out there listening, who are triggered by motion sickness in vr.<\/p>\n\n\n\n<p>341<br>00:41:03.090 &#8211;&gt; 00:41:13.950<br>Professor_Ashley: There are a couple protests that i&#8217;ve discovered I get motion sick very easy and so see sitting down finding games in vr that are seated helps me and putting a fan on.<\/p>\n\n\n\n<p>342<br>00:41:15.030 &#8211;&gt; 00:41:26.130<br>Professor_Ashley: So, having a box fan that you can direct at your face it&#8217;s it&#8217;s kind of the same effect, I also get seasick So for me it feels like when you&#8217;re on a ship and you go above duck to get fresh air it feels like that.<\/p>\n\n\n\n<p>343<br>00:41:27.570 &#8211;&gt; 00:41:28.560<br>Professor_Ashley: So that&#8217;s helpful.<\/p>\n\n\n\n<p>344<br>00:41:28.860 &#8211;&gt; 00:41:39.420<br>Shlomo Sher: But sorry that was attention is is is that something you is this a personal hack that you&#8217;ve come up with, or is this, something that has been researched, because I mean we&#8217;re talking research here.<\/p>\n\n\n\n<p>345<br>00:41:39.660 &#8211;&gt; 00:41:47.940<br>Professor_Ashley: yeah I wish I were that clever that actually came out of the Games user research summit and the video is on I can give you the link.<\/p>\n\n\n\n<p>346<br>00:41:48.870 &#8211;&gt; 00:42:07.200<br>Professor_Ashley: it&#8217;s on YouTube and I can give you the citation as well i&#8217;ll have to look that up but yeah so some some great research pro tips are shared at the Games user research summit every year on on how to make your play testers more comfortable while they are testing games.<\/p>\n\n\n\n<p>347<br>00:42:07.500 &#8211;&gt; 00:42:08.400<br>A Ashcraft: While they&#8217;re getting sick.<\/p>\n\n\n\n<p>348<br>00:42:08.850 &#8211;&gt; 00:42:09.120<br>Be.<\/p>\n\n\n\n<p>349<br>00:42:10.830 &#8211;&gt; 00:42:11.880<br>A Ashcraft: comfortable but.<\/p>\n\n\n\n<p>350<br>00:42:12.690 &#8211;&gt; 00:42:14.700<br>Shlomo Sher: Though it&#8217;s interesting because it means that.<\/p>\n\n\n\n<p>351<br>00:42:14.730 &#8211;&gt; 00:42:25.110<br>Shlomo Sher: Unless you pass that on that information on to players later on right what you&#8217;re testing on is ideal conditions that are going to apply to the two regular play conditions.<\/p>\n\n\n\n<p>352<br>00:42:26.820 &#8211;&gt; 00:42:27.390<br>Ann Johnson: Right.<\/p>\n\n\n\n<p>353<br>00:42:27.450 &#8211;&gt; 00:42:28.170<br>A Ashcraft: Right right right.<\/p>\n\n\n\n<p>354<br>00:42:29.940 &#8211;&gt; 00:42:32.610<br>Ann Johnson: And that happens in medical research as well right.<\/p>\n\n\n\n<p>355<br>00:42:32.760 &#8211;&gt; 00:42:40.860<br>Ann Johnson: Where we have these really confined conditions and it doesn&#8217;t translate into the real world and so same with same with video game research.<\/p>\n\n\n\n<p>356<br>00:42:42.240 &#8211;&gt; 00:42:43.290<br>A Ashcraft: yeah that&#8217;s fascinating.<\/p>\n\n\n\n<p>357<br>00:42:44.880 &#8211;&gt; 00:42:47.610<br>Shlomo Sher: um Okay, so let me, let me ask i&#8217;m going to go to number two.<\/p>\n\n\n\n<p>358<br>00:42:48.990 &#8211;&gt; 00:42:49.410<br>Shlomo Sher: So.<\/p>\n\n\n\n<p>359<br>00:42:50.550 &#8211;&gt; 00:42:56.550<br>Shlomo Sher: You know we&#8217;ve talked a lot this point about you know we&#8217;ve talked about some about fairness, some of the concerns we have.<\/p>\n\n\n\n<p>360<br>00:42:57.720 &#8211;&gt; 00:43:05.010<br>Shlomo Sher: We haven&#8217;t actually talked a whole lot about the range of kind of video games research projects and i&#8217;m just kind of curious if.<\/p>\n\n\n\n<p>361<br>00:43:05.850 &#8211;&gt; 00:43:17.700<br>Shlomo Sher: Number one you could tell us about some of the ways that video games a research and number two, as some of the ways where maybe the morally right thing is not always the practical thing to do.<\/p>\n\n\n\n<p>362<br>00:43:18.210 &#8211;&gt; 00:43:28.110<br>A Ashcraft: yeah and and i&#8217;m one of you mentioned also that there&#8217;s a difference between morals and ethics that i&#8217;d like to to dive into to like if something&#8217;s morally wrong is it ethically wrong.<\/p>\n\n\n\n<p>363<br>00:43:30.660 &#8211;&gt; 00:43:31.800<br>Shlomo Sher: let&#8217;s do this one, at a time.<\/p>\n\n\n\n<p>364<br>00:43:32.460 &#8211;&gt; 00:43:33.420<br>Professor_Ashley: Okay, which one do you want to.<\/p>\n\n\n\n<p>365<br>00:43:33.600 &#8211;&gt; 00:43:47.340<br>Shlomo Sher: Let let&#8217;s let&#8217;s start let&#8217;s start actually with the let&#8217;s start just with what do you think is a give us some examples of research and video games that we haven&#8217;t talked about that let&#8217;s say doesn&#8217;t involve vr.<\/p>\n\n\n\n<p>366<br>00:43:48.480 &#8211;&gt; 00:43:50.160<br>Professor_Ashley: Okay, and.<\/p>\n\n\n\n<p>367<br>00:43:51.960 &#8211;&gt; 00:43:54.990<br>Professor_Ashley: In terms of ethical issues that could come up.<\/p>\n\n\n\n<p>368<br>00:43:55.830 &#8211;&gt; 00:44:02.700<br>Shlomo Sher: Maybe even just a regular regular kind of research that that happens, we probably should have done this in the beginning of program but we just kind of go with the flow.<\/p>\n\n\n\n<p>369<br>00:44:03.360 &#8211;&gt; 00:44:05.040<br>Professor_Ashley: Sure sure sure.<\/p>\n\n\n\n<p>370<br>00:44:05.070 &#8211;&gt; 00:44:06.660<br>Professor_Ashley: So sorry.<\/p>\n\n\n\n<p>371<br>00:44:07.680 &#8211;&gt; 00:44:13.200<br>Ann Johnson: No so Ashley you know I think you&#8217;re obviously the best person to talk about specific kinds of research.<\/p>\n\n\n\n<p>372<br>00:44:13.500 &#8211;&gt; 00:44:27.300<br>Ann Johnson: You know, but I can also just talk in generalities about you know here&#8217;s something that might be legal but that&#8217;s not moral or here&#8217;s something that is moral, but may not be practical, you know, and so you know I can bounce off of that.<\/p>\n\n\n\n<p>373<br>00:44:28.320 &#8211;&gt; 00:44:38.130<br>Shlomo Sher: So okay great so let&#8217;s start with what kind of researches there is then let&#8217;s go to moral but not practical or legal hey so actually if you could start us off.<\/p>\n\n\n\n<p>374<br>00:44:39.060 &#8211;&gt; 00:44:39.960<br>Professor_Ashley: yeah so.<\/p>\n\n\n\n<p>375<br>00:44:41.700 &#8211;&gt; 00:44:46.050<br>Professor_Ashley: In terms of just broadly the types of video game research that happens, I.<\/p>\n\n\n\n<p>376<br>00:44:46.050 &#8211;&gt; 00:44:47.430<br>Shlomo Sher: mean there&#8217;s.<\/p>\n\n\n\n<p>377<br>00:44:48.030 &#8211;&gt; 00:44:57.210<br>Professor_Ashley: there&#8217;s so much I can&#8217;t even I think I think I did a library search Recently I was looking specifically at vr studies and there was over a million results.<\/p>\n\n\n\n<p>378<br>00:44:57.300 &#8211;&gt; 00:44:57.870<br>A Ashcraft: Like wow.<\/p>\n\n\n\n<p>379<br>00:44:58.140 &#8211;&gt; 00:45:03.870<br>Professor_Ashley: So, would you try to narrow down by date there&#8217;s just people are doing so much really interesting stuff.<\/p>\n\n\n\n<p>380<br>00:45:04.920 &#8211;&gt; 00:45:05.400<br>Professor_Ashley: Out there.<\/p>\n\n\n\n<p>381<br>00:45:07.320 &#8211;&gt; 00:45:17.820<br>Professor_Ashley: So one one thing that might be interesting, this is an example, I actually give my students in in class to think about morality practicality and.<\/p>\n\n\n\n<p>382<br>00:45:18.270 &#8211;&gt; 00:45:31.380<br>Professor_Ashley: Research ethics is say, for example, you were developing a mobile game for teenagers and there&#8217;s like a social media component and.<\/p>\n\n\n\n<p>383<br>00:45:32.190 &#8211;&gt; 00:45:45.690<br>Professor_Ashley: You know this is a fictional game this game does not exist, this is just a thought experiment, what if you&#8217;re you&#8217;re studying to find out how fun the game is how helps feeling it as you&#8217;re not doing anything controversial you&#8217;re not the game isn&#8217;t controversial either it&#8217;s.<\/p>\n\n\n\n<p>384<br>00:45:47.670 &#8211;&gt; 00:45:51.660<br>Professor_Ashley: it&#8217;s a farm game because i&#8217;m using really bad examples right now.<\/p>\n\n\n\n<p>385<br>00:45:53.460 &#8211;&gt; 00:46:00.780<br>Professor_Ashley: I will do okay let&#8217;s do something more creative it&#8217;s a furniture crafting game what could go wrong with that there&#8217;s nothing controversial about this.<\/p>\n\n\n\n<p>386<br>00:46:01.320 &#8211;&gt; 00:46:09.450<br>Professor_Ashley: But what if you have a chat feature And what if, in one of your research reports participant says that they&#8217;re being bullied and harassed.<\/p>\n\n\n\n<p>387<br>00:46:10.200 &#8211;&gt; 00:46:24.240<br>Professor_Ashley: What if that participant says, please don&#8217;t tell my parents I don&#8217;t want them to take this game away, I really enjoy the game, but i&#8217;m getting bullied and i&#8217;m i&#8217;m scared What do you do well in my case it&#8217;s easy i&#8217;m a mandatory reporter.<\/p>\n\n\n\n<p>388<br>00:46:25.680 &#8211;&gt; 00:46:36.510<br>Professor_Ashley: The State says, I have to tell them, but in in anyone else&#8217;s case that might be a real moral quandary So what is legal, what do you legally have to do well that&#8217;s a that&#8217;s a Gray area.<\/p>\n\n\n\n<p>389<br>00:46:37.200 &#8211;&gt; 00:46:49.200<br>Professor_Ashley: Could the parents turn around and Sue if you didn&#8217;t tell them, I mean people, particularly in the United States can sue for just about anything, would it go anywhere I don&#8217;t know is there precedent I don&#8217;t know i&#8217;m not a legal expert right.<\/p>\n\n\n\n<p>390<br>00:46:50.430 &#8211;&gt; 00:46:50.940<br>Professor_Ashley: Is it.<\/p>\n\n\n\n<p>391<br>00:46:52.170 &#8211;&gt; 00:47:01.860<br>Professor_Ashley: If you tell the parents is that morally appropriate you&#8217;re just taking this child&#8217;s game away and that could have been the child&#8217;s only outlet for socialization.<\/p>\n\n\n\n<p>392<br>00:47:03.240 &#8211;&gt; 00:47:14.070<br>Professor_Ashley: If you don&#8217;t tell the parents and the child continues to get bullied and it affects their self esteem, or something worse happens, then what have you done, have you have you been negligent in your role as a game developer.<\/p>\n\n\n\n<p>393<br>00:47:14.370 &#8211;&gt; 00:47:28.740<br>Professor_Ashley: So this is, this is an example that I do not have a clear example of I do not know of a precedent, where this has come up this is kind of just a thought experiment, I, like my students to kind of struggle and grapple with but yeah i&#8217;d like to hear what Dan has to say.<\/p>\n\n\n\n<p>394<br>00:47:30.480 &#8211;&gt; 00:47:42.180<br>Ann Johnson: yeah I think that that&#8217;s a great example of what&#8217;s legal but what&#8217;s the actually the right thing to do right and and we grapple with that our laws don&#8217;t always dictate the right thing to do.<\/p>\n\n\n\n<p>395<br>00:47:43.500 &#8211;&gt; 00:47:54.450<br>Ann Johnson: But here here&#8217;s the here&#8217;s the kind of slip that another example on its head in terms of there may be something that we would all agree is morally right to do so, the concept of informed consent.<\/p>\n\n\n\n<p>396<br>00:47:55.260 &#8211;&gt; 00:48:06.990<br>Ann Johnson: You know, you say that you&#8217;re like yes that&#8217;s that is a that is a great principle, we want to respect people by letting them have informed consent and choose you know what they want to do, based on good information.<\/p>\n\n\n\n<p>397<br>00:48:07.200 &#8211;&gt; 00:48:09.810<br>Professor_Ashley: So we defined inside inside real quick.<\/p>\n\n\n\n<p>398<br>00:48:11.940 &#8211;&gt; 00:48:12.420<br>Ann Johnson: So.<\/p>\n\n\n\n<p>399<br>00:48:12.750 &#8211;&gt; 00:48:13.230<br>A Ashcraft: If you like.<\/p>\n\n\n\n<p>400<br>00:48:14.490 &#8211;&gt; 00:48:14.730<br>Shlomo Sher: yeah.<\/p>\n\n\n\n<p>401<br>00:48:15.960 &#8211;&gt; 00:48:24.180<br>Ann Johnson: So consent is obviously your ability to say yes or no, and making a choice, but the informed part means you had good information to make that choice list.<\/p>\n\n\n\n<p>402<br>00:48:24.780 &#8211;&gt; 00:48:36.510<br>Ann Johnson: Okay, so I think that that&#8217;s important, but so again informed consent sounds like a great thing, and you would think, yes, everyone should give informed consent for all the things that they do, but think about the practicalities of that.<\/p>\n\n\n\n<p>403<br>00:48:38.220 &#8211;&gt; 00:48:46.830<br>Ann Johnson: it&#8217;s it can be really challenging to sit let&#8217;s say you&#8217;re trying to study a video game and you&#8217;re trying to look at the data of thousands of players.<\/p>\n\n\n\n<p>404<br>00:48:48.450 &#8211;&gt; 00:48:56.910<br>Ann Johnson: Getting true informed consent, other than just those terms and conditions, you check the box next to when you sign up for you know, using a game.<\/p>\n\n\n\n<p>405<br>00:48:57.210 &#8211;&gt; 00:48:57.420<br>Ann Johnson: Right.<\/p>\n\n\n\n<p>406<br>00:48:57.660 &#8211;&gt; 00:48:59.070<br>A Ashcraft: So get over them recess.<\/p>\n\n\n\n<p>407<br>00:49:00.360 &#8211;&gt; 00:49:04.350<br>Ann Johnson: Exactly yeah it&#8217;s actually it&#8217;s really impractical.<\/p>\n\n\n\n<p>408<br>00:49:05.250 &#8211;&gt; 00:49:15.960<br>Ann Johnson: And so we like to think that we&#8217;ve gotten informed consent by having that both terms and conditions and blah blah blah but we&#8217;re openly admitting we&#8217;re not reading it so we&#8217;re not important, we gave consent, but we&#8217;re not informed.<\/p>\n\n\n\n<p>409<br>00:49:16.440 &#8211;&gt; 00:49:29.460<br>Ann Johnson: So, you know that is a real to life practicality, that means we&#8217;re not honoring something that we morally think it&#8217;s right but because it&#8217;s impractical we don&#8217;t care.<\/p>\n\n\n\n<p>410<br>00:49:30.600 &#8211;&gt; 00:49:32.460<br>Ann Johnson: You know and where&#8217;s that balance.<\/p>\n\n\n\n<p>411<br>00:49:33.390 &#8211;&gt; 00:49:33.780<br>Right.<\/p>\n\n\n\n<p>412<br>00:49:35.040 &#8211;&gt; 00:49:42.660<br>Shlomo Sher: And it&#8217;s you know it&#8217;s interesting I mean normally we say well it&#8217;s your risk we&#8217;re giving you the opportunity to become informed.<\/p>\n\n\n\n<p>413<br>00:49:43.200 &#8211;&gt; 00:49:50.040<br>Shlomo Sher: But we know that you&#8217;re not really taking that opportunity, so we really know you&#8217;re not informed, but it was, but the.<\/p>\n\n\n\n<p>414<br>00:49:50.460 &#8211;&gt; 00:49:55.350<br>Shlomo Sher: You know the ethical part was to respect your agency by giving you that opportunity but, of course.<\/p>\n\n\n\n<p>415<br>00:49:55.740 &#8211;&gt; 00:50:03.240<br>Shlomo Sher: You know, as classic would you know any kind of medical situations, even if you or any legal document I ever signed ever.<\/p>\n\n\n\n<p>416<br>00:50:03.660 &#8211;&gt; 00:50:22.530<br>Shlomo Sher: Right there&#8217;s also the limitations of actually having the capacity to be informed and understand what you&#8217;re doing in the first place, because you might not have the expertise in it um I I wanna I want to kind of go back to something you said earlier and.<\/p>\n\n\n\n<p>417<br>00:50:24.600 &#8211;&gt; 00:50:33.750<br>Shlomo Sher: Which is it&#8217;s interesting records being informed right i&#8217;m being given correct information, but sometimes research lies.<\/p>\n\n\n\n<p>418<br>00:50:34.170 &#8211;&gt; 00:50:43.470<br>Shlomo Sher: Right, the seeds, I mean some of the greatest psychological studies right and I don&#8217;t know how exactly psychological studies fit into video game research but they&#8217;ve got to fit in the.<\/p>\n\n\n\n<p>419<br>00:50:44.130 &#8211;&gt; 00:50:44.550<br>Shlomo Sher: Research.<\/p>\n\n\n\n<p>420<br>00:50:44.610 &#8211;&gt; 00:50:46.380<br>Shlomo Sher: For in lots of ways right.<\/p>\n\n\n\n<p>421<br>00:50:47.460 &#8211;&gt; 00:50:52.200<br>Shlomo Sher: How much deception, can I do in my in my research.<\/p>\n\n\n\n<p>422<br>00:50:54.000 &#8211;&gt; 00:50:56.790<br>Ann Johnson: that&#8217;s a really good question so let&#8217;s think about.<\/p>\n\n\n\n<p>423<br>00:50:57.780 &#8211;&gt; 00:51:10.650<br>Ann Johnson: You know let&#8217;s say, well, I won&#8217;t say in the IRB world in human research world we have these three core values core ethical principles and we&#8217;ve talked about all of them here today informed consent is a big one.<\/p>\n\n\n\n<p>424<br>00:51:11.280 &#8211;&gt; 00:51:29.220<br>Ann Johnson: that&#8217;s the value we have waiting risks and benefits that&#8217;s the second value we have and then fairness and justice that&#8217;s a third value we have so in the case that you just described this idea of deceiving people in order to study them and we&#8217;re we&#8217;re basically trying to weigh.<\/p>\n\n\n\n<p>425<br>00:51:30.420 &#8211;&gt; 00:51:39.330<br>Ann Johnson: Our value of informed consent against our value of of risk benefit the benefit of that research of what you&#8217;re going to learn right.<\/p>\n\n\n\n<p>426<br>00:51:40.020 &#8211;&gt; 00:51:56.580<br>Ann Johnson: And so, is it is it more valuable to learn the thing we&#8217;re going to learn from this research, even though we&#8217;re deceiving people, or is it more valuable to get their informed consent, what do we value more, and so, with every study, then we have to decide, are the benefits worth it.<\/p>\n\n\n\n<p>427<br>00:51:57.720 &#8211;&gt; 00:52:08.220<br>Ann Johnson: Is is that worse, the deception now in psychology research, you know it is commonly accepted practice, now that you don&#8217;t just deceive people and then walk away.<\/p>\n\n\n\n<p>428<br>00:52:08.790 &#8211;&gt; 00:52:17.100<br>Ann Johnson: You deceive them they do the study right they do the thing you&#8217;re asking them to do, and then you actually tell them that you didn&#8217;t see it to them before they walk away.<\/p>\n\n\n\n<p>429<br>00:52:17.610 &#8211;&gt; 00:52:30.720<br>Ann Johnson: and tell them why you needed to deceive them in the first place so you&#8217;re actually getting informed consent later, a little bit right because, even though they couldn&#8217;t make that full decision up front, they are getting information later.<\/p>\n\n\n\n<p>430<br>00:52:31.170 &#8211;&gt; 00:52:40.170<br>Ann Johnson: And we ask our researchers Center respect people and say, if you hated what we did, to you, you don&#8217;t have you can pull all your data from our research project right.<\/p>\n\n\n\n<p>431<br>00:52:41.610 &#8211;&gt; 00:52:48.660<br>Ann Johnson: And you know you have the right to voice that so it&#8217;s not a perfect way of getting informed consent, but it helps fill in some of the gaps.<\/p>\n\n\n\n<p>432<br>00:52:50.130 &#8211;&gt; 00:52:55.440<br>Ann Johnson: That that would cause people to feel like that was an ethically questionable practice in the first place.<\/p>\n\n\n\n<p>433<br>00:52:56.970 &#8211;&gt; 00:53:04.590<br>A Ashcraft: Interesting yeah so that brings into question there&#8217;s a lot of stuff that happens in games, particularly now that you know mobile games and other connected games where.<\/p>\n\n\n\n<p>434<br>00:53:07.200 &#8211;&gt; 00:53:19.650<br>A Ashcraft: The game itself is in some ways a a giant test right and and people test all kinds of things there&#8217;s a be testing for for ui issues like in some ways, these are psychological tests right.<\/p>\n\n\n\n<p>435<br>00:53:20.130 &#8211;&gt; 00:53:30.780<br>A Ashcraft: Like does this does this interface work better, for doing whatever it is that we&#8217;re attempting to do, then this other interface and we&#8217;re going to test half of our population of you know 30,000 gamers.<\/p>\n\n\n\n<p>436<br>00:53:31.950 &#8211;&gt; 00:53:38.880<br>A Ashcraft: What they you know against one, and then the other 30,000 against the other, and we get a lot of good data out of this stuff and get a lot of good information.<\/p>\n\n\n\n<p>437<br>00:53:40.680 &#8211;&gt; 00:53:54.630<br>A Ashcraft: You know, and every game has its terms of its terms that you, you know check the box off and not read, but is that should that be something that we should really consider through these through the same lens that the IRB do.<\/p>\n\n\n\n<p>438<br>00:53:55.920 &#8211;&gt; 00:54:05.100<br>Shlomo Sher: Oh, I say so, just to be clear, so these are so this is these would be just kind of practical research that the game itself does.<\/p>\n\n\n\n<p>439<br>00:54:05.580 &#8211;&gt; 00:54:08.340<br>Shlomo Sher: Right continuously right and continuously.<\/p>\n\n\n\n<p>440<br>00:54:08.430 &#8211;&gt; 00:54:09.090<br>A Ashcraft: Absolutely.<\/p>\n\n\n\n<p>441<br>00:54:09.330 &#8211;&gt; 00:54:17.130<br>Shlomo Sher: you&#8217;re getting feedback from users very, very I mean directly or indirectly, I guess you could always you know ask them after the fact.<\/p>\n\n\n\n<p>442<br>00:54:17.370 &#8211;&gt; 00:54:19.560<br>A Ashcraft: So we&#8217;re just getting it directly we&#8217;re just seeing.<\/p>\n\n\n\n<p>443<br>00:54:19.590 &#8211;&gt; 00:54:22.170<br>A Ashcraft: Seeing what they do in the game and we&#8217;re and we&#8217;re collecting that data.<\/p>\n\n\n\n<p>444<br>00:54:22.410 &#8211;&gt; 00:54:31.800<br>Shlomo Sher: Right So yes, i&#8217;d love to hear that yeah How is this different from what you guys do and are there any lessons that you think game company should take from this.<\/p>\n\n\n\n<p>445<br>00:54:32.820 &#8211;&gt; 00:54:33.990<br>Professor_Ashley: So that is.<\/p>\n\n\n\n<p>446<br>00:54:35.130 &#8211;&gt; 00:54:39.630<br>Professor_Ashley: The product development type angle, so one of the ways I think about this and I.<\/p>\n\n\n\n<p>447<br>00:54:41.010 &#8211;&gt; 00:54:45.840<br>Professor_Ashley: I don&#8217;t know that there&#8217;s you know I don&#8217;t know that this is in the belmont report right.<\/p>\n\n\n\n<p>448<br>00:54:46.350 &#8211;&gt; 00:55:00.180<br>Professor_Ashley: I don&#8217;t know that this is officially documented, but I tend to think about things in terms of intervention in the psychological sense in terms of user testing and how much we are impacting changing or.<\/p>\n\n\n\n<p>449<br>00:55:01.710 &#8211;&gt; 00:55:07.530<br>Professor_Ashley: messing with people&#8217;s natural behaviors so if, for example, I want to study.<\/p>\n\n\n\n<p>450<br>00:55:09.450 &#8211;&gt; 00:55:11.370<br>Professor_Ashley: people&#8217;s reaction to.<\/p>\n\n\n\n<p>451<br>00:55:12.930 &#8211;&gt; 00:55:23.610<br>Professor_Ashley: A virtual world in one version where site is very limited and audio is more apparent and and another version where site is there, but there&#8217;s no audio track something like that right.<\/p>\n\n\n\n<p>452<br>00:55:23.850 &#8211;&gt; 00:55:29.160<br>Professor_Ashley: i&#8217;m introducing a change i&#8217;m having them play and then introducing this change and then and seeing the results.<\/p>\n\n\n\n<p>453<br>00:55:30.390 &#8211;&gt; 00:55:38.820<br>Professor_Ashley: i&#8217;m impacting them by introducing this change in a minor way that&#8217;s not going to presumably cause anyone any psychological distress or any kind of harp.<\/p>\n\n\n\n<p>454<br>00:55:40.650 &#8211;&gt; 00:55:43.260<br>Professor_Ashley: Whereas, if I have someone.<\/p>\n\n\n\n<p>455<br>00:55:44.280 &#8211;&gt; 00:55:44.970<br>Professor_Ashley: play.<\/p>\n\n\n\n<p>456<br>00:55:46.620 &#8211;&gt; 00:55:54.840<br>Professor_Ashley: Like a very cutesy colorful game, and all of a sudden, a giant scary monster comes out to scare them and because i&#8217;m introducing the stimuli.<\/p>\n\n\n\n<p>457<br>00:55:55.110 &#8211;&gt; 00:56:04.890<br>Professor_Ashley: As a type of intervention to see how I mean I don&#8217;t know why you&#8217;d want to do this research unless you&#8217;re doing something biometric Lee right you want to see how fast, you can make someone&#8217;s heart rate go up.<\/p>\n\n\n\n<p>458<br>00:56:06.990 &#8211;&gt; 00:56:12.660<br>Professor_Ashley: very cruel but fun that&#8217;s a little bit more serious now i&#8217;m impacting them impacting their physicality.<\/p>\n\n\n\n<p>459<br>00:56:12.990 &#8211;&gt; 00:56:22.080<br>Professor_Ashley: I am intentionally disrupting what they are setting out to do so, I think in terms of when companies are collecting telemetry telemetry.<\/p>\n\n\n\n<p>460<br>00:56:22.980 &#8211;&gt; 00:56:39.240<br>Professor_Ashley: And and they&#8217;re collecting analytical data from their users their users are playing the game as intended they&#8217;re playing the product that they purchased of course okay so maybe maybe they have some complaints about this product as users, you know we&#8217;ve all been on reddit before.<\/p>\n\n\n\n<p>461<br>00:56:39.480 &#8211;&gt; 00:56:40.980<br>Professor_Ashley: But there they purchase this product they&#8217;re.<\/p>\n\n\n\n<p>462<br>00:56:40.980 &#8211;&gt; 00:56:52.380<br>Professor_Ashley: playing this product they&#8217;re happy to play this product now sending data to the company about pinch points where the users dying sending data to the company about how much in game currency they&#8217;ve earned.<\/p>\n\n\n\n<p>463<br>00:56:53.310 &#8211;&gt; 00:57:00.720<br>Professor_Ashley: And how much they&#8217;ve spent says find out the economy is balanced, all of these things are are fairly innocuous they&#8217;re there.<\/p>\n\n\n\n<p>464<br>00:57:00.990 &#8211;&gt; 00:57:13.980<br>Professor_Ashley: For the benefit of the game and for the benefit of the Games balancing and and presumably to make that person even happier with the game, the next time they play it because there&#8217;ll be more more balanced and more theoretically more enjoyable.<\/p>\n\n\n\n<p>465<br>00:57:15.420 &#8211;&gt; 00:57:20.400<br>Professor_Ashley: which is different to intentionally disrupting someone&#8217;s gameplay to see how they react right.<\/p>\n\n\n\n<p>466<br>00:57:20.460 &#8211;&gt; 00:57:24.480<br>A Ashcraft: Well, what about things like because we&#8217;ve certainly heard a lot of stories about.<\/p>\n\n\n\n<p>467<br>00:57:26.310 &#8211;&gt; 00:57:32.550<br>A Ashcraft: Using a B testing to see which things will lead people to buy more in game purchases.<\/p>\n\n\n\n<p>468<br>00:57:34.200 &#8211;&gt; 00:57:35.010<br>Professor_Ashley: Oh marketing.<\/p>\n\n\n\n<p>469<br>00:57:35.370 &#8211;&gt; 00:57:35.640<br>Oh, my.<\/p>\n\n\n\n<p>470<br>00:57:39.930 &#8211;&gt; 00:57:43.710<br>Professor_Ashley: So, in terms of what would be the question is it ethical.<\/p>\n\n\n\n<p>471<br>00:57:44.130 &#8211;&gt; 00:57:51.360<br>A Ashcraft: Well, no, no, not I mean, how could, how can we, how can we make that more ethical because it&#8217;s not going to go away.<\/p>\n\n\n\n<p>472<br>00:57:52.740 &#8211;&gt; 00:57:53.100<br>Shlomo Sher: Right so.<\/p>\n\n\n\n<p>473<br>00:57:53.220 &#8211;&gt; 00:58:04.740<br>Shlomo Sher: The question is not whether let&#8217;s say research about what marketing works is ethical, I guess, but maybe what concerns need to go into.<\/p>\n\n\n\n<p>474<br>00:58:04.800 &#8211;&gt; 00:58:05.220<br>A Ashcraft: yeah.<\/p>\n\n\n\n<p>475<br>00:58:05.250 &#8211;&gt; 00:58:05.880<br>Shlomo Sher: Could should we.<\/p>\n\n\n\n<p>476<br>00:58:06.090 &#8211;&gt; 00:58:15.240<br>A Ashcraft: Should we be using the lens of that that and talks about for the the IRB us for doing these sorts of things as well.<\/p>\n\n\n\n<p>477<br>00:58:16.710 &#8211;&gt; 00:58:16.830<br>Ann Johnson: I.<\/p>\n\n\n\n<p>478<br>00:58:17.160 &#8211;&gt; 00:58:18.510<br>Ann Johnson: really think you can.<\/p>\n\n\n\n<p>479<br>00:58:19.740 &#8211;&gt; 00:58:31.560<br>Ann Johnson: Sorry actually I I think you can one of the things that I teach and and why it&#8217;s probably particularly interesting that my bio starts with the fact that i&#8217;m a soul and I love the so.<\/p>\n\n\n\n<p>480<br>00:58:32.100 &#8211;&gt; 00:58:42.780<br>Ann Johnson: Is I actually have kind of taken on some projects where I go out into what you would think are completely unrelated fields like sewing and artistry.<\/p>\n\n\n\n<p>481<br>00:58:43.500 &#8211;&gt; 00:58:53.940<br>Ann Johnson: You would think it&#8217;s unrelated to research ethics and I actually go and I talked about how are three core ethical principles we we use all over our lives in lots of different fields and in lots of different ways.<\/p>\n\n\n\n<p>482<br>00:58:54.420 &#8211;&gt; 00:59:01.860<br>Ann Johnson: And so I think it&#8217;s really easy to look at things like informed choices risk benefit balance and justice.<\/p>\n\n\n\n<p>483<br>00:59:02.220 &#8211;&gt; 00:59:07.530<br>Ann Johnson: across all the things that we do there they&#8217;re just great ethical principles to away.<\/p>\n\n\n\n<p>484<br>00:59:07.800 &#8211;&gt; 00:59:17.460<br>Ann Johnson: With all of our decisions that we&#8217;re making and so when you&#8217;re looking at you know phase setting different ways, you would advertise to people to get them to make purchases, you know you absolutely can say.<\/p>\n\n\n\n<p>485<br>00:59:18.030 &#8211;&gt; 00:59:29.550<br>Ann Johnson: what&#8217;s the what&#8217;s the risk to the person into society here what&#8217;s the benefit to the person in society here are the burdens and the benefits equitably distributed is it adjust way a fair way of doing things.<\/p>\n\n\n\n<p>486<br>00:59:30.060 &#8211;&gt; 00:59:37.500<br>Ann Johnson: So, even though that that type of an activity doesn&#8217;t need to be reviewed by an IRB think the word above.<\/p>\n\n\n\n<p>487<br>00:59:38.970 &#8211;&gt; 00:59:55.920<br>Ann Johnson: is something that you can still apply apply ethics to you can still you know use these principles to make better decisions if you know if you&#8217;re trying to make the world more ethical you would absolutely be able to do that and sorry actually I cut you off, please.<\/p>\n\n\n\n<p>488<br>00:59:56.580 &#8211;&gt; 00:59:56.970<br>Professor_Ashley: Oh, I would.<\/p>\n\n\n\n<p>489<br>00:59:57.720 &#8211;&gt; 01:00:13.560<br>Professor_Ashley: Say from a very practical standpoint, you have this idea of well, are you making people spend more money or were those people going to spend that money anyway and you&#8217;ve just made it easier for them, because your user interfaces more aligned to how people think it&#8217;s more intuitive right.<\/p>\n\n\n\n<p>490<br>01:00:14.760 &#8211;&gt; 01:00:23.610<br>Professor_Ashley: Do I mean I don&#8217;t know of a causal relationship to to having a particular aesthetic design that causes people to spend more money.<\/p>\n\n\n\n<p>491<br>01:00:24.210 &#8211;&gt; 01:00:36.930<br>Professor_Ashley: I do know that you want to good good user experience design practices that you want to limit the amount of barriers that exist for people to be able to spend their money, I mean I have examples of I was trying to get a food delivery APP.<\/p>\n\n\n\n<p>492<br>01:00:38.340 &#8211;&gt; 01:00:45.300<br>Professor_Ashley: Like a box, the box of groceries that&#8217;s delivered to your House and I tried two different Apps and I couldn&#8217;t figure out how to give them my money.<\/p>\n\n\n\n<p>493<br>01:00:45.510 &#8211;&gt; 01:00:55.890<br>Professor_Ashley: Like I wanted this service, I was a client like let&#8217;s go I got my credit card in hand, but your ui is so terrible that I cannot figure out how to order my first box, I am not going to use your service.<\/p>\n\n\n\n<p>494<br>01:00:56.310 &#8211;&gt; 01:01:05.760<br>Professor_Ashley: So when we&#8217;re talking about like the the convert the conversion between the number of people who download a game or an APP and the number of people who pay for the game, or the APP.<\/p>\n\n\n\n<p>495<br>01:01:06.360 &#8211;&gt; 01:01:13.830<br>Professor_Ashley: We were looking at how much of that is people getting frustrated and closing it and uninstalling it because they can&#8217;t figure out how to do what they want to do.<\/p>\n\n\n\n<p>496<br>01:01:14.280 &#8211;&gt; 01:01:25.350<br>Professor_Ashley: That might not necessarily always be give someone money right your ui might be terrible and people get frustrated not being able to play the game in general and then close the APP and never convert to a paying customer but.<\/p>\n\n\n\n<p>497<br>01:01:26.010 &#8211;&gt; 01:01:35.910<br>Professor_Ashley: But I totally ECHO and agree with an as well, but in terms of dark design practices, there we absolutely can implement this moral framework.<\/p>\n\n\n\n<p>498<br>01:01:36.960 &#8211;&gt; 01:01:46.650<br>Professor_Ashley: I just wanted to be careful to suss out the kind of practicalities of user interface design is not and user experience design is not always to fleece.<\/p>\n\n\n\n<p>499<br>01:01:48.270 &#8211;&gt; 01:01:50.640<br>Professor_Ashley: we&#8217;ve got we gotta make money.<\/p>\n\n\n\n<p>500<br>01:01:51.210 &#8211;&gt; 01:01:52.620<br>A Ashcraft: that&#8217;s right and it might not even be.<\/p>\n\n\n\n<p>501<br>01:01:52.680 &#8211;&gt; 01:02:07.950<br>A Ashcraft: Your your your your business model right, it might be, you know, the way that you serve ads or the way that you do anything but, but we do a lot of this sort of testing all the time, as it was was my point and it was sort of I was sort of struck by how.<\/p>\n\n\n\n<p>502<br>01:02:08.430 &#8211;&gt; 01:02:16.680<br>A Ashcraft: The descriptions of these of these psychological tests mapped over to this this kind of a B testing that we do in games and other Apps.<\/p>\n\n\n\n<p>503<br>01:02:16.800 &#8211;&gt; 01:02:30.150<br>Shlomo Sher: it&#8217;s interesting with the with the ap with the A, B testing also whether you guys have demographics, of the of it, whether these are just players or whether you have information that gives you different graphics on these players and how.<\/p>\n\n\n\n<p>504<br>01:02:30.150 &#8211;&gt; 01:02:40.320<br>Shlomo Sher: That would kind of you know how how that would play into it, I was thinking Ashley with your example I was thinking of you know, all these games that have.<\/p>\n\n\n\n<p>505<br>01:02:41.220 &#8211;&gt; 01:02:53.760<br>Shlomo Sher: ads in the middle, to get you to buy other games and how hard it is for me to find the X to shut them off or those two little arrows to forward them and how you can essentially do a B testing where.<\/p>\n\n\n\n<p>506<br>01:02:54.330 &#8211;&gt; 01:03:09.810<br>Shlomo Sher: The button is just a little tiny bit smaller or yet in another place that&#8217;s even harder to find and, again, I think the way unexplained it is OK, you know what&#8217;s the potential harms here right How does that way gets the benefits, I thought that I thought that was really great just.<\/p>\n\n\n\n<p>507<br>01:03:09.870 &#8211;&gt; 01:03:10.230<br>Shlomo Sher: yeah.<\/p>\n\n\n\n<p>508<br>01:03:10.260 &#8211;&gt; 01:03:11.430<br>Shlomo Sher: You know how you could apply it.<\/p>\n\n\n\n<p>509<br>01:03:12.030 &#8211;&gt; 01:03:19.410<br>A Ashcraft: I kind of love this as just a set of lenses that we should look at, we should look at all this stuff through maybe.<\/p>\n\n\n\n<p>510<br>01:03:19.980 &#8211;&gt; 01:03:20.730<br>Professor_Ashley: totally agree.<\/p>\n\n\n\n<p>511<br>01:03:20.820 &#8211;&gt; 01:03:21.300<br>yeah.<\/p>\n\n\n\n<p>512<br>01:03:22.410 &#8211;&gt; 01:03:25.050<br>Shlomo Sher: Andy really quick i&#8217;m checking on i&#8217;m having a time check with you.<\/p>\n\n\n\n<p>513<br>01:03:25.260 &#8211;&gt; 01:03:27.450<br>A Ashcraft: Right we&#8217;re we&#8217;re we&#8217;re good for another 10.<\/p>\n\n\n\n<p>514<br>01:03:27.930 &#8211;&gt; 01:03:42.510<br>Shlomo Sher: Great Okay, so let me get to okay guys, so let me ask you that so i&#8217;m probably the most famous topics of research right on video games are the ones that have made it to the public discussion right.<\/p>\n\n\n\n<p>515<br>01:03:43.440 &#8211;&gt; 01:03:58.980<br>Shlomo Sher: There about you know, violence, sexism and addiction right that&#8217;s been kind of the the big three right um you know I want to know if ultra violent video game, whatever exactly that means you know but let&#8217;s say a very violent video game right.<\/p>\n\n\n\n<p>516<br>01:04:00.120 &#8211;&gt; 01:04:03.360<br>Shlomo Sher: is going to actually lead to violence right and.<\/p>\n\n\n\n<p>517<br>01:04:05.130 &#8211;&gt; 01:04:15.360<br>Shlomo Sher: i&#8217;m as i&#8217;m sure you guys are at least Ashley has a seminar standing of the history, you know of of this but um.<\/p>\n\n\n\n<p>518<br>01:04:16.020 &#8211;&gt; 01:04:30.360<br>Shlomo Sher: You know I remember reading study on aggression and you know, looking at how they were doing the study and thinking my God there Sam number one their sample so small, but number two they were using the blast of horns.<\/p>\n\n\n\n<p>519<br>01:04:31.770 &#8211;&gt; 01:04:42.930<br>Shlomo Sher: Right to so you&#8217;re playing a game and weather and you have this ability to blast a horn that&#8217;s going to be really loud in someone&#8217;s face, and if you do that, that was a sign that you are aggressive.<\/p>\n\n\n\n<p>520<br>01:04:43.500 &#8211;&gt; 01:04:58.320<br>Shlomo Sher: And I thought to myself oh my God that is Nicholas in terms of measuring aggression, but, of course, you know you&#8217;re limited right in what you can so you know how am I limited right is is.<\/p>\n\n\n\n<p>521<br>01:04:59.100 &#8211;&gt; 01:05:01.530<br>Professor_Ashley: I think it&#8217;s really interesting that you bring up that they had such a.<\/p>\n\n\n\n<p>522<br>01:05:01.530 &#8211;&gt; 01:05:06.030<br>Professor_Ashley: small sample size, because in some in some I mean yes in terms of your.<\/p>\n\n\n\n<p>523<br>01:05:06.840 &#8211;&gt; 01:05:08.400<br>Shlomo Sher: Particular study I was looking at.<\/p>\n\n\n\n<p>524<br>01:05:08.430 &#8211;&gt; 01:05:11.310<br>Shlomo Sher: yeah yeah sure there&#8217;s some with large sample sizes.<\/p>\n\n\n\n<p>525<br>01:05:11.370 &#8211;&gt; 01:05:15.510<br>Professor_Ashley: Oh yeah, no, no, I know the exact day you mean and I can&#8217;t remember the name of the authors of the moment but.<\/p>\n\n\n\n<p>526<br>01:05:16.380 &#8211;&gt; 01:05:24.000<br>Professor_Ashley: it&#8217;s it&#8217;s really interesting because, of course, when we&#8217;re doing a research design we if we&#8217;re doing quantitatively, we want, as many people as possible but.<\/p>\n\n\n\n<p>527<br>01:05:24.270 &#8211;&gt; 01:05:37.830<br>Professor_Ashley: And i&#8217;m always heartened a little bit when you have these wild studies really quiet and you see that they have a small sample size, because it means that the IRB is working right because people did not consent to participate in the research.<\/p>\n\n\n\n<p>528<br>01:05:38.760 &#8211;&gt; 01:05:49.530<br>Professor_Ashley: I mean i&#8217;m always floored by pain management studies, where I mean it&#8217;s not they&#8217;re not like inflicting permanent harm but, but you see them all the time, where people hold an ice cube.<\/p>\n\n\n\n<p>529<br>01:05:50.220 &#8211;&gt; 01:05:56.520<br>Professor_Ashley: Which is discomfort right or they will snap rubber bands on their arm or they will expose skin to heat or cold.<\/p>\n\n\n\n<p>530<br>01:05:56.850 &#8211;&gt; 01:06:11.250<br>Professor_Ashley: And then determine how effective an analgesic is or an aesthetic or whatever the the intervention is to try and reduce you know not feel that pain and every time I read one of these I just think who in the hell would want.<\/p>\n\n\n\n<p>531<br>01:06:14.490 &#8211;&gt; 01:06:25.620<br>Shlomo Sher: As an undergrad I I participated in you know clinical trials, because I needed the money and, as I totally would have held an ice cube for money right.<\/p>\n\n\n\n<p>532<br>01:06:26.130 &#8211;&gt; 01:06:29.250<br>Shlomo Sher: You know, we need money I would be would be my guess.<\/p>\n\n\n\n<p>533<br>01:06:29.970 &#8211;&gt; 01:06:30.870<br>A Ashcraft: yeah so our.<\/p>\n\n\n\n<p>534<br>01:06:31.620 &#8211;&gt; 01:06:33.540<br>Professor_Ashley: Research respects it comes down to.<\/p>\n\n\n\n<p>535<br>01:06:33.600 &#8211;&gt; 01:06:40.560<br>Professor_Ashley: If you would do it for money, and if that seems reasonable to you, you we respect you as a person, we respect your ability to consent to that.<\/p>\n\n\n\n<p>536<br>01:06:41.670 &#8211;&gt; 01:06:42.210<br>Professor_Ashley: Go for it.<\/p>\n\n\n\n<p>537<br>01:06:45.360 &#8211;&gt; 01:06:56.820<br>Ann Johnson: Although we do have to make the decision of like how much pain, are we willing to let you choose to inflict on yourself at your own expense so even though you might be a competent adults.<\/p>\n\n\n\n<p>538<br>01:06:57.120 &#8211;&gt; 01:07:09.540<br>Ann Johnson: right there might be a threshold of risk that we, as an IRB we&#8217;re not okay with you, choosing that amount of risk, you know whether it&#8217;s for money or you know, whatever the result could be disability after that risk is taken.<\/p>\n\n\n\n<p>539<br>01:07:11.280 &#8211;&gt; 01:07:23.070<br>Ann Johnson: One of the one of the things that I thought about with this question, and this is really somber topic, unfortunately, but I think it&#8217;s a really good example is studies about child abuse.<\/p>\n\n\n\n<p>540<br>01:07:24.210 &#8211;&gt; 01:07:34.830<br>Ann Johnson: So I think we can all agree that figuring out how to reduce child abuse in our society is a great thing to figure out.<\/p>\n\n\n\n<p>541<br>01:07:35.100 &#8211;&gt; 01:07:38.970<br>Ann Johnson: And yet we don&#8217;t want to do any studies, where we&#8217;re actually abusing children.<\/p>\n\n\n\n<p>542<br>01:07:40.230 &#8211;&gt; 01:07:51.000<br>Ann Johnson: that&#8217;s that&#8217;s not the goal right, and yet we need to study it, and so the way we design our studies is actually how we address kind of the the issues.<\/p>\n\n\n\n<p>543<br>01:07:51.360 &#8211;&gt; 01:08:00.510<br>Ann Johnson: Of of risk and benefit here right i&#8217;m not going to design a study that abuses children that&#8217;s not right, however, I could design a study that observed.<\/p>\n\n\n\n<p>544<br>01:08:01.590 &#8211;&gt; 01:08:12.180<br>Ann Johnson: Child abuse behavior that&#8217;s happening out in the real world environment right and and then study you know things that go along, without observation I think it&#8217;s the same.<\/p>\n\n\n\n<p>545<br>01:08:12.750 &#8211;&gt; 01:08:17.790<br>Ann Johnson: With violent video game research right if we.<\/p>\n\n\n\n<p>546<br>01:08:18.750 &#8211;&gt; 01:08:27.690<br>Ann Johnson: If there is the hypothesis that violent video games are causing people to be violence but it&#8217;s just questionable, but if that&#8217;s your hypothesis, then.<\/p>\n\n\n\n<p>547<br>01:08:28.050 &#8211;&gt; 01:08:37.980<br>Ann Johnson: You need to go about studying that, in a way that doesn&#8217;t increase harm to people and so perhaps it again when we talked about this earlier you don&#8217;t go and expose naive.<\/p>\n\n\n\n<p>548<br>01:08:38.430 &#8211;&gt; 01:08:44.550<br>Ann Johnson: video game players who have never played a violent video game to all these violent video games and then see what happens.<\/p>\n\n\n\n<p>549<br>01:08:45.390 &#8211;&gt; 01:08:58.830<br>Ann Johnson: But there are a lot of people out there that are already playing violent video games that there&#8217;s a pool to potentially observe and study, now the science of you know how we measure.<\/p>\n\n\n\n<p>550<br>01:08:59.850 &#8211;&gt; 01:09:15.060<br>Ann Johnson: Their progression toward violence or not is is very interesting in and of itself and correlation versus causation is also, I think, an interesting thing to think about here that we have to be careful as scientists, but.<\/p>\n\n\n\n<p>551<br>01:09:17.040 &#8211;&gt; 01:09:25.530<br>Ann Johnson: I think it&#8217;s important to really say like what am I really trying to study here what&#8217;s the social problem i&#8217;m really trying to understand and maybe we&#8217;re trying to benefit from.<\/p>\n\n\n\n<p>552<br>01:09:26.040 &#8211;&gt; 01:09:31.710<br>Ann Johnson: And then, how do I make sure that I am not just harming people, for the sake of harming people to answer my question.<\/p>\n\n\n\n<p>553<br>01:09:33.300 &#8211;&gt; 01:09:38.970<br>Shlomo Sher: Right I just basically really want to get a psychologist WHO studies stuff like this.<\/p>\n\n\n\n<p>554<br>01:09:40.110 &#8211;&gt; 01:09:41.880<br>Shlomo Sher: i&#8217;ve had my and Chris Ferguson.<\/p>\n\n\n\n<p>555<br>01:09:43.260 &#8211;&gt; 01:09:52.260<br>Shlomo Sher: To come talk about you know study you know, creating studies for dealing with with with with issues like this and how they they think about doing that.<\/p>\n\n\n\n<p>556<br>01:09:54.090 &#8211;&gt; 01:10:01.590<br>Shlomo Sher: You know, though it does make me think the study actually I was thinking about an Ashley I don&#8217;t know for think about the same study or if there&#8217;s lots of studies that through this.<\/p>\n\n\n\n<p>557<br>01:10:01.860 &#8211;&gt; 01:10:06.660<br>Shlomo Sher: But one of the things that they did want to know is, they wanted to know the difference between people who do play.<\/p>\n\n\n\n<p>558<br>01:10:07.410 &#8211;&gt; 01:10:19.500<br>Shlomo Sher: violent games and I remember how violent we&#8217;re talking about Maybe it was just first person shooters are, but they did want to know the difference between people who play regularly and people that don&#8217;t play so they can see if.<\/p>\n\n\n\n<p>559<br>01:10:20.400 &#8211;&gt; 01:10:32.310<br>Shlomo Sher: You know if you&#8217;re more desensitized to violence or anything like that, and so they did do that, but again i&#8217;m curious if that was maybe they were playing call of duty, as opposed to like man hunter or.<\/p>\n\n\n\n<p>560<br>01:10:32.310 &#8211;&gt; 01:10:32.910<br>Professor_Ashley: Something yeah.<\/p>\n\n\n\n<p>561<br>01:10:33.390 &#8211;&gt; 01:10:44.370<br>Shlomo Sher: or right so that&#8217;s and and that&#8217;s when we&#8217;re talking about also adults versus kids is another one that seems really interesting there speaking of.<\/p>\n\n\n\n<p>562<br>01:10:45.210 &#8211;&gt; 01:10:59.520<br>Shlomo Sher: You know, one of the big concerns with kids is pathological playing addiction right and it really kind of makes me wonder again study design for an addictive behavior.<\/p>\n\n\n\n<p>563<br>01:11:00.600 &#8211;&gt; 01:11:03.540<br>Shlomo Sher: How do you do that, and you know ethically.<\/p>\n\n\n\n<p>564<br>01:11:05.220 &#8211;&gt; 01:11:07.500<br>Professor_Ashley: Do the design hearts between you and God.<\/p>\n\n\n\n<p>565<br>01:11:08.970 &#8211;&gt; 01:11:10.860<br>Professor_Ashley: In terms of do the research.<\/p>\n\n\n\n<p>566<br>01:11:12.030 &#8211;&gt; 01:11:20.610<br>Professor_Ashley: that&#8217;s like i&#8217;d like and so that&#8217;s something that the IRB wouldn&#8217;t have to deal with because it&#8217;s product research, thank goodness, because that&#8217;s a that&#8217;s an ethical land mine.<\/p>\n\n\n\n<p>567<br>01:11:22.350 &#8211;&gt; 01:11:22.830<br>Professor_Ashley: But.<\/p>\n\n\n\n<p>568<br>01:11:24.210 &#8211;&gt; 01:11:35.610<br>Professor_Ashley: I think it really goes back to thinking about the core principles and in your your the Why are you doing this study, are you doing the study to make a profit.<\/p>\n\n\n\n<p>569<br>01:11:37.320 &#8211;&gt; 01:11:45.120<br>Professor_Ashley: I mean that&#8217;s some people value that right that&#8217;s not something that I value and I I would not, I would not participate or.<\/p>\n\n\n\n<p>570<br>01:11:45.930 &#8211;&gt; 01:12:02.670<br>Professor_Ashley: run a study according to what&#8217;s going to line my pockets, but you know if are you doing it because you&#8217;re a small indie company and you&#8217;re trying to make it big I mean that&#8217;s that&#8217;s a little bit more relatable a little bit more sympathetic, we can we can say.<\/p>\n\n\n\n<p>571<br>01:12:03.330 &#8211;&gt; 01:12:07.620<br>Shlomo Sher: I want to make it big by creating attic set of my players so they&#8217;ll spend a lot of money.<\/p>\n\n\n\n<p>572<br>01:12:08.580 &#8211;&gt; 01:12:13.410<br>A Ashcraft: or I but i&#8217;ve created a mechanic that i&#8217;m worried might be addicting.<\/p>\n\n\n\n<p>573<br>01:12:13.650 &#8211;&gt; 01:12:15.090<br>A Ashcraft: And I don&#8217;t want to do this.<\/p>\n\n\n\n<p>574<br>01:12:16.020 &#8211;&gt; 01:12:23.580<br>Shlomo Sher: Or, I must say, oh my cycle or psychologist who is concerned about addiction and just wants to do this for the sake of knowledge.<\/p>\n\n\n\n<p>575<br>01:12:25.050 &#8211;&gt; 01:12:27.060<br>Professor_Ashley: So how can you do that ethically mm hmm.<\/p>\n\n\n\n<p>576<br>01:12:27.150 &#8211;&gt; 01:12:36.150<br>Professor_Ashley: yeah um well make sure that your participants know that what they&#8217;re signing up for that they know that there&#8217;s the potential that they could become addicted.<\/p>\n\n\n\n<p>577<br>01:12:36.780 &#8211;&gt; 01:12:48.330<br>Professor_Ashley: and make sure you have some sort of onboarding and D boarding process where you can break them of that addictive habit and or provide support in terms of therapy or addiction counseling.<\/p>\n\n\n\n<p>578<br>01:12:48.840 &#8211;&gt; 01:12:55.500<br>Professor_Ashley: For them afterwards, should they actually become dependent on on this particular mechanic i&#8217;d say what do you think.<\/p>\n\n\n\n<p>579<br>01:12:57.150 &#8211;&gt; 01:13:04.230<br>Ann Johnson: yeah I think one of the ways that we reduce risk isn&#8217;t necessarily by preventing it, but maybe by treating it after the fact.<\/p>\n\n\n\n<p>580<br>01:13:05.340 &#8211;&gt; 01:13:14.940<br>Ann Johnson: So you know with those additional offerings of services that it&#8217;s like we as researchers aren&#8217;t trying to research, how you protect the services later, but we&#8217;re trying to do.<\/p>\n\n\n\n<p>581<br>01:13:15.240 &#8211;&gt; 01:13:20.190<br>Ann Johnson: Good by you, as the person who was in our study, if we can help you.<\/p>\n\n\n\n<p>582<br>01:13:20.640 &#8211;&gt; 01:13:35.610<br>Ann Johnson: Based on something that we&#8217;ve learned and and leave you better off than when you came here, or at least try to leave you better off than you know, maybe we&#8217;ve done our duty to help you and to help ourselves as researchers right to gain that knowledge.<\/p>\n\n\n\n<p>583<br>01:13:36.750 &#8211;&gt; 01:13:42.450<br>Professor_Ashley: yeah Dr Rachel co where it would be a great person to talk to she&#8217;s a research psychologist who&#8217;s done.<\/p>\n\n\n\n<p>584<br>01:13:42.990 &#8211;&gt; 01:13:50.190<br>Professor_Ashley: loads of research into video game ethics video game and violence and children she&#8217;s also a parent.<\/p>\n\n\n\n<p>585<br>01:13:50.490 &#8211;&gt; 01:14:03.570<br>Professor_Ashley: So she&#8217;s she&#8217;s kind of a talking head for these kinds of things which is really nice she also produce the video game debate book, which is all the controversy surrounding video game, so I can provide an introduction to her if you if you&#8217;d like she&#8217;s awesome.<\/p>\n\n\n\n<p>586<br>01:14:03.870 &#8211;&gt; 01:14:04.740<br>Shlomo Sher: We would looks like.<\/p>\n\n\n\n<p>587<br>01:14:05.640 &#8211;&gt; 01:14:07.740<br>Professor_Ashley: She doesn&#8217;t work for the University of utah.<\/p>\n\n\n\n<p>588<br>01:14:11.280 &#8211;&gt; 01:14:12.750<br>Ann Johnson: Which is a shame we.<\/p>\n\n\n\n<p>589<br>01:14:12.750 &#8211;&gt; 01:14:13.830<br>Ann Johnson: really want her to.<\/p>\n\n\n\n<p>590<br>01:14:18.510 &#8211;&gt; 01:14:21.570<br>Shlomo Sher: I have to say I mean this conversation really gave me.<\/p>\n\n\n\n<p>591<br>01:14:23.220 &#8211;&gt; 01:14:31.770<br>Shlomo Sher: A respect for how hard it is to do you know practical ethical research at some of the most controversial topics.<\/p>\n\n\n\n<p>592<br>01:14:32.820 &#8211;&gt; 01:14:34.890<br>Shlomo Sher: You know in video games.<\/p>\n\n\n\n<p>593<br>01:14:35.730 &#8211;&gt; 01:14:41.070<br>A Ashcraft: I agree, and I, and I feel like i&#8217;ve come away with a with a new set of lenses that I can I can apply.<\/p>\n\n\n\n<p>594<br>01:14:42.390 &#8211;&gt; 01:14:54.570<br>Professor_Ashley: One thing to be clear about, though, is that because it&#8217;s difficult and I don&#8217;t in terms of like the paperwork I don&#8217;t think it is that difficult I think it&#8217;s more about.<\/p>\n\n\n\n<p>595<br>01:14:55.050 &#8211;&gt; 01:15:13.290<br>Professor_Ashley: The thought experiments and thinking through your research design in a in an ethical way that&#8217;s challenging but you should still do it, not only because it makes you a better person, but because that research, study researching controversial things is really important, the the more.<\/p>\n\n\n\n<p>596<br>01:15:14.370 &#8211;&gt; 01:15:22.500<br>Professor_Ashley: Ethical kind of alarm bells that sound isn&#8217;t necessarily a deterrent, it means you&#8217;re thinking, the right things you&#8217;re asking the right questions.<\/p>\n\n\n\n<p>597<br>01:15:22.830 &#8211;&gt; 01:15:29.640<br>Professor_Ashley: And you&#8217;re putting your participants first and thinking about your research design, but it shouldn&#8217;t dissuade you from doing that research, you should just.<\/p>\n\n\n\n<p>598<br>01:15:29.970 &#8211;&gt; 01:15:46.200<br>Professor_Ashley: help encourage you to do that research ethically and your local institutional review board and whatever form that takes is friendly and and there to help you I, for some reason I think on campuses in particular IRB is get this reputation for being this like draconian.<\/p>\n\n\n\n<p>599<br>01:15:47.520 &#8211;&gt; 01:15:50.250<br>Professor_Ashley: You know bureaucracy that&#8217;s just there to ruin your day.<\/p>\n\n\n\n<p>600<br>01:15:51.510 &#8211;&gt; 01:15:59.670<br>Professor_Ashley: really not we want to see be successful because you know we&#8217;re researchers to and we&#8217;re really excited to generate knowledge it&#8217;s really important to us.<\/p>\n\n\n\n<p>601<br>01:16:02.370 &#8211;&gt; 01:16:09.840<br>Shlomo Sher: awesome i&#8217;m going to ask you guys if there was anything else that you guys think our listeners to know about the ethics of research and you must subject involving video games and I think.<\/p>\n\n\n\n<p>602<br>01:16:10.290 &#8211;&gt; 01:16:17.130<br>Shlomo Sher: Actually, that was that was a great answer to that are really unless you want to add anything to it and and we&#8217;d love to hear from you as well.<\/p>\n\n\n\n<p>603<br>01:16:17.340 &#8211;&gt; 01:16:20.040<br>Professor_Ashley: I have one quick thing that i&#8217;m that.<\/p>\n\n\n\n<p>604<br>01:16:21.150 &#8211;&gt; 01:16:34.320<br>Professor_Ashley: So much of research ethics is just not taught, so this is not necessarily ethics and games, but when I have students come through my user research class and and I tell them about research ethics and.<\/p>\n\n\n\n<p>605<br>01:16:34.890 &#8211;&gt; 01:16:40.440<br>Professor_Ashley: They you know they don&#8217;t necessarily say this Alex they&#8217;re very kind of sweet people and they wouldn&#8217;t hurt my feelings.<\/p>\n\n\n\n<p>606<br>01:16:40.770 &#8211;&gt; 01:16:45.660<br>Professor_Ashley: But I get the kind of why should we be learning about this we&#8217;re just studying video games and.<\/p>\n\n\n\n<p>607<br>01:16:46.110 &#8211;&gt; 01:16:56.370<br>Professor_Ashley: and made a point earlier that our history with research ethics in this country is absolutely atrocious and I would encourage everyone to when when they have the spoons.<\/p>\n\n\n\n<p>608<br>01:16:57.270 &#8211;&gt; 01:17:03.660<br>Professor_Ashley: which might not be anytime soon, because the world is difficult, but there is a book called medical apartheid by Harriet Washington.<\/p>\n\n\n\n<p>609<br>01:17:04.230 &#8211;&gt; 01:17:15.510<br>Professor_Ashley: And as part of my own self improvement work for black history month I decided to read that book it deals with race, particularly the.<\/p>\n\n\n\n<p>610<br>01:17:16.170 &#8211;&gt; 01:17:33.060<br>Professor_Ashley: Unfair unjust and disproportionate amount of medical research that has been done on black people throughout the United States history with without consent and it, I mean full full disclosure, it is a dark dark pocket is something that you need to.<\/p>\n\n\n\n<p>611<br>01:17:34.170 &#8211;&gt; 01:17:40.020<br>Professor_Ashley: prepare yourself for and do when you&#8217;re in a good headspace for sure, because it is, we have a lot to be.<\/p>\n\n\n\n<p>612<br>01:17:41.070 &#8211;&gt; 01:17:45.630<br>Professor_Ashley: To be ashamed of in terms of our history, but it&#8217;s very important that we know it.<\/p>\n\n\n\n<p>613<br>01:17:47.940 &#8211;&gt; 01:17:58.110<br>Ann Johnson: And if I could add on to that you know examining our history is really important it&#8217;s brought us to where we are and it&#8217;s helped us helped us to make better ethical decisions.<\/p>\n\n\n\n<p>614<br>01:17:58.620 &#8211;&gt; 01:18:12.210<br>Ann Johnson: However, what&#8217;s really interesting about video game research is how fast the technology changes, you all know this and when technology changes fast our ability to keep up ethically kind of struggle.<\/p>\n\n\n\n<p>615<br>01:18:12.840 &#8211;&gt; 01:18:20.370<br>Ann Johnson: So one of the things IRB is have to grapple with is that changing landscape of what&#8217;s acceptable what&#8217;s ethical what&#8217;s fair.<\/p>\n\n\n\n<p>616<br>01:18:21.780 &#8211;&gt; 01:18:28.680<br>Ann Johnson: Because our society changes, just like the technology changes, and so I would just encourage everybody to.<\/p>\n\n\n\n<p>617<br>01:18:29.160 &#8211;&gt; 01:18:36.870<br>Ann Johnson: Look at the potential for the future of being able to sit with ourselves and and and apply these ethical lenses.<\/p>\n\n\n\n<p>618<br>01:18:37.560 &#8211;&gt; 01:18:52.410<br>Ann Johnson: To how video game research changes over time what new research questions are going to come up because of that, but maybe also what new ethical quandary are we going to be put in because of it and that&#8217;s what I feel is incredibly interesting.<\/p>\n\n\n\n<p>619<br>01:18:53.700 &#8211;&gt; 01:19:15.570<br>Ann Johnson: about my field of study, and what I do today today but it&#8217;s also imperative that if we&#8217;re not going to repeat history by treating people badly, we need to continue to question the status quo and move the ethical conversation as fast as the technology is moving to.<\/p>\n\n\n\n<p>620<br>01:19:16.470 &#8211;&gt; 01:19:17.490<br>Shlomo Sher: Well, said.<\/p>\n\n\n\n<p>621<br>01:19:17.640 &#8211;&gt; 01:19:18.300<br>Professor_Ashley: yeah very.<\/p>\n\n\n\n<p>622<br>01:19:18.840 &#8211;&gt; 01:19:19.500<br>A Ashcraft: Hard agree.<\/p>\n\n\n\n<p>623<br>01:19:19.770 &#8211;&gt; 01:19:20.400<br>Shlomo Sher: All right.<\/p>\n\n\n\n<p>624<br>01:19:21.810 &#8211;&gt; 01:19:30.300<br>Shlomo Sher: All right, and Johnson Ashley rado Thank you so much for for coming on the show we really, really appreciate yay.<\/p>\n\n\n\n<p>625<br>01:19:30.810 &#8211;&gt; 01:19:32.070<br>Professor_Ashley: Thank you so much for having us.<\/p>\n\n\n\n<p>626<br>01:19:32.550 &#8211;&gt; 01:19:36.480<br>Shlomo Sher: Right really great podcast everybody.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>[Release Date: April 12, 2022]\u00a0There\u2019s lots of research going on about video games.\u00a0 Some of it involves product testing like VR games or the effectiveness<\/p>\n","protected":false},"author":1,"featured_media":864,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_FSMCFIC_featured_image_caption":"","_FSMCFIC_featured_image_nocaption":"","_FSMCFIC_featured_image_hide":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[4],"tags":[146,148,147],"class_list":["post-863","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-the-podcast","tag-irb","tag-research-ethics","tag-video-game-research"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/ethicsandvideogames.com\/wp-content\/uploads\/2022\/03\/40-3-w-logo-copy-w-logo-1.png?fit=1200%2C628&ssl=1","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/posts\/863","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=863"}],"version-history":[{"count":5,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/posts\/863\/revisions"}],"predecessor-version":[{"id":901,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/posts\/863\/revisions\/901"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=\/wp\/v2\/media\/864"}],"wp:attachment":[{"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=863"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=863"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ethicsandvideogames.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=863"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}