[visionlist] Are there any working interactive demos of SDT decision space and ROC space on the web?

[Kenneth Knoblauch]

Hi, 

Several years ago, I wrote a simple web app in R
(https://www.r-project.org) using the shiny package
(https://cran.r-project.org/web/packages/shiny/index.html) for an STD
demonstrator.  I have used it in courses and tutorials that I have given
and have shared the code when asked.  To run it, you have to put the two
attached files in a directory.  Then run R from that directory (or set
that directory to your working directory from within R)  and load the
shiny package (after having previously installed it and any of its
dependencies) with the command: library(shiny).  Then from the command
line type: runApp().  It should open a browser window with sliders and
plots that are self-evident.  I haven't looked at the code in a long
while, but it worked when I just tried it using Safari on a Mac running
High Sierra. 

best, 

Ken

-- 
Kenneth Knoblauch
Inserm U1208
Stem-cell and Brain Research Institute
18 avenue du Doyen Lépine
69500 Bron
France
tel: +33 (0)4 72 91 34 77
fax: +33 (0)4 72 91 34 61
portable: +33 (0)6 84 10 64 10
http://www.sbri.fr/user/1453 

On 02-09-2018 22:18, Lester Loschky wrote:

> Hi Everybody, 
> 
> For a long time, I've used interactive web-based demonstrations of Signal Detection Theory (SDT) decision space and ROC space to teach students about the underlying statistical theory of SDT.  So, I would like to start this posting by giving a big "Thank You!!" to the folks at Claremont Graduate University, Ann Bisantz, John Krantz, and Garrett Neske who have made it possible to do so!  That has been a great educational gift from each of them to the world wide community. 
> 
> Having said that, 3 of the 4 ones I ones I know of were written in Java, and are now no longer able to be run due to being blocked by Java security (with no possibility of unblocking them).   
> 
> For example, at Claremont Graduate University, the Web Interface for Statistics Education (WISE) website had a really nice demo of the SDT decision space and how it maps onto the ROC space: 
> 
> http://wise.cgu.edu/portfolio/demo-signal-detection-theory/ 
> 
> However, that Java applet no longer runs due to being blocked by Java security.  So, you get an error message if you try to run it, which says: 
> "Application Blocked. Click for details" 
> 
> I used to be able to add that Java Applet to my trusted Java exceptions in the Security tab of Preferences in my web browser (Safari).  However, while I can currently add the WISE website to the exceptions list, I can no longer add that particular page to the list.  The folks at WISE are aware of this, and have the following notice about it on their Troubleshooting page: 
> 
>> Enable JavaScript
>> You no longer can unblock Java for specific pages. The applets written in JavaScript will work, but the older Java applets will not.
> 
> Evidently, that demo is an older Java applet that was not written in JavaScript.  
> 
> Similarly, I have had the same problem for John Krantz's SDT demos at Hanover College: 
> https://psych.hanover.edu/JavaTest/SDT/outcomes.html 
> https://psych.hanover.edu/JavaTest/SDT/ROC.html 
> 
> Likewise, there used to be a really nice web-based interactive demo of the SDT decision space and ROC space by Ann Bisantz at SUNY Buffalo.  However, I can no longer find it on the web (and if it was written as an older Java applet, probably would not run now).  
> 
> Garrett Neske has very kindly shared a nice interactive demo of the SDT decision space and ROC curve on the Wolfram (Mathematica) Demonstrations Project, which you can download and run using the Wolfram CDF player.  However, unlike the Claremont WISE and Bisantz interactive demos, it does not report d' and c.  Having said that, it does give H and F rates out of 1,000 signal present and absent trials each, so one can calculate d' and c with students in class, but it isn't automatic as with the other interactive demos.  I guess from an educational standpoint it's a trade-off between a) fluidity of demonstrating the concepts and b) demonstrating how to calculate d' and c.  Currently, this is the interactive demo I use in class (hats off to Garrett). 
> 
> However, out of curiosity, I'm wondering, are there any other web-based demos of the SDT decision space and ROC space that currently work? 
> 
> Best wishes, 
> 
> Les Loschky 
> -- 
> 
> Lester Loschky 
> 
> Professor 
> Associate Director, Cognitive and Neurobiological Approaches to Plasticity Center
> Department of Psychological Sciences
> 471 Bluemont Hall 
> 
> 1114 Mid-Campus Dr North Kansas State University
> Manhattan, KS  66506-5302  
> email: loschky at ksu.edu 
> research page: https://www.k-state.edu/psych/research/loschkylester.html 
> lab page: http://www.k-state.edu/psych/vcl/index.html 
> _______________________________________________
> visionlist mailing list
> visionlist at visionscience.com
> http://visionscience.com/mailman/listinfo/visionlist_visionscience.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180903/68e11706/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: server.R
Type: text/x-pascal
Size: 2520 bytes
Desc: not available
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180903/68e11706/attachment-0001.bin>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: ui.R
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180903/68e11706/attachment-0001.ksh>