[visionlist] Are there any working interactive demos of SDT decision space and ROC space on the web?

[Timothy Vickery]

Hi Lester,

I hacked a little SDT/ROC thing together in Javascript a while back. Needs
some polish but might help with at least part of what you're looking for,
requires zero effort to host, and should run in any modern browser. If you
have recommendations for improving it / making it more useful, I'd be
delighted to hear them.
http://cogneurolab.org/tools/SDT_withROC.html

-Tim

On Mon, Sep 3, 2018 at 9:01 AM Kenneth Knoblauch <ken.knoblauch at inserm.fr>
wrote:

> Hi,
>
> Several years ago, I wrote a simple web app in R (
> https://www.r-project.org) using the shiny package (
> https://cran.r-project.org/web/packages/shiny/index.html) for an STD
> demonstrator.  I have used it in courses and tutorials that I have given
> and have shared the code when asked.  To run it, you have to put the two
> attached files in a directory.  Then run R from that directory (or set that
> directory to your working directory from within R)  and load the shiny
> package (after having previously installed it and any of its dependencies)
> with the command: library(shiny).  Then from the command line type:
> runApp().  It should open a browser window with sliders and plots that are
> self-evident.  I haven't looked at the code in a long while, but it worked
> when I just tried it using Safari on a Mac running High Sierra.
>
> best,
>
> Ken
> --
> Kenneth Knoblauch
> Inserm U1208
> Stem-cell and Brain Research Institute
> 18 avenue du Doyen Lépine
> 69500 Bron
> France
> tel: +33 (0)4 72 91 34 77
> fax: +33 (0)4 72 91 34 61
> portable: +33 (0)6 84 10 64 10
> http://www.sbri.fr/user/1453
>
>
> On 02-09-2018 22:18, Lester Loschky wrote:
>
> Hi Everybody,
>
> For a long time, I've used interactive web-based demonstrations of Signal
> Detection Theory (SDT) decision space and ROC space to teach students about
> the underlying statistical theory of SDT.  So, I would like to start this
> posting by giving a big "Thank You!!" to the folks at Claremont Graduate
> University, Ann Bisantz, John Krantz, and Garrett Neske who have made it
> possible to do so!  That has been a great educational gift from each of
> them to the world wide community.
>
> Having said that, 3 of the 4 ones I ones I know of were written in Java,
> and are now no longer able to be run due to being blocked by Java security
> (with no possibility of unblocking them).
>
> For example, at Claremont Graduate University, the Web Interface for
> Statistics Education (WISE) website had a really nice demo of the SDT
> decision space and how it maps onto the ROC space:
>
> http://wise.cgu.edu/portfolio/demo-signal-detection-theory/
>
> However, that Java applet no longer runs due to being blocked by Java
> security.  So, you get an error message if you try to run it, which says:
> "Application Blocked. Click for details"
>
> I used to be able to add that Java Applet to my trusted Java exceptions in
> the Security tab of Preferences in my web browser (Safari).  However, while
> I can currently add the WISE website to the exceptions list, I can no
> longer add that particular page to the list.  The folks at WISE are aware
> of this, and have the following notice about it on their Troubleshooting
> page:
>
>
>> Enable JavaScript
>> You no longer can unblock Java for specific pages. The applets written in
>> JavaScript will work, but the older Java applets will not.
>
>
> Evidently, that demo is an older Java applet that was not written in
> JavaScript.
>
> Similarly, I have had the same problem for John Krantz's SDT demos at
> Hanover College:
> https://psych.hanover.edu/JavaTest/SDT/outcomes.html
> https://psych.hanover.edu/JavaTest/SDT/ROC.html
>
> Likewise, there used to be a really nice web-based interactive demo of the
> SDT decision space and ROC space by Ann Bisantz at SUNY Buffalo.  However,
> I can no longer find it on the web (and if it was written as an older Java
> applet, probably would not run now).
>
> Garrett Neske has very kindly shared a nice interactive demo of the SDT
> decision space and ROC curve on the Wolfram (Mathematica) Demonstrations
> Project, which you can download and run using the Wolfram CDF player.
> However, unlike the Claremont WISE and Bisantz interactive demos, it does
> not report d' and c.  Having said that, it does give H and F rates out of
> 1,000 signal present and absent trials each, so one can calculate d' and c
> with students in class, but it isn't automatic as with the other
> interactive demos.  I guess from an educational standpoint it's a trade-off
> between a) fluidity of demonstrating the concepts and b) demonstrating how
> to calculate d' and c.  Currently, this is the interactive demo I use in
> class (hats off to Garrett).
>
> However, out of curiosity, I'm wondering, are there any other web-based
> demos of the SDT decision space and ROC space that currently work?
>
> Best wishes,
>
> Les Loschky
>
> --
> Lester Loschky
> Professor
> Associate Director, Cognitive and Neurobiological Approaches to Plasticity
> Center
> Department of Psychological Sciences
> 471 Bluemont Hall
> 1114 Mid-Campus Dr North
> Kansas State University
> Manhattan, KS  66506-5302
> email: loschky at ksu.edu
> research page: https://www.k-state.edu/psych/research/loschkylester.html
> lab page: http://www.k-state.edu/psych/vcl/index.html
>
> _______________________________________________
> visionlist mailing list
> visionlist at visionscience.com
> http://visionscience.com/mailman/listinfo/visionlist_visionscience.com
>
> _______________________________________________
> visionlist mailing list
> visionlist at visionscience.com
> http://visionscience.com/mailman/listinfo/visionlist_visionscience.com
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180904/8825b5f5/attachment-0001.html>