[visionlist] Are there any working interactive demos of SDT decision space and ROC space on the web?

[Tom Wallis]

Hi Les,

I made some .gifs for teaching recently that are not quite what you're
after but may nevertheless be of help. They show the effect of (1) changing
criterion, (2) changing sensitivity and (3) changing equal-variance
assumption respectively. Sorry about the rather large file sizes for email
exchange; if they're bounced from this list I will find another way to make
them available.

The movies were made in R. You can find the code here:
http://gist.github.com/tomwallis/76739322c9ff879b409e337c47e18700.

The axis scaling could be improved.

Best

Tom
--
Thomas Wallis, PhD
Vertretungsprofessor (Acting Professor)
Wilhelm-Schickard Institute for Computer Science (Informatik)

and

Project Leader, SFB 1233 Robust Vision
AG Bethge
Max Planck Institute for Intelligent Systems
Max-Planck-Ring 4
72076 Tübingen
Germany
Tel: 07071 2988906

www.tomwallis.info


On Sun, Sep 2, 2018 at 11:38 PM Lester Loschky <loschky at ksu.edu> wrote:

> Hi Everybody,
>
> For a long time, I've used interactive web-based demonstrations of Signal
> Detection Theory (SDT) decision space and ROC space to teach students about
> the underlying statistical theory of SDT.  So, I would like to start this
> posting by giving a big "Thank You!!" to the folks at Claremont Graduate
> University, Ann Bisantz, John Krantz, and Garrett Neske who have made it
> possible to do so!  That has been a great educational gift from each of
> them to the world wide community.
>
> Having said that, 3 of the 4 ones I ones I know of were written in Java,
> and are now no longer able to be run due to being blocked by Java security
> (with no possibility of unblocking them).
>
> For example, at Claremont Graduate University, the Web Interface for
> Statistics Education (WISE) website had a really nice demo of the SDT
> decision space and how it maps onto the ROC space:
>
> http://wise.cgu.edu/portfolio/demo-signal-detection-theory/
>
> However, that Java applet no longer runs due to being blocked by Java
> security.  So, you get an error message if you try to run it, which says:
> "Application Blocked. Click for details"
>
> I used to be able to add that Java Applet to my trusted Java exceptions in
> the Security tab of Preferences in my web browser (Safari).  However, while
> I can currently add the WISE website to the exceptions list, I can no
> longer add that particular page to the list.  The folks at WISE are aware
> of this, and have the following notice about it on their Troubleshooting
> page:
>
> Enable JavaScript
>> You no longer can unblock Java for specific pages. The applets written in
>> JavaScript will work, but the older Java applets will not.
>
>
> Evidently, that demo is an older Java applet that was not written in
> JavaScript.
>
> Similarly, I have had the same problem for John Krantz's SDT demos at
> Hanover College:
> https://psych.hanover.edu/JavaTest/SDT/outcomes.html
> https://psych.hanover.edu/JavaTest/SDT/ROC.html
>
> Likewise, there used to be a really nice web-based interactive demo of the
> SDT decision space and ROC space by Ann Bisantz at SUNY Buffalo.  However,
> I can no longer find it on the web (and if it was written as an older Java
> applet, probably would not run now).
>
> Garrett Neske has very kindly shared a nice interactive demo of the SDT
> decision space and ROC curve on the Wolfram (Mathematica) Demonstrations
> Project, which you can download and run using the Wolfram CDF player.
> However, unlike the Claremont WISE and Bisantz interactive demos, it does
> not report d' and c.  Having said that, it does give H and F rates out of
> 1,000 signal present and absent trials each, so one can calculate d' and c
> with students in class, but it isn't automatic as with the other
> interactive demos.  I guess from an educational standpoint it's a trade-off
> between a) fluidity of demonstrating the concepts and b) demonstrating how
> to calculate d' and c.  Currently, this is the interactive demo I use in
> class (hats off to Garrett).
>
> However, out of curiosity, I'm wondering, are there any other web-based
> demos of the SDT decision space and ROC space that currently work?
>
> Best wishes,
>
> Les Loschky
>
> --
> Lester Loschky
> Professor
> Associate Director, Cognitive and Neurobiological Approaches to Plasticity
> Center
> Department of Psychological Sciences
> 471 Bluemont Hall
> 1114 Mid-Campus Dr North
> Kansas State University
> Manhattan, KS  66506-5302
> email: loschky at ksu.edu
> research page: https://www.k-state.edu/psych/research/loschkylester.html
> lab page: http://www.k-state.edu/psych/vcl/index.html
> _______________________________________________
> visionlist mailing list
> visionlist at visionscience.com
> http://visionscience.com/mailman/listinfo/visionlist_visionscience.com
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180906/68f1d4cf/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sdt_all_together_now_1.gif
Type: image/gif
Size: 1757687 bytes
Desc: not available
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180906/68f1d4cf/attachment-0003.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sdt_all_together_now_3.gif
Type: image/gif
Size: 1725638 bytes
Desc: not available
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180906/68f1d4cf/attachment-0004.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sdt_all_together_now_2.gif
Type: image/gif
Size: 1745506 bytes
Desc: not available
URL: <http://visionscience.com/pipermail/visionlist_visionscience.com/attachments/20180906/68f1d4cf/attachment-0005.gif>