[visionlist] Call-for-Participation: ImageCLEF Detection and Recognition of Hand Drawn Website UIs Task

[Bogdan Ionescu]

[Apologies for multiple postings]

ImageCLEFdrawnUI
https://www.imageclef.org/2021/drawnui


*** CALL FOR PARTICIPATION ***
Building websites requires a very specific set of skills. Currently,
the two main ways to achieve this is either by using a visual website
builder or by programming. Both approaches have a steep learning
curve. Enabling people to create websites by drawing them on a
whiteboard or on a piece of paper would make the webpage building
process more accessible.

A first step in capturing the intent expressed by a user through a
wireframe is to correctly detect a set of atomic user interface
elements (UI) in their drawings. The bounding boxes and labels
resulted from this detection step can then be used to accurately
generate a website layout using various heuristics.

In this context, the detection and recognition of hand drawn website
UIs task addresses the problem of automatically recognizing the hand
drawn objects representing website UIs, which are further used to be
translated automatically into website code.

*** TASKS ***
Given a set of images of hand drawn UIs or webpages screenshots,
participants are required to develop machine learning techniques that
are able to predict the exact position and type of UI elements.

*** DATA SETS ***
#Wireframe Task
4,291 hand drawn images inspired from mobile application screenshots
and actual web pages. Each image comes with the manual labeling of the
positions of the bounding boxes corresponding to each UI element and
its type.
?#Screenshots Task
9,630 screenshots of sections and full pages from high quality
websites gathered using an in-house parser. Each image comes with the
manual labeling of the positions of the bounding boxes corresponding
to each UI element and its type.

*** METRICS ***
The performance of the algorithms will be evaluated using the standard
mean Average Precision over IoU .5, commonly used in object detection.

*** IMPORTANT DATES ***
- Task registration opens: November 16, 2020
- Development data release: January 25, 2021
- Test data release: March 15, 2021
- Run submission: May 7, 2021
- Working notes submission: May 28, 2021
- CLEF 2021 conference: September 21-24, Bucharest, Romania

*** REGISTER ***
https://www.imageclef.org/2021#registration

*** OVERALL COORDINATION ***
Dimitri Fichou, teleportHQ, Cluj Napoca, Romania
Raul Berari, teleportHQ, Cluj Napoca, Romania
Andrei Tauteanu, teleportHQ, Cluj Napoca, Romania
Paul Brie, teleportHQ, Cluj Napoca, Romania
Mihai Dogariu, University Politehnica of Bucharest, Romania
Liviu-Daniel Stefan, University Politehnica of Bucharest, Romania
Mihai-Gabriel Constantin, University Politehnica of Bucharest, Romania
Bogdan Ionescu, University Politehnica of Bucharest, Romania


On behalf of the Organizers,
Bogdan Ionescu
https://www.AIMultimediaLab.ro/