<div dir="ltr"><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">[Apologies for multiple posts; please distribute to interested people!]</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26);min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26);min-height:15px"><span style="font-kerning:none"></span><br></p><p style="margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal"><span style="font-kerning:none"><font color="#1a1a1a">We are looking for applicants for a fully funded PhD (</font><span style="color:rgb(33,37,41);font-family:Inter,Arial,sans-serif">£20,700</span><font color="#1a1a1a"> per annum bursary plus the payment of the student fees) in the areas of Continual and Open-ended Reinforcement Learning at the Computer Science Department of the University of Hertfordshire, United Kingdom </font><font color="#ff0000">(d</font></span><span style="color:rgb(251,0,7);font-size:13px">eadline</span><b style="color:rgb(251,0,7);font-size:13px"> </b><span style="color:rgb(251,0,7);font-size:13px">14/11/2025</span><span style="color:rgb(251,0,7);font-size:13px;text-decoration:underline">)</span><font color="#1a1a1a">.</font></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none"><b>*PhD Project*</b></span></p><div class="gmail-page" title="Page 1" style="color:rgb(0,0,0)"><div class="gmail-section"><div class="gmail-layoutArea"><div class="gmail-column"><p><span style="font-family:Helvetica">Recent advancements in Artificial Intelligence (AI) have resolved challenges once deemed insurmountable just a decade ago, and RL is at the core of this breakthrough. However, most RL methods still struggle to operate effectively in truly open-ended, non-stationary environments. </span><span style="font-family:Helvetica">This project will push the boundaries of RL by investigating how agents can continuously learn and adapt over time; how they can autonomously develop and flexibly apply an ever-expanding repertoire of skills across various tasks; and what representations allow them to do this efficiently. Addressing these questions is crucial for creating AI systems that, despite limited computational resources, can sustain autonomous learning and adaptation in ever-changing environments throughout their lifetime—becoming increasingly knowledgeable and capable. </span><span style="font-family:Helvetica">The selected candidate will have the opportunity to master and contribute to cutting- edge techniques in deep reinforcement learning, incorporating principles from probabilistic machine learning, information theory, intrinsic motivation, continual and open-ended learning frameworks. The project will employ computer games as benchmarking tools and/or apply its findings to robotic systems (in simulations or on real-world platforms), including manipulators, intelligent autonomous vehicles, and humanoid robots.</span><span style="font-family:Helvetica">This PhD project offers a unique chance to explore some of the most profound and fascinating questions in artificial intelligence today, providing the opportunity to make a significant contribution to a field at the forefront of AI research.</span></p></div></div></div></div><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none"><b>*Requirements*</b></span></p><div class="gmail-page" title="Page 1" style="color:rgb(0,0,0)"><div class="gmail-section"><div class="gmail-layoutArea"><div class="gmail-column"><p><span style="font-family:Helvetica">We are looking for a student who is motivated and passionate about Artificial Intelligence. A background in computer science or mathematics, together with strong programming skills, are essential requirements. Experience in reinforcement learning or robotics are desirable and will be considered a plus during the selection process. The applicant will be expected to disseminate her/his work publishing scientific articles and/or participating at international conferences. To be fluent in English is mandatory.</span></p></div></div></div></div><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none"><b>*Where*</b></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">The PhD will take place in the Adaptive System research group of the Computer Science department of the University of Hertfordshire, United Kingdom. The group is specialised in probabilistic/information-theoretic approaches to Artificial Intelligence, used for a wide range of applications such as robotics, video-games and cognitive modelling.</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">According to the Research Excellence Framework 2021, the University of Hertfordshire is ranked in the top 25% of all UK universities for research impact and research in Computer Science has been recognised as excellent, with 90% of the research submitted and all of the research impact rated as internationally excellent or world leading. The University of Hertfordshire has ranked second in the UK 2023 Postgraduate Taught Experience survey, providing a very stimulating environment, offering a large number of specialised and interdisciplinary seminars as well as general training and researcher development opportunities. The University is situated in Hatfield, in the green belt just 25 minutes by train to London.</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none"><b>*How to Apply*</b></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">The application must be done following the procedure indicated in this website:</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(16,60,192)"><span style="text-decoration:underline;font-kerning:none"><a href="https://www.herts.ac.uk/study/schools-of-study/physics-engineering-and-computer-science/engineering-and-computer-science/research-in-engineering-and-computer-science/the-phd-programme-in-computer-science" target="_blank">https://www.herts.ac.uk/study/schools-of-study/physics-engineering-and-computer-science/engineering-and-computer-science/research-in-engineering-and-computer-science/the-phd-programme-in-computer-science<span style="font-kerning:none"></span></a></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">Interested applicants may want to contact Dr. Nicola Catenacci Volpi (<a href="mailto:n.catenacci-volpi@herts.ac.uk" target="_blank"><span style="font-kerning:none;color:rgb(16,60,192)">n.catenacci-volpi@herts.ac.uk</span></a>) to discuss the project, the PhD program at the University of Hertfordshire and details about the application process.</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(251,0,7)"><span style="font-kerning:none"><b>*Deadline*</b></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(251,0,7)"><span style="text-decoration:underline;font-kerning:none">14/11/2025</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(251,0,7)"><span style="text-decoration:underline;font-kerning:none"><br></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(251,0,7)"><span style="text-decoration:underline;font-kerning:none"><br></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none"><b>-----------------------------------</b></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"><b></b></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">Dr. Nicola Catenacci Volpi, PhD</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;min-height:15px"><span style="font-kerning:none"></span><br></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">Research Fellow in Information Theory for AI & Robotics</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">Adaptive Systems Research Group</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">The University of Hertfordshire</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">Department of Computer Science</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">College Lane</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">Hatfield, Hertfordshire AL10 9AB</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(26,26,26)"><span style="font-kerning:none">United Kingdom</span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(251,0,7)"><span style="text-decoration:underline;font-kerning:none"></span></p><p style="font-size:13px;margin:0px;font-stretch:normal;line-height:normal;font-family:Arial;font-size-adjust:none;font-kerning:auto;font-variant-alternates:normal;font-variant-ligatures:normal;font-variant-numeric:normal;font-variant-east-asian:normal;font-feature-settings:normal;color:rgb(16,60,192)"><span style="font-kerning:none;color:rgb(26,26,26)">E-mail:<span class="gmail-Apple-converted-space"> </span><a href="mailto:n.catenacci-volpi@herts.ac.uk" target="_blank"><span style="font-kerning:none;color:rgb(16,60,192)">n.catenacci-volpi@herts.ac.uk</span></a></span></p></div>