{"id":296,"date":"2025-11-20T11:56:13","date_gmt":"2025-11-20T11:56:13","guid":{"rendered":"https:\/\/www.ieeesmc.org\/cai-2026\/?page_id=296"},"modified":"2025-12-19T20:30:58","modified_gmt":"2025-12-19T20:30:58","slug":"tutorial-7-sustainable-hyperparameter-optimization","status":"publish","type":"page","link":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/","title":{"rendered":"Tutorial 7: Sustainable Hyperparameter Optimization"},"content":{"rendered":"<p style=\"font-size: 1.2em; font-weight: bold;\">Speakers<\/p>\n<ul>\n<li><a href=\"mailto:l.bliek@tue.nl\">Laurens Bliek<\/a> (Department of Industrial Engineering &amp; Innovation Sciences. Eindhoven University of Technology (TU\/e))<\/li>\n<li><a href=\"mailto:Sasan.amini@uhasselt.be\">Sasan Amini<\/a> (Data Science Institute. Hasselt University)<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p style=\"font-size: 1.2em; font-weight: bold;\">Abstract<\/p>\n<p>Hyperparameter Optimization (HPO) plays a pivotal role in modern machine learning pipelines, determining model performance, generalization, and stability. However, HPO is inherently computationally intensive, resulting in significant energy consumption and environmental cost. As models and datasets grow, this computational burden scales dramatically, making traditional HPO practices unsustainable.<\/p>\n<p>This tutorial provides an overview of state-of-the-art HPO methods, with a particular emphasis on Bayesian Optimization (BO) as a data-efficient and principled framework for black-box optimization. We will begin by revisiting the theoretical underpinnings of BO, including surrogate modeling, acquisition functions, and extensions to constrained and multi-objective settings. Building upon this foundation, we introduce the emerging research area of sustainable HPO, focusing on approaches that explicitly target energy and resource efficiency, such as multi-fidelity modeling. This way, the tutorial contributes to the vertical area of Sustainable and Trustworthy AI.<\/p>\n<p>&nbsp;<\/p>\n<p style=\"font-size: 1.2em; font-weight: bold;\">Target Audience<\/p>\n<p>The tutorial targets researchers, graduate students, and practitioners in machine learning, optimization, and AI systems design who are interested in the methodological and practical aspects of hyperparameter optimization and energy &#8211; efficient AI. Participants are expected to have:<\/p>\n<ul>\n<li>A general understanding of supervised learning (e.g., regression, classification) and model training workflows.<\/li>\n<li>Basic familiarity with optimization concepts such as search spaces, objective functions, and performance evaluation.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p style=\"font-size: 1.2em; font-weight: bold;\">Outline and Description of the Tutorial<\/p>\n<p><strong>Part I<\/strong> introduces the principles of Hyperparameter Optimization (HPO), focusing on Bayesian Optimization (BO) as a data-efficient framework for black-box optimization. (1.5hrs)<\/p>\n<p><strong>Part II<\/strong> presents the emerging area of sustainable HPO, discussing methods that reduce computational and energy costs. (1,5hrs)<\/p>\n<p><strong>Part III<\/strong> offers a short hands-on exercise with an example application of sustainable HPO. (1 hrs)<\/p>\n<p>&nbsp;<\/p>\n<p style=\"font-size: 1.2em; font-weight: bold;\">Reading List<\/p>\n<ul>\n<li>Bliek, L. (2022). A survey on sustainable surrogate-based optimisation. Sustainability.<\/li>\n<li>Garnett, R. (2023). Bayesian optimization. Cambridge University Press.<\/li>\n<li>Bischl, B., Binder, M., Lang, M., Pielok, T., Richter, J., Coors, S., &#8230; &amp; Lindauer, M. (2023). Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 13(2), e1484.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p style=\"font-size: 1.2em; font-weight: bold;\">Vertical<\/p>\n<p>Sustainable and Trustworthy AI<\/p>\n<p>&nbsp;<\/p>\n<p style=\"font-size: 1.2em; font-weight: bold;\">Timeline<\/p>\n<p>4 hours<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Speakers Laurens Bliek (Department of Industrial Engineering &amp; Innovation Sciences. Eindhoven University of Technology (TU\/e)) Sasan Amini (Data Science Institute. Hasselt University) &nbsp; Abstract Hyperparameter Optimization (HPO) plays a pivotal role in modern machine learning pipelines, determining model performance, generalization, and stability. However, HPO is inherently computationally intensive, resulting in significant energy consumption and environmental&#8230;<\/p>\n","protected":false},"author":2627,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-296","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Sustainable Hyperparameter Optimization<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Sustainable Hyperparameter Optimization\" \/>\n<meta property=\"og:description\" content=\"Speakers Laurens Bliek (Department of Industrial Engineering &amp; Innovation Sciences. Eindhoven University of Technology (TU\/e)) Sasan Amini (Data Science Institute. Hasselt University) &nbsp; Abstract Hyperparameter Optimization (HPO) plays a pivotal role in modern machine learning pipelines, determining model performance, generalization, and stability. However, HPO is inherently computationally intensive, resulting in significant energy consumption and environmental...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/\" \/>\n<meta property=\"og:site_name\" content=\"IEEE CAI 2026\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-19T20:30:58+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/\",\"url\":\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/\",\"name\":\"Sustainable Hyperparameter Optimization\",\"isPartOf\":{\"@id\":\"https:\/\/www.ieeesmc.org\/cai-2026\/#website\"},\"datePublished\":\"2025-11-20T11:56:13+00:00\",\"dateModified\":\"2025-12-19T20:30:58+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.ieeesmc.org\/cai-2026\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Tutorial 7: Sustainable Hyperparameter Optimization\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.ieeesmc.org\/cai-2026\/#website\",\"url\":\"https:\/\/www.ieeesmc.org\/cai-2026\/\",\"name\":\"IEEE CAI 2026\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.ieeesmc.org\/cai-2026\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Sustainable Hyperparameter Optimization","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/","og_locale":"en_US","og_type":"article","og_title":"Sustainable Hyperparameter Optimization","og_description":"Speakers Laurens Bliek (Department of Industrial Engineering &amp; Innovation Sciences. Eindhoven University of Technology (TU\/e)) Sasan Amini (Data Science Institute. Hasselt University) &nbsp; Abstract Hyperparameter Optimization (HPO) plays a pivotal role in modern machine learning pipelines, determining model performance, generalization, and stability. However, HPO is inherently computationally intensive, resulting in significant energy consumption and environmental...","og_url":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/","og_site_name":"IEEE CAI 2026","article_modified_time":"2025-12-19T20:30:58+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/","url":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/","name":"Sustainable Hyperparameter Optimization","isPartOf":{"@id":"https:\/\/www.ieeesmc.org\/cai-2026\/#website"},"datePublished":"2025-11-20T11:56:13+00:00","dateModified":"2025-12-19T20:30:58+00:00","breadcrumb":{"@id":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ieeesmc.org\/cai-2026\/tutorial-7-sustainable-hyperparameter-optimization\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ieeesmc.org\/cai-2026\/"},{"@type":"ListItem","position":2,"name":"Tutorial 7: Sustainable Hyperparameter Optimization"}]},{"@type":"WebSite","@id":"https:\/\/www.ieeesmc.org\/cai-2026\/#website","url":"https:\/\/www.ieeesmc.org\/cai-2026\/","name":"IEEE CAI 2026","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ieeesmc.org\/cai-2026\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/pages\/296","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/users\/2627"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/comments?post=296"}],"version-history":[{"count":0,"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/pages\/296\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.ieeesmc.org\/cai-2026\/wp-json\/wp\/v2\/media?parent=296"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}