from xtream (Italy)
About speaker
Head of AI at xtream
Engineer, researcher, entrepreneur. Emanuele earned his PhD in AI by researching time series forecasting in the energy field. He was a guest researcher at EPFL Lausanne, and he's now the Head of AI at xtream, where he solves business problems with AI.
About speakers company
xtream is a small software house in Italy that develops AI solutions. Founded in 2018, it is now a partner of corporations such as Plenitude, A2A, Credem, Yamaha, Lavazza, Illimity, and scaleups such as WeRoad, Credimi, and Senso.
This talk showcases the use of serverless computing to solve large-scale optimization problems efficiently.
Starting from a real case study, we discuss different cloud-based architectures and we show how cloud functions enable a 96% reduction in elapsed time while keeping the cost low.
Solving large-scale optimization is challenging.
However, some optimization problems can be easily parallelized. In this case, serverless computing can drastically cut the elapsed time, while keeping the cost low.
In this talk, we consider a real case study. While creating power market scenarios, we need to find the optimal way of using power storage facilities.
This results in a convex optimization problem, where the power exchanged between each facility and the grid in each hour is an optimization variable. Over a scenario range of 50 years, this generates hundreds of thousands of variables.
Fortunately, the problem can be split into subproblems which can be solved in parallel.
Nonetheless, a conventional solution, based on a 16-core virtual machine, requires about 2 hours to perform the computations. We show how a serverless approach based on cloud functions is capable of cutting the elapsed time by 96% while keeping the operating costs as low as 3€ per run.
Finally, we show how to connect the parallel optimization module to the rest of the scenario processing pipeline, implemented in AirFlow.
After attending this talk, you will be aware of the capabilities of serverless for high-performance computing, and you will have a better feeling about how to design a cloud architecture.
The Program Committee has not yet taken a decision on this talk
Utku Özdemir
Sidero Labs
Adrian Kodja
softgarden e-recruiting GmbH
Federico Fregosi
OpsGuru
Geetha Anne
Temporal Technologies
Florian Lenz
neocentric GmbH - Azure Cloud Developer / Architect
Vamsi Krishna Rao
Salesforce
Andrii Raikov
Delivery Hero SE
Vinit Dhatrak
Docusign
Vijaykumar Jangamashetti
Florian Lenz
neocentric GmbH - Azure Cloud Developer / Architect
Ambesh Singh
Visionet Systems Deutschland
Florian Lenz
neocentric GmbH - Azure Cloud Developer / Architect
Joachim Aumann
Amazon Web Services
Aman Sharma
Lamatic.ai
Alexander Gilevich
EPAM
Mons Anderson
Exness
Neel Bhatt
RTL/Buienradar
Florian Lenz
neocentric GmbH - Azure Cloud Developer / Architect
Alina Krasavina
Delivery hero
Joachim Aumann
Amazon Web Services
Alexandre Touret
Worldline
Joachim Aumann
Amazon Web Services
Ivan Koveshnikov
Gcore
Raphael Semeteys
Worldline
Viktor Vedmich
Amazon Web Services
Tech Internals Conf is the leading conference for developers of complex and highly loaded systems
Participation options
Offline
The price is soaring —> the closer the conference is, the more it costs.
The current price of a ticket is —> 360 EUR
If you have any questions you can reach out to our support service —> support@internals.tech
Changed your mind?
Please tell us why.
Thank you for your reply!
Professional conference for developers of high-load systems