{"id":145574,"date":"2026-07-01T08:58:21","date_gmt":"2026-07-01T00:58:21","guid":{"rendered":"https:\/\/www.curtin.edu.au\/research\/?post_type=hdr-r-projects&#038;p=145574"},"modified":"2026-07-01T08:58:21","modified_gmt":"2026-07-01T00:58:21","slug":"taming-cloud-service-variability-performance-modelling-for-intelligent-ai-ml-service-selection","status":"publish","type":"hdr-r-projects","link":"https:\/\/www.curtin.edu.au\/research\/hdr-r-projects\/taming-cloud-service-variability-performance-modelling-for-intelligent-ai-ml-service-selection\/","title":{"rendered":"Taming Cloud Service Variability: Performance Modelling for Intelligent AI\/ML Service Selection"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">Managed AI and machine learning cloud services \u2014 including AWS Bedrock, Google Vertex AI, and Microsoft Azure AI \u2014 have transformed enterprise software development. Developers now build intelligent applications by composing foundation model capabilities (language, vision, speech, embeddings, code) directly as black-box, pay-per-call APIs. This shift has created a significant and largely unaddressed challenge: the performance of these services is not stable, predictable, or transparent. The same API call can vary by an order of magnitude in response time across providers, regions, load levels, and times of day, yet no principled framework exists to help enterprise developers reason about this variability when selecting a service.<\/p>\n\n\n\n<p class=\"has-intro-font-size wp-block-paragraph\">Aim&nbsp;&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This project aims to systematically characterise, model, and predict performance variability in managed AI\/ML cloud services across AWS, Azure, and Google Cloud Platform, and to translate those predictions into an evidence-based service selection framework that enables enterprise developers to choose the cloud AI service best suited to their end-to-end performance requirements.<\/p>\n\n\n\n<p class=\"has-intro-font-size wp-block-paragraph\">Objectives&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Conduct a longitudinal, multi-provider measurement study of managed AI\/ML APIs, capturing latency distributions, throughput, failure rates, and cost across varied load levels, input characteristics, regions, and time periods over 12 months.<\/li>\n\n\n\n<li>Develop a variability attribution framework that identifies and quantifies the root causes of observed performance variation \u2014 including multi-tenancy interference, cold-start dynamics, rate-limit interactions, and model routing \u2014 using only externally observable signals.<\/li>\n\n\n\n<li>Build and validate a calibrated probabilistic prediction model that forecasts latency distributions (p50\/p95\/p99), failure probabilities, and throughput ceilings for a given workload specification, with support for transfer learning to newly released APIs.<\/li>\n\n\n\n<li>Design and evaluate a variability-aware service selection framework that matches a developer\u2019s performance and cost requirements to the most suitable managed AI service, supported by a user study with enterprise developers.<\/li>\n<\/ul>\n\n\n\n<p class=\"has-intro-font-size wp-block-paragraph\">Significance&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Managed AI cloud services are the dominant infrastructure layer for enterprise AI adoption globally, yet the lack of transparency in their performance behaviour imposes hidden costs, reliability risks, and poor user experiences on applications built on top of them. This project addresses a genuine gap in both research and practice: no systematic measurement dataset, variability model, or selection framework exists for this class of services. The open dataset produced in the first phase will serve as a lasting community resource for cloud systems researchers. The selection framework will provide immediate practical value to the thousands of enterprise development teams navigating multi-cloud AI service choices. The findings also directly support policy objectives around AI service transparency under the Australian AI Ethics Framework and emerging international standards.<\/p>\n\n\n\n<p class=\"has-intro-font-size wp-block-paragraph\">Ideal Candidate&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Applicants should hold an Honours or Masters degree in Computer Science, Software Engineering, Information Technology, or a related discipline, with a strong academic record. A background in one or more of the following is desirable: cloud computing, distributed systems, software performance, or data analysis. Basic programming experience, particularly in Python, is expected. Candidates with an interest in empirical research methods and a motivation to produce work with real-world impact are encouraged to apply. Additionally, the applicants should meet the eligibility criteria for entry into a PhD program at Curtin University.\u00a0<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This project is open to International and Domestic applicants.&nbsp;<\/p>\n\n\n\n<p class=\"has-intro-font-size wp-block-paragraph\">Scholarship&nbsp;&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you are identified as the preferred candidate for this project, you may be considered for an&nbsp;<a href=\"https:\/\/www.curtin.edu.au\/study\/scholarships\/research-training-program-rtp-scholarships\/\" target=\"_blank\" rel=\"noreferrer noopener\">RTP scholarship<\/a>.&nbsp;<\/p>\n\n\n\n<p class=\"has-intro-font-size wp-block-paragraph\">Enquires and How to Apply&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For enquires about this opportunity contact Dr Sheik Fattah at\u00a0<a href=\"mailto:Sheik.Fattah@curtin.edu.au\">Sheik.Fattah@curtin.edu.au<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To formally apply submit an\u00a0<a href=\"https:\/\/forms.curtin.edu.au\/Produce\/Form\/External%20Forms\/Graduate%20Research\/\" target=\"_blank\" rel=\"noreferrer noopener\">Expression of Interest<\/a>\u00a0to Dr Sheik Fattah during the Central Scholarship round (July 1st &#8211; July 31st 2026)\u00a0<\/p>\n","protected":false},"author":125,"featured_media":0,"template":"","faculties":[51],"hdr_types":[5487],"research_areas":[],"class_list":["post-145574","hdr-r-projects","type-hdr-r-projects","status-publish","hentry","faculties-science-and-engineering","hdr_types-rtp-scholarship"],"acf":false,"featured_image":false,"_links":{"self":[{"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/hdr-r-projects\/145574","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/hdr-r-projects"}],"about":[{"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/types\/hdr-r-projects"}],"author":[{"embeddable":true,"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/users\/125"}],"version-history":[{"count":0,"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/hdr-r-projects\/145574\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/media?parent=145574"}],"wp:term":[{"taxonomy":"faculties","embeddable":true,"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/faculties?post=145574"},{"taxonomy":"hdr_types","embeddable":true,"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/hdr_types?post=145574"},{"taxonomy":"research_areas","embeddable":true,"href":"https:\/\/www.curtin.edu.au\/research\/wp-json\/wp\/v2\/research_areas?post=145574"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}