In April I presented at the AI & Big Data Conference in Chisinau, Moldova. The two-day event took place on April 3-4 at Castel Mimi and Tekwill, and was supported by the Government of the Republic of Moldova. This was my 2nd time speaking in Chisinau.
My speech – Generative AI in Action: From prototype to production – focused on the challenges organizations face when moving generative AI workloads beyond the proof of concept stage. Gartner predicts that 30% of generative AI projects will be abandoned after proof of concept by the end of 2025, so I walked through four key drivers for success: models, cost, data and infrastructure.
On the models side, I covered how there is no one model to rule them all – with 41% of enterprises using three or more LLM providers – and introduced Amazon Bedrock with its broad selection of foundation models, along with Amazon Nova and Amazon Bedrock Marketplace. On the cost and data side, I discussed inference cost challenges and capabilities like Amazon Bedrock prompt caching, Intelligent Prompt Routing and Amazon Bedrock Knowledge Bases for end-to-end RAG workflows.
My slides covering the presentation can be found here.