“Before starting a new AI project, it is really worthwhile defining the business priority first,” asserts Joanna Hodgson, the UK and Ireland regional leader at Red Hat.

“What specific problem are you trying to solve with AI? Do we need a general purpose AI application or would a more focused model be better? How will we manage security, compliance and governance of that model? This process can help to reveal where AI adoption makes sense and where it doesn't," she added.

In this episode of the Tech Transformed podcast, host Shubhangi Dua, podcast producer at EM360Tech speaks with Hodgson, a seasoned business and technical leader with over 25 years of experience at IBM and Red Hat. They talk about the challenges of scaling AI projects, the importance of open source in compliance with GDPR, and the geopolitical aspects of AI innovation.

They also discuss the role of small language models (SLMs) in enterprise applications and the collaboration between IBM and Red Hat in advancing AI technology. Joanna emphasises the need for a strategic approach to AI and the importance of data quality for sustainable business practices. While large language models (LLMs) dominate headlines, SLMs offer a cost-effective and efficient alternative for specific tasks.

The podcast answers key questions, like ‘how do businesses balance ethical considerations, moral obligations, and even patriotism with the drive for AI advancement?’ Hodgson shares her perspective on how open source can facilitate this balance, ensuring AI works for everyone, not just those with the deepest pockets.

Hodgson also provides her vision on the future of AI. It comprises interconnected small AI models, agentic AI, and a world where AI frees up teams to create personal connections and exceptional customer experiences.

Takeaways

  • Curiosity is a strength in technology.
  • AI is becoming embedded in existing applications.
  • Regulatory compliance is crucial for AI systems.
  • Open source can enhance trust and transparency.
  • Small language models are efficient for specific tasks.
  • AI should free teams to create personal connections.
  • A strategic AI platform is essential for businesses.
  • Data quality is key for sustainable business success.
  • Collaboration in open source accelerates innovation.
  • AI can be used for both good and bad outcomes.

Chapters

00:00 Introduction to the Tech Transform Podcast

01:35 Pivotal Moments in Joanna's Career

05:12 Challenges in Scaling AI Projects

09:15 Open Source and GDPR Compliance

13:11 Regulatory Compliance and Data Security

17:30 Geopolitical Aspects of AI Innovation

22:31 Collaboration Between IBM and Red Hat

23:58 Understanding Small Language Models

29:54 Future Trends in AI and Sustainability

About Red Hat

Red Hat is one of the world’s leading providers of enterprise open source solutions, using a community-powered approach to deliver high-performing Linux, hybrid cloud, edge, and Kubernetes technologies. The company is known for Enterprise Linux.

They offer a wide range of hybrid cloud platforms and open source technologies—including AI, virtualization, edge, app development, and automation solutions. The hybrid cloud solutions are built to run their customers’ most important, most complex projects—from the datacenter to clouds to the edge. Their open ecosystem of partners and communities aim to ensure existing investments stay protected, providing unmatched freedom and choices to change, flex, reinvent, or stay the course.

What is Open Source Software (OSS)?

Open source software (OSS) refers to the source code of software that is relatively liberally available for use, modification, and distribution. The source code knowledge is accessible with few restrictions.

Enterprise open source software is supported by a vendor, usually via a subscription fee. For example, the vendor stabilises and quality-assures the software, certifies it works with an ecosystem of hardware and software, secures it and provides technical support.

OSS is a driver of collaborative development of AI models, fostering transparency, team-backed innovations. This often results in highly adaptable and cost-effective solutions. The open nature allows for peer review, potentially leading to enhanced security and reliability, making it a cornerstone of modern technology.