Course Outline

Introduction to Multimodal LLMs in Vertex AI

  • Overview of multimodal capabilities in Vertex AI
  • Gemini models and supported modalities
  • Use cases in enterprise and research

Setting Up the Development Environment

  • Configuring Vertex AI for multimodal workflows
  • Working with datasets across modalities
  • Hands-on lab: environment setup and dataset preparation

Long Context Windows and Advanced Reasoning

  • Understanding long-context workflows
  • Use cases in planning and decision-making
  • Hands-on lab: implementing long-context analysis

Cross-Modal Workflow Design

  • Combining text, audio, and image analysis
  • Chaining multimodal steps in pipelines
  • Hands-on lab: designing a multimodal pipeline

Working with Gemini API Parameters

  • Configuring multimodal inputs and outputs
  • Optimizing inference and efficiency
  • Hands-on lab: tuning Gemini API parameters

Advanced Applications and Integrations

  • Interactive multimodal agents and assistants
  • Integrating external APIs and tools
  • Hands-on lab: building a multimodal application

Evaluation and Iteration

  • Testing multimodal performance
  • Metrics for accuracy, alignment, and drift
  • Hands-on lab: evaluating multimodal workflows

Summary and Next Steps

Requirements

  • Proficiency in Python programming
  • Experience with machine learning model development
  • Familiarity with multimodal data (text, audio, image)

Audience

  • AI researchers
  • Advanced developers
  • ML scientists
 14 Hours

Delivery Options

Private Group Training

Our identity is rooted in delivering exactly what our clients need.

  • Pre-course call with your trainer
  • Customisation of the learning experience to achieve your goals -
    • Bespoke outlines
    • Practical hands-on exercises containing data / scenarios recognisable to the learners
  • Training scheduled on a date of your choice
  • Delivered online, onsite/classroom or hybrid by experts sharing real world experience

Private Group Prices RRP from €4560 online delivery, based on a group of 2 delegates, €1440 per additional delegate (excludes any certification / exam costs). We recommend a maximum group size of 12 for most learning events.

Contact us for an exact quote and to hear our latest promotions


Public Training

Please see our public courses

Provisional Upcoming Courses (Contact Us For More Information)

Related Categories