Course Outline
Foundations of Hybrid AI Deployment
- Understanding hybrid, cloud, and edge deployment models
- AI workload characteristics and infrastructure constraints
- Selecting the appropriate deployment topology
Containerizing AI Workloads with Docker
- Building GPU and CPU inference containers
- Managing secure images and registries
- Implementing reproducible environments for AI
Deploying AI Services to Cloud Environments
- Running inference on AWS, Azure, and GCP via Docker
- Provisioning cloud compute resources for model serving
- Securing cloud-based AI endpoints
Edge and On-Prem Deployment Techniques
- Running AI on IoT devices, gateways, and microservers
- Utilizing lightweight runtimes for edge environments
- Managing intermittent connectivity and local persistence
Hybrid Networking and Secure Connectivity
- Establishing secure tunneling between edge and cloud
- Managing certificates, secrets, and token-based access
- Performance tuning for low-latency inference
Orchestrating Distributed AI Deployments
- Using K3s, K8s, or lightweight orchestration for hybrid setups
- Service discovery and workload scheduling
- Automating multi-location rollout strategies
Monitoring and Observability Across Environments
- Tracking inference performance across various locations
- Implementing centralized logging for hybrid AI systems
- Failure detection and automated recovery mechanisms
Scaling and Optimizing Hybrid AI Systems
- Scaling edge clusters and cloud nodes
- Optimizing bandwidth usage and caching strategies
- Balancing compute loads between cloud and edge environments
Summary and Next Steps
Requirements
- A foundational understanding of containerization concepts
- Practical experience with Linux command-line operations
- Familiarity with AI model deployment workflows
Audience
- Infrastructure architects
- Site Reliability Engineers (SREs)
- Edge and IoT developers
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin