Course Outline
Introduction to GPU-Accelerated Containerisation
- Exploring the role of GPUs in deep learning pipelines
- Understanding how Docker facilitates GPU-based workloads
- Key performance factors to consider
Installation and Configuration of the NVIDIA Container Toolkit
- Establishing drivers and ensuring CUDA compatibility
- Verifying GPU access within containers
- Setting up the runtime environment
Creating GPU-Enabled Docker Images
- Leveraging CUDA base images
- Packaging AI frameworks into GPU-ready containers
- Managing dependencies for training and inference tasks
Executing GPU-Accelerated AI Workloads
- Running training jobs leveraging GPU power
- Handling multi-GPU workloads
- Monitoring GPU utilisation metrics
Performance and Resource Allocation Optimisation
- Restricting and isolating GPU resources
- Optimising memory usage, batch sizes, and device placement
- Performance tuning and diagnostic techniques
Containerised Inference and Model Serving
- Constructing containers prepared for inference
- Serving high-volume workloads on GPUs
- Integrating model runners and APIs
Scaling GPU Workloads with Docker
- Strategies for distributed GPU training
- Scaling inference microservices
- Coordinating multi-container AI systems
Security and Reliability in GPU-Enabled Containers
- Safeguarding GPU access in shared environments
- Hardening container images
- Managing updates, versions, and compatibility issues
Summary and Next Steps
Requirements
- A solid grasp of deep learning fundamentals
- Proficiency with Python and widely used AI frameworks
- A working knowledge of basic containerisation concepts
Target Audience
- Deep learning engineers
- Research and development teams
- AI model trainers
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin
