Course Outline
Introduction to AI Inference with Docker
- Comprehending AI inference workloads.
- Advantages of containerized inference.
- Deployment scenarios and associated constraints.
Building AI Inference Containers
- Selecting appropriate base images and frameworks.
- Packaging pretrained models.
- Structuring inference code for container execution.
Securing Containerized AI Services
- Minimizing the container attack surface.
- Managing secrets and sensitive files effectively.
- Implementing safe networking and API exposure strategies.
Portable Deployment Techniques
- Optimizing images for portability.
- Ensuring predictable runtime environments.
- Managing dependencies across different platforms.
Local Deployment and Testing
- Running services locally using Docker.
- Debugging inference containers.
- Evaluating performance and reliability through testing.
Deploying on Servers and Cloud VMs
- Adapting containers for remote environments.
- Configuring secure server access.
- Deploying inference APIs on cloud VMs.
Using Docker Compose for Multi-Service AI Systems
- Orchestrating inference alongside supporting components.
- Managing environment variables and configuration files.
- Scaling microservices using Compose.
Monitoring and Maintenance of AI Inference Services
- Approaches to logging and observability.
- Detecting failures within inference pipelines.
- Updating and versioning models in production environments.
Summary and Next Steps
Requirements
- A solid understanding of fundamental machine learning concepts.
- Practical experience with Python or backend development.
- Familiarity with foundational container concepts.
Audience
- Developers
- Backend engineers
- Teams responsible for deploying AI services
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 3200 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (3)
How trainer deliver knowledge so effectively
Vu Thoai Le - Reply Polska sp. z o. o.
Course - Certified Kubernetes Administrator (CKA) - exam preparation
the trainer had a lot of knowledge and patience to share with us
Bogdan Olaru
Course - Introduction to Docker
The knowledge and exchanges with Augustin
