Course Outline
Foundations of Data-Intensive Platform Engineering
- Introduction to data-intensive applications
- Challenges in platform engineering for big data
- Overview of data processing architectures
Data Modeling and Management
- Principles of data modeling for scalability
- Data storage options and optimization
- Managing data lifecycle in a distributed environment
Big Data Processing Frameworks
- Overview of big data processing tools (Hadoop, Spark, Flink)
- Batch vs. stream processing
- Setting up a big data processing pipeline
Real-Time Analytics Platforms
- Architecting for real-time analytics
- Stream processing engines (Kafka Streams, Apache Storm)
- Building real-time dashboards and visualizations
Data Pipeline Orchestration
- Workflow management with Apache Airflow and others
- Automating data pipelines for efficiency
- Monitoring and alerting for data pipelines
Platform Security and Compliance
- Security best practices for data platforms
- Ensuring data privacy and regulatory compliance
- Implementing secure data access controls
Performance Tuning and Optimization
- Techniques for optimizing data throughput and latency
- Scaling strategies for data-intensive platforms
- Performance benchmarking and monitoring
Case Studies and Best Practices
- Analyzing successful data platform implementations
- Lessons learned from industry leaders
- Emerging trends in data-intensive platform engineering
Capstone Project
- Designing a platform solution for a data-intensive application
- Implementing a prototype of the data processing pipeline
- Evaluating the platform's performance and scalability
Summary and Next Steps
Requirements
- A solid understanding of basic data structures and algorithms.
- Practical experience with Java, Scala, or Python programming.
- Familiarity with fundamental concepts of databases and SQL.
Target Audience
- Software developers
- Data engineers
- Technical leads
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (2)
the overall concept of DevOps/DevSecOps is not a team but a culture, a mind set
Mpho Mashele - South Africa Reserve Bank
Course - DevOps and Platform Engineering: A Collaborative Approach
About the microservices and how to maintenance kubernetes
