Course Outline
NiFi Fundamentals and Data Flow
- Contrasting data in motion versus data at rest: concepts and associated challenges
- NiFi architecture: exploring cores, flow controllers, provenance, and bulletins
- Essential components: processors, connections, controllers, and provenance tracking
Big Data Context and Integration
- The position of NiFi within Big Data ecosystems (Hadoop, Kafka, cloud storage)
- Introduction to HDFS, MapReduce, and contemporary alternatives
- Practical applications: stream ingestion, log shipping, and event pipelines
Installation, Configuration & Cluster Setup
- Deploying NiFi in both single-node and cluster modes
- Configuring clusters: defining node roles, managing Zookeeper, and balancing loads
- Orchestrating NiFi deployments using Ansible, Docker, or Helm
Designing and Managing Dataflows
- Managing flow operations: routing, filtering, splitting, and merging
- Configuring processors (e.g., InvokeHTTP, QueryRecord, PutDatabaseRecord)
- Executing schema handling, enrichment, and transformation tasks
- Managing errors, setting up retry relationships, and applying backpressure
Integration Scenarios
- Establishing connections to databases, messaging systems, and REST APIs
- Streaming data to analytics platforms such as Kafka, Elasticsearch, or cloud storage
- Integrating with monitoring and logging tools like Splunk, Prometheus, or other pipelines
Monitoring, Recovery & Provenance
- Utilizing the NiFi UI, metrics, and the provenance visualizer
- Designing for autonomous recovery and graceful handling of failures
- Implementing backup strategies, flow versioning, and change management
Performance Tuning & Optimization
- Adjusting JVM settings, heap size, thread pools, and clustering parameters
- Refining flow designs to minimize bottlenecks
- Managing resource isolation, flow prioritization, and throughput control
Best Practices & Governance
- Ensuring flow documentation, adhering to naming standards, and adopting modular design
- Security measures: TLS, authentication, access control, and data encryption
- Enforcing change control, versioning, role-based access, and maintaining audit trails
Troubleshooting & Incident Response
- Addressing common issues: deadlocks, memory leaks, and processor errors
- Conducting log analysis, error diagnostics, and root cause investigations
- Applying recovery strategies and executing flow rollbacks
Hands-on Lab: Realistic Data Pipeline Implementation
- Constructing an end-to-end flow covering ingestion, transformation, and delivery
- Implementing error handling, backpressure mechanisms, and scaling capabilities
- Testing performance and tuning the pipeline for optimal results
Summary and Next Steps
Requirements
- Proficiency with the Linux command line
- Foundational knowledge of networking and data systems
- Familiarity with data streaming or ETL concepts
Target Audience
- System administrators
- Data engineers
- Developers
- DevOps specialists
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 4800 € + VAT*
Contact us for an exact quote and to hear our latest promotions
Testimonials (7)
Hands on exercises. Class should have been 5 days, but the 3 days helped to clear up a lot of questions that I had from working with NiFi already
James - BHG Financial
Course - Apache NiFi for Administrators
I thought the trainer's pace was good. He left no student behind with his approach. He was very supportive with us NEWBIES that may not have had a System Administrator or Infrastructure role during our career or resurrected those skills from a prior period of our career.
Pamdrea Ivory - BHG Financial
Course - Apache NiFi for Administrators
I like the hands on section. It helped me to better retain information by completing the provided exercises. Also, the trainer's ability to engage with the entire class made me feel comfortable to ask questions on things I was not sure about.
Leila - BHG Financial
Course - Apache NiFi for Administrators
Use-cases, examples for building NiFi dataflows. We worked on troubleshooting common problems and gotchas.
Nelson - BHG Financial
Course - Apache NiFi for Administrators
I loved the structure. We dove into the basics of Nifi, concepts, use cases, etc. on day 1. On day 2, we got to put Day 1 knowledge into practice by building out flows to meet scenario requirements. Day 3 we got to see Nifi Registry and version control, mulit-tenancy, and go over Q&A.
Adam - BHG Financial
Course - Apache NiFi for Administrators
I like how he was able to elaborate about Nifi and how powerful it is. You can basically use it for any infrastructure and use many different computer languages. Also i was glad we were able to fix the Nifi cert renewal issue we were having with the Truststore.
Joachim Martin - BHG Financial
Course - Apache NiFi for Administrators
general knowledge and the possibilities that the training offered in terms on the tool.
