Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Construction
- Multi-layer ETL architectural models
- Crafting modular and reusable components
- Implementing hybrid approaches across various systems
Advanced Performance Engineering
- Optimizing at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Creating custom plugins
- Expanding PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integration
- Interaction with big data platforms
- Sophisticated file and API processing techniques
Data Governance, Security, and Compliance
- Protecting transformations and credentials
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Overseeing extensive job networks
- Designing for error recovery and failover
- Orchestration at the environment level
Repository Management, Version Control, and CI/CD
- Strategies for enterprise repositories
- Integration of PDI with Git
- Patterns for continuous deployment
Deployment, Monitoring, and Production Operations
- Advancing solutions across different environments
- Utilizing operational tooling and dashboards
- Achieving end-to-end production readiness
Conclusion and Future Directions
Requirements
- Proficiency in ETL pipelines and data modeling principles
- Hands-on experience with intermediate-level PDI transformations
- Strong command of SQL and scripting languages
Target Audience
- Senior data engineers
- ETL architects
- Professionals overseeing complex data integration workloads
Testimonials (1)
It's a hands-on session.
