Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-tiered ETL architectural models.
- Designing modular and reusable components.
- Implementing hybrid approaches across various systems.
Advanced Performance Engineering
- Step-level performance optimization.
- Strategies for parallelism and threading.
- Monitoring pipelines under high load conditions.
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations.
- Creating custom plugins.
- Expanding PDI capabilities using Java and JavaScript.
Complex Data Processing and Integrations
- Real-time and streaming data integration.
- Interaction with big data platforms.
- Advanced handling of files and APIs.
Data Governance, Security, and Compliance
- Securing transformations and credential management.
- Data lineage and traceability mechanisms.
- Regulatory and compliance requirements.
Enterprise Orchestration and Scheduling
- Management of extensive job networks.
- Error recovery and failover design principles.
- Orchestration at the environment level.
Repository, Version Control, and CI/CD
- Strategies for enterprise repositories.
- Integrating PDI with Git workflows.
- Continuous deployment methodologies.
Deployment, Monitoring, and Production Operations
- Promoting solutions across different environments.
- Operational tools and dashboards.
- Achieving end-to-end production readiness.
Conclusion and Future Pathways
Requirements
- A fundamental comprehension of ETL pipelines and data modeling principles.
- Practical experience with intermediate-level PDI transformations.
- Proficiency in SQL and scripting languages.
Target Audience
- Senior data engineers.
- ETL architects.
- Professionals overseeing intricate data integration workloads.
Testimonials (1)
It's a hands-on session.
