CTOs, CIOs, heads of data, data engineers, architects and senior software engineers.
Data Engineering with Python
- 2 days
- HRDC claimable
- Intermediate
In short
What is the Data Engineering with Python program?
A two-day technical program on building scalable data infrastructure in Python. Cover ETL and ELT, stream and batch processing, orchestration, and AI-augmented engineering.
Your team leaves able to build scalable ETL and ELT pipelines in Python, handling stream and batch processing with orchestration and AIGE-compliant data sovereignty.
Generative AI can automate activities that absorb 60 to 70% of employees’ time, yet operations and data work are where firms have scaled least (McKinsey, 2023). Pipelines are what make that reachable at scale. Source: McKinsey, The economic potential of generative AI, 2023
Pipelines keep AI fed. We have automated ingestion and transformation for a Malaysian enterprise, moving data from source systems into a warehouse with self-service dashboards and far less manual work. See a case study.
What your team will be able to do
- Architect ETL and ELT pipelines for high-volume ingestion and transformation.
- Handle stream and batch processing with Pandas, PySpark and Dask.
- Use AI to assist code generation and pipeline optimization.
- Orchestrate with Apache Airflow or Prefect.
- Operationalize data sovereignty with encryption and AIGE compliance.
No obligation. We reply within one working day, and your details stay confidential. Privacy
Who runs it
This program is run by industry practitioners who have shipped AI inside regulated enterprises across banking, government, manufacturing, and telco. It is led by Peter Kua, our AI and data science lead, a core contributor to Malaysia’s National Big Data Analytics Framework under MDEC and co-author of Malaysia’s AI Adoption Blueprints in 2019 and 2020. You are learning from people who have built this in production, not read about it. Peter’s commentary on AI adoption and workforce capability has appeared in The Star, theSun, Singapore Business Review, e27, and DagangNews, and on RTM Berita’s Tech Today.
Pipelines are what keep AI fed. This program builds the engineering layer that makes data usable at scale.
Common questions
Is this program HRDC claimable?
Yes. It is claimable through HRD Corp under SBL and SBL-Khas. GrowthPro Asia is an HRDC-registered provider, and we handle the claim paperwork so it stays audit-ready. For most registered employers the levy covers most or all of the cost.
Is this hands-on or theory?
Hands-on. These are build-along programs: your team works in real tools on real datasets and leaves with working code and a project it can reuse, not a slide deck. We introduce concepts only to support what you build.
What do we need to know before we start?
It depends on the level. Beginner programs start from fundamentals and assume no prior coding. Intermediate and advanced ones assume working Python or data experience. Each program states its level, and we help you place your team correctly.
Is it delivered in-house or as a scheduled cohort?
Both. Most teams run it in-house over two days on their own stack and data, which is where the skills stick. A scheduled cohort is available when you want a smaller group to learn alongside peers from other organisations.
How is the cost set?
We do not publish a fixed price. Cost depends on in-house versus scheduled delivery, group size, and how far we customise to your stack and data. It is HRD Corp claimable, so for most registered employers the levy covers most or all of it. Tell us your group size and format for an indicative quote.
Who is Data Engineering with Python for?
Engineers and architects who build the data layer: heads of data, data engineers, architects, and senior software engineers. It assumes working Python and moves into ETL and ELT, stream and batch processing with PySpark and Dask, and orchestration with Airflow or Prefect.
Does it cover data residency and compliance?
Yes. We build data sovereignty into the engineering: encryption, access control, and AIGE-aligned practice, so pipelines that move personal or sensitive data do so within Malaysian obligations. Compliance is part of the design, not a later audit.
What it costs
We do not publish a fixed price, because the program is built around your team and stack. Three things set the cost: whether you run it in-house on your own tools and data or join a scheduled cohort, the size of the group, and how far we customise to your environment. It is HRD Corp claimable under SBL and SBL-Khas, so for most registered employers the levy covers most or all of it. Tell us your group size and format, and we will send an indicative quote and exactly what is included.
Book the Free AI Strategic BriefingRelated
- AI Capstone, the pilot a roadmap leads into.
- HRDC-claimable AI training, how the claim works.
- AI consulting, strategy, governance and pilots.
- Advanced GenAI Systems: RAG, Fine-Tuning and Internal Copilots, a related program in AI Engineering & Systems Intelligence.
- Agentic AI for Workflow Autonomy, a related program in AI Engineering & Systems Intelligence.
Turn AI strategy into a working pilot, and prove the ROI.
Start with the free 3-hour AI Strategic Briefing. See agentic AI run real workflows, and leave with an automation roadmap, a prompt library, and a pilot playbook.