
- This event has passed.
Data engineering 101: Data, Define & Decision
August 3, 2024 @ 9:00 am - 12:00 pm
99₫ – 149₫
Language in the workshop: Vietnamese
A common problem for a company looking to expand and develop its business is organizing a data system to address issues like Go to Market, Operation, and Risk Management.
Ticket Pricing
+ VND 200,000 99.000 – Early bird (Registration before 20/07/2024)
+ VND 250,000 149.000 – Standard (Registration after 20/07/2024)
Registration will close on 1/8/2024 (23:59)
Workshop Agenda
-
09:00 – 10:00Panel SessionDiscussion on the main content of the Workshop and interaction with the speakers
-
1.1 Topics:
- Fraud Detection
- Credit Scoring
-
1.2 Outline:
- Discuss business use cases of topics
- Discuss the company’s data team
- Data Mesh model in large companies
-
-
10:00 – 10:30Tea Break – Meetup – Networking
-
10:30 – 11:45Workshop
-
Sharing Session
-
Understanding the basic concepts of Data Platform and going through some practical examples.
-
Building a Data Engineering Team and Data Platform Orientation.
-
Stage 1: Small company, cost-optimized, and mainly needs quick analysis. In case the company requires data driving.
-
Learn how to build an effective team to solve problems at each stage of the company’s development.
-
Stage 2: has reached the stage where development is needed. Team Data Engineer grows with a larger number of members. And the business scale is larger, the system in phase 1 cannot optimize costs.
-
-
Hands-on Session
-
Prepare Resources and Data
-
Using Dataset: Financial company | Kaggle
-
AWS S3 bucket as Datalake
-
Presto for query engine
-
Spark for data processing
-
Airflow for scheduler
-
Jupyterhub for Data Scientist
-
Optional:
- DuckDB
- Postgres
- Superset
- LLM
-
- 1-1 Practical Guide
-
-