Telecom Use Case Part 1 ETL Practice

#etl #scala #dwh #spark #Spark_In_Arabic #Big_Data #Hadoop #هادوب #بالعربي #Big_Data_In_Arabic #Code
In this episode, we present a practical ETL use case from the telecom industry, and how to think about the data life cycle from scratch.
This video presents the following topics:
- (0:00) Introduction and Demo Notes.
- (3:00) Creating an interface document for data analysis.
- (5:06) Design data life cycle.
- (10:05) Doing the data analysis for the new source system.
- (10:40) Data format analysis.
- (14:55) Analyze the data risks and recovery scenarios.
- (16:50) Analyze business use cases.
- (18:00) Analyze the data and think about data mapping as part of the data modelling.
- (21:29) Data Archiving.
- (22:24) How to manage discussion with data source owners before starting the data project?
The coding sessions are available in the next video in the same playlist.
Repo: https://github.com/garage-education/spark-etl-demo
Documentation: https://docs.google.com/document/d/11MDJCHMxUZE7EAYIBJluq6HJv3upYgV06gYMNApUNdc/
----------------------------------------------------------------------------------------------------------------------
"Big Data Engineering in Depth": https://gability.com/en/courses/big-data-in-depth/
----------------------------------------------------------------------------------------------------------------------
- About Garage Education: https://gability.com/en/#about
----------------------------------------------------------------------------------------------------------------------
Follow us:
Twitter: https://twitter.com/garageeducation
Facebook: https://www.facebook.com/GarageEducationCourses/
Youtube: https://www.youtube.com/c/GarageEducation
Website: http://gability.com/