Video of Telecom Use Case Part 3 ETL Practice in ETL Process course by Garage Education channel, video No. 3 free certified online
#etl #scala #dwh #spark #Spark_In_Arabic #Big_Data #Hadoop #هادوب #بالعربي #Big_Data_In_Arabic #Code
In this episode, we explain the following topics:
- (00:00) Introduction and recap from previous videos.
- (02:20) Writing unit test for parsing input data function.
- (12:45) Writing function to parse CSV with an added column as Spark DataFrame.
- (21:20) Testing the function based on the input data.
----------------------------------------------------------------------------------------------------------------------
"Big Data Engineering in Depth": https://gability.com/en/courses/big-data-in-depth/
----------------------------------------------------------------------------------------------------------------------
Repo: https://github.com/garage-education/spark-etl-demo
Documentation: https://docs.google.com/document/d/11MDJCHMxUZE7EAYIBJluq6HJv3upYgV06gYMNApUNdc/
----------------------------------------------------------------------------------------------------------------------
- About Garage Education: https://gability.com/en/#about
----------------------------------------------------------------------------------------------------------------------
Follow us:
Twitter: https://twitter.com/garageeducation
Facebook: https://www.facebook.com/GarageEducationCourses/
Youtube: https://www.youtube.com/c/GarageEducation
Website: http://gability.com/
