Telecom Use Case Part 4 ETL Practice

#etl #scala #dwh #spark #Spark_In_Arabic #Big_Data #Hadoop #هادوب #بالعربي #Big_Data_In_Arabic #Code
In this episode, we explain the following topics:
1- Input data schema validation.
2- Rejection handling.
3- Writing unit testing to validate input data against a defined schema.
----------------------------------------------------------------------------------------------------------------------
"Big Data Engineering in Depth": https://gability.com/en/courses/big-data-in-depth/
----------------------------------------------------------------------------------------------------------------------
Repo: https://github.com/garage-education/spark-etl-demo
Documentation: https://docs.google.com/document/d/11MDJCHMxUZE7EAYIBJluq6HJv3upYgV06gYMNApUNdc/
----------------------------------------------------------------------------------------------------------------------
- About Garage Education: https://gability.com/en/#about
----------------------------------------------------------------------------------------------------------------------
Follow us:
Twitter: https://twitter.com/garageeducation
Facebook: https://www.facebook.com/GarageEducationCourses/
Youtube: https://www.youtube.com/c/GarageEducation
Website: http://gability.com/