Glue is an Amazon provided and managed ETL platform that uses the open source Apache Spark behind the back. When you write a DynamicFrame ton S3 using the `write_dynamic_frame()` method, it will internally call the Spark methods to save the file. Sin...




Docker allows us to package and run applications as an isolated process on a shared operating system, acting as a lighter weight alternative to virtual machines. The reason I chose to _dockerise_ my blog was the same as everybody else, 'speeding up t...


Amazon CloudWatch Events enables you to react selectively to events in the cloud as well as in your applications. Using simple rules you can easily route each type of event to one or more targets including but not limited to AWS Lambda functions, Ama...




As described in the Wikipedia page, "extract, transform, load (ETL) is the general procedure of copying data from one or more sources into a destination system which represents the data differently from the source(s)". Even though the crux of all ETL...



AWS Glue is a fully managed ETL service provided by Amazon that makes it easy to extract and migrate data from one source to another whilst performing a transformation on the source data. Amongst these transformation is the Relationalize[1] transform...


© 2019 | Ujjwal Bhardwaj. All Rights Reserved.