HOME

TheInfoList



OR:

Extract, load, transform (ELT) is an alternative to extract, transform, load (ETL) used with data lake implementations. In contrast to ETL, in ELT models the
data In the pursuit of knowledge, data (; ) is a collection of discrete values that convey information, describing quantity, quality, fact, statistics, other basic units of meaning, or simply sequences of symbols that may be further interpret ...
is not transformed on entry to the data lake, but stored in its original raw format. This enables faster loading times. However, ELT requires sufficient processing power within the
data processing Data processing is the collection and manipulation of digital data to produce meaningful information. Data processing is a form of ''information processing'', which is the modification (processing) of information in any manner detectable by an ...
engine to carry out the transformation on demand, to return the results in a timely manner. Since the data is not processed on entry to the data lake, the query and schema do not need to be defined a priori (although often the schema will be available during load since many data sources are extracts from databases or similar structured data systems and hence have an associated schema). ELT is a data pipeline model.Using Redshift Spectrum to load data pipelines
Published by deductive.com on January 17, 2018, retrieved on April 3, 2019


Cloud data lake components


Common storage options

* AWS **
Simple Storage Service Amazon S3 or Amazon Simple Storage Service is a service offered by Amazon Web Services (AWS) that provides object storage through a web service interface. Amazon S3 uses the same scalable storage infrastructure that Amazon.com uses to run its e- ...
(S3) **
Amazon RDS Amazon Relational Database Service (or Amazon RDS) is a distributed relational database service by Amazon Web Services (AWS). It is a web service running "in the cloud" designed to simplify the setup, operation, and scaling of a relational dat ...
* Azure *
Azure Blob Storage
* GCP **
Google Storage Google Cloud Storage is a RESTful online file storage web service for storing and accessing data on Google Cloud Platform infrastructure. The service combines the performance and scalability of Google's cloud with advanced security and sharing ...
(GCS)


Querying

* AWS *
Redshift Spectrum
*
Athena
*
EMR (Presto)
* Azure ** Azure Data Lake * GCP *
BigQuery


References


External links

* Dull, Tamara
"The Data Lake Debate: Pro is Up First"
''smartdatacollective.com'', March 20, 2015. Data warehousing {{computing-stub