Presto (SQL query engine)

Presto is a high performance, distributed SQL query engine for big data. Its architecture allows users to query a variety of data sources such as Hadoop, AWS S3, Alluxio, MySQL, Cassandra, Kafka, MongoDB and Teradata.[1] One can even query data from multiple data sources within a single query. Presto is community driven open-source software released under the Apache License.

Presto
Original author(s)Martin Traverso, Dain Sundstrom, David Phillips, Eric Hwang
Initial release10 November 2013 (10 November 2013)
Written inJava
Operating systemCross-platform
Standard(s)SQL
TypeData warehouse
LicenseApache License 2.0
Websiteprestodb.io
trino.io

History

Presto was originally designed and developed at Facebook for their data analysts to run interactive queries on its large data warehouse in Apache Hadoop. Before Presto, the data analysts at Facebook relied on Apache Hive for running SQL analytics on their multi petabyte data warehouse. Hive was deemed too slow[2] for Facebook's scale and Presto was invented to fill the gap to run fast queries. Original development started in 2012 and deployed at Facebook later that year. In November 2013, Facebook announced its release as open source 2013.[2][3] In 2014, Netflix disclosed they used Presto on 10 petabytes of data stored in the Amazon Simple Storage Service (S3).[4]

In January 2019, the Presto Software Foundation was announced. The foundation is a not-for-profit organization dedicated to the advancement of the Presto open source distributed SQL query engine.[5][6] At the same time, Presto development forked: PrestoDB maintained by Facebook and PrestoSQL maintained by the Presto Software Foundation with some cross pollination of code.

In September 2019, Facebook donated PrestoDB to the Linux Foundation establishing the Presto Foundation.[7] Neither the creators of Presto, nor the top contributors and committers, were invited to join this foundation.[8]

In December 2020, PrestoSQL was rebranded as Trino.[9]

Architecture

Presto’s architecture is very similar to a classic database management system using cluster computing (MPP). It can be visualized as one coordinator node working in sync with multiple worker nodes. Clients submit SQL statements that get parsed and planned following which parallel tasks are scheduled to workers. Workers jointly process rows from the data sources and produce results that are returned to the client. Compared to the original Apache Hive execution model which used the Hadoop MapReduce mechanism on each query, Presto does not write intermediate results to disk resulting in a significant speed improvement. Presto is written in the Java programming language.

A single Presto query can combine data from multiple sources. Presto offers connectors to data sources including files in Alluxio, Hadoop Distributed File System, Amazon S3, MySQL, PostgreSQL, Microsoft SQL Server, Amazon Redshift, Apache Kudu, Apache Phoenix, Apache Kafka, Apache Cassandra, Apache Accumulo, MongoDB and Redis. Unlike other Hadoop distribution-specific tools, such as Apache Impala, Presto can work with any flavor of Hadoop or without it. Presto supports separation of compute and storage and may be deployed both on premises and in the cloud.

See also

References
  1. https://teradata.github.io/presto/docs/0.167-t/overview/teradata-distribution.html
  2. Joab Jackson (November 6, 2013). "Facebook goes open source with query engine for big data". Computer World. Retrieved April 26, 2017.
  3. Jordan Novet (June 6, 2013). "Facebook unveils Presto engine for querying 250 PB data warehouse". Giga Om. Retrieved April 26, 2017.
  4. Eva Tse, Zhenxiao Luo, Nezih Yigitbasi (October 7, 2014). "Using Presto in our Big Data Platform on AWS". Netflix technical blog. Retrieved April 26, 2017.CS1 maint: uses authors parameter (link)
  5. "Presto Software Foundation Launches to Advance Presto Open Source Community". PRWeb. Retrieved 2019-02-01.
  6. "Presto's New Foundation Signals Growth for the Big Data SQL Engine". The New Stack. 2019-01-31. Retrieved 2019-02-01.
  7. "Facebook, Uber, Twitter and Alibaba form Presto Foundation to Tackle Distributed Data Processing at Scale". Retrieved 2019-11-12.
  8. "What's the relationship between prestosql and prestodb?". 2019-11-22.
  9. "We're rebranding PrestoSQL as Trino". 2020-12-27.


This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.