AirPlay
AirPlay is a proprietary protocol stack/suite developed by Apple Inc. that allows wireless streaming between devices of audio, video, device screens, and photos, together with related metadata. Originally implemented only in Apple's software and devices, it was called AirTunes and used for audio only.[2] Apple has since licensed the AirPlay protocol stack as a third-party software component technology to manufacturers that build products compatible with Apple's devices.
Logos of AirPlay 2 AirPlay video (left) and AirPlay audio (right) | |
Developer | Apple Inc. |
---|---|
Type | Wireless media streaming |
Release date |
|
Website | apple |
History
Apple announced AirPlay 2 at its annual WWDC conference on June 5, 2017. It was scheduled for release along with iOS 11 in the third quarter of 2017, but was delayed until June 2018.[3][4] Compared to the original version, AirPlay 2 improves buffering; adds streaming audio to stereo speakers;[5] allows audio to be sent to multiple devices in different rooms;[6] and control by Control Center, the Home app, or Siri,[7] functionality that was only available previously using iTunes under macOS or Windows.[8]
Senders
AirPlay sender devices include computers running iTunes, and iOS devices such as iPhones, iPods, and iPads running iOS 4.2 or greater, and devices can send AirPlay over Wi-Fi or ethernet. OS X Mountain Lion supports display mirroring via AirPlay on systems containing 2nd generation Intel Core processors or later.[9]
In 2016, HTC released an Android phone with Apple AirPlay streaming.[10]
As of iOS 4.3, third-party apps like ApowerMirror,[11] AirServer, and Reflector may send compatible audio and video streams over AirPlay.[12] The iTunes Remote app on iOS can be used to control media playback and select AirPlay streaming receivers for iTunes running on a Mac or PC.[13]
As of macOS 10.14, there is no public API for third-party developers to integrate AirPlay 2 into their macOS apps. However, there are third-party streamers such as Airfoil. In May 2019, a third-party developer released a macOS app that can stream audio using AirPlay 2.[14] The app includes a helper tool called "AirPlay Enabler" that uses code injection to bypass restrictions to the AirPlay 2 private API on macOS.[15]
Receivers
AirPlay receiver devices include Apple TV, HomePod, other third-party speakers and the discontinued AirPort Express, which included a combined analog and optical S/PDIF audio output connector. Compatible devices can receive AirPlay over wi-fi or ethernet. Some open-source projects have reverse-engineered the audio part of the protocol, enabling any computer to be turned into an AirPlay receiver for audio.[16]
However, because not all third-party receivers implement Apple's DRM encryption, some media, such as iTunes Store's own rights-protected music (Apple's own "FairPlay" encryption), YouTube, and Netflix, cannot stream to those devices or software. On Apple TV, starting with firmware 6.0, the DRM scheme is enforced: devices without it cannot be used.[17]
AirPlay wireless technology is integrated into speaker docks, AV receivers, and stereo systems from companies such as Bose, Yamaha, Philips, Marantz, Onkyo, Bowers & Wilkins, Pioneer, Sony, Sonos, McIntosh, Denon,[18] and Bang & Olufsen.[19] Song titles, artists, album names, elapsed and remaining time, and album artwork can appear on AirPlay-enabled speakers with graphical displays. Often these receivers are built to only support the audio component of AirPlay, much like AirTunes.
Bluetooth devices (headsets, speakers) that support the A2DP profile also appear as AirPlay receivers when paired with an iOS device, although Bluetooth is a device-to-device protocol that does not rely on a wireless network access point.
During the January 2019 Consumer Electronics Show (CES) in Las Vegas, television makers Samsung, LG, Vizio, and Sony announced they would be producing sets with built-in AirPlay 2 receiving capability.[20] LG announced that television models that are Airplay 2-enabled will include the 2019 OLED, NanoCell SM9X, UHD UM7X, and LG NanoCell SM8X models.[21]
In late 2020 Roku added AirPlay 2 support to some of its streaming devices.[22]
Protocols
AirPlay and AirTunes work over Wi-Fi. Originally, devices had to be connected to the same Wi-Fi network, but since iOS 8 devices can use Wi-Fi Direct and thus does not require an existing Wi-Fi network.[23]
The AirTunes part of the AirPlay protocol stack uses UDP for streaming audio and is based on the RTSP network control protocol.[24] The streams are transcoded using the Apple Lossless codec with 44100 Hz and 2 channels symmetrically encrypted with AES, requiring the receiver to have access to the appropriate key to decrypt the streams.[25] The stream is buffered for approximately 2 seconds before playback begins, resulting in a small delay before audio is output after starting an AirPlay stream.[26]
The protocol supports metadata packets that determine the final output volume on the receiving end. This makes it possible to always send audio data unprocessed at its original full volume, preventing sound quality deterioration due to reduction in bit depth and thus sound quality which would otherwise occur if changes in volume were made to the source stream before transmitting. It also makes possible the streaming of one source to multiple targets each with its own volume control. The AirPort Express' streaming media capabilities use Apple's Remote Audio Output Protocol (RAOP), a proprietary variant of RTSP/RTP. Using WDS-bridging,[27] the AirPort Express can allow AirPlay functionality (as well as Internet access, file and print sharing, etc.) across a larger distance in a mixed environment of wired and up to 10 wireless clients.
AirPlay Mirroring
At WWDC 2011, Steve Jobs, then CEO of Apple Inc., announced AirPlay Mirroring as a feature in iOS 5 where the user can stream the screen from an iPad 2 to a HDTV wirelessly and securely without the need for cables.[28][29]
AirPlay is a different technology from AirPlay Mirroring, as the former allows specific content formats to be streamed while the latter that allows the whole screen to be broadcast from a variety of iOS devices and iTunes to an Apple TV (2nd Gen or later). The exact composition of the protocols that AirPlay Mirroring uses have not yet fully been discovered, or reverse-engineered.[29] However, an unofficial AirPlay protocol specification is available.[30] Supported hardware (when using OS X Mountain Lion or later) includes any 2011 or later iMac, Mac mini, MacBook Air, MacBook Pro, or the Mac Pro (late 2013 or newer).[31]
Reverse engineering
When the protocol was known as AirTunes, it was reverse-engineered by Jon Lech Johansen in 2008.[25]
On April 8, 2011, James Laird reverse-engineered and released the private key used by the Apple AirPort Express to decrypt incoming audio streams.[32] The release of this key means that third-party software and devices modified to use the key will be able to decrypt and play back or store AirPlay streams.[33] Laird released ShairPort as an example of an audio-only software receiver implementation of AirPlay.[34] Soon more followed and in 2012 the first AirPlay audio and video receiver for PC came with a product called AirServer.[35][36]
See also
Notes
- "Apple Unveils AirPort Express for Mac & PC Users". Apple.com. June 7, 2004. Archived from the original on March 29, 2011. Retrieved April 12, 2012.
- Brownlee, John (September 1, 2010). "September iPod Event: In iOS 4.2, AirTunes Becomes AirPlay". Cult of Mac. Retrieved April 11, 2011.
- "Apple unveils iOS 11 with P2P Apple Pay transfers, a new sound for Siri, AirPlay 2, more". AppleInsider. June 5, 2017. Retrieved June 6, 2017.
- "iOS 11.4 brings stereo pairs and multi-room audio with AirPlay 2". Apple.com. May 29, 2018. Retrieved May 29, 2018.
- "iOS 11.4 brings stereo pairs and multi-room audio with AirPlay 2". Apple Newsroom. Retrieved May 9, 2019.
- "AirPlay 2 FAQ: What it is, how it works, and which devices support it". Macworld. Retrieved June 22, 2018.
- "iOS 11 brings new features to iPhone and iPad this fall". Apple.com. Retrieved June 6, 2017.
- "Use AirPlay to stream content from iTunes on your computer". Apple Support. Retrieved June 30, 2017.
- "About AirPlay Mirroring in OS X Mountain Lion". Apple.com. Retrieved August 6, 2012.
- "HTC's 10 is the first Android phone with Apple AirPlay streaming". Engadget.
- "ApowerMirror". Apowersoft. Retrieved September 10, 2017.
- Rose, Michael. "iOS 4.3 spotlight: AirPlay improvements and 720p playback". TUAW. AOL. Retrieved May 5, 2011.
- "iTunes Remote". Apple.com. Archived from the original on September 13, 2010.
- "Optimus Player". Optimus Player. May 7, 2019. Retrieved May 8, 2019.
- Mo, Darren (May 7, 2019). "A helper tool that enables Optimus Player to stream audio using AirPlay 2". Retrieved May 9, 2019.
- "How-To: Turn your Raspberry Pi into a AirPlay receiver to stream music from your iPhone". Raspberry Pi HQ. Retrieved September 4, 2013.
- Kafasis, Paul (September 20, 2013). "Warning on Apple TV version 6.0". Under the Microsope. Rogue Amoeba. Retrieved September 20, 2013.
- Grobart, Sam (November 22, 2010). "Understanding AirPlay in Apple's iOS 4.2". The New York Times. Retrieved April 11, 2011.
- "Bang & Olufsen unveils Playmaker wireless audio bridge, makes sure AirPlay and DLNA speak Danish". Engadget. Retrieved June 12, 2019.
- "At CES 2019, Apple finally sets iTunes, AirPlay loose". CNET. Retrieved January 12, 2019.
- Rossignol, Joe. "LG's Latest Smart TVs Will Receive AirPlay 2 Update in Mid 2019". Mac Rumors. Retrieved April 2, 2019.
- "How do I use AirPlay and HomeKit with my Roku streaming device?". Roku website. Retrieved November 2, 2020.
- "AirPlay no longer requires a Wi-Fi network in iOS 8". Retrieved November 16, 2017.
- Donenfeld, Jason A. "AirTunes 2 Protocol". ZX2C4. Retrieved April 11, 2011.
- Hanselmann, Michael (December 16, 2008). "Add Remote Audio Output Protocol stream output plugin" (Mailing list).
- "Preventing audio delays while watching videos with Airfoil". Rogue Amoeba. Retrieved August 18, 2012.
- "Apple WDS Setup". Apple.com. February 11, 2011. Retrieved April 12, 2012.
- "iOS5 – AirPlay Mirroring for iPad 2". Apple.com. Archived from the original on September 23, 2011. Retrieved April 12, 2012.
- "Exploring Airplay Mirroring Internals". aorensoftare.com. August 20, 2011.
- "Unofficial AirPlay Protocol Specification". nto.github.com. May 29, 2012. Retrieved May 29, 2012.
- "About AirPlay Mirroring in OS X". Apple.com. Retrieved January 13, 2015.
- Laird, James (April 8, 2011). "RAOP/Airtunes". vlc-devel (Mailing list).
- Cheng, Jacqui (April 11, 2011). "ShairPort emulates AirPort Express to receive AirPlay streams". Ars Technica. Retrieved April 11, 2011.
- Laird, James (April 11, 2011). "ShairPort 0.02 released". Archived from the original on April 27, 2011. Retrieved April 11, 2011.
- "Wireless Mirroring from iPad to PC Now a Reality with AirServer". LearningInHand.com.
- "History ‹ AirServer". AirServer.
External links
- Official website
- The Main Wireless HDMI Transmission Protocols and Their Typical Products Comparison of different wireless HDMI transmission protocols at Portablehifi.com