File:DotScale 2017 - Neha Narkhede - The Rise of Real-Time.webm
Original file (WebM audio/video file, VP9/Opus, length 17 min 38 s, 1,920 × 1,080 pixels, 1.29 Mbps overall, file size: 162.23 MB)
Captions
Captions
Summary[edit]
| Description |
English: Filmed at https://2017.dotscale.io on April 24th in Paris. More talks on https://dotconferences.com/talks
What happens if you take everything that is happening in your company—every click, every database change, every application log—and make it all available as a real-time stream of well-structured data? Neha discusses the experience at LinkedIn and elsewhere moving from batch-oriented ETL to real-time streams using Apache Kafka, including how the design and implementation of Kafka was driven by the goal of acting as a real-time platform for event data as well as some of the challenges of scaling Kafka to hundreds of billions of events per day at Linkedin, supporting thousands of engineers, applications and data systems in a self-service fashion. She describes how real-time streams can become the source of ETL into Hadoop or a relational data warehouse, how real-time data can supplement the role of batch-oriented analytics in Hadoop or a traditional data warehouse, and how applications and stream processing systems such as Storm, Spark, or Samza can make use of these feeds for sophisticated real-time data processing as events occur. |
| Date | |
| Source | YouTube: dotScale 2017 - Neha Narkhede - The Rise of Real-Time – View/save archived versions on archive.org and archive.today (archived) |
| Author | dotconferences |
Licensing[edit]
.svg){kind=icon}
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
|
This file, which was originally posted to YouTube: dotScale 2017 - Neha Narkhede - The Rise of Real-Time, was reviewed on 14 February 2020 by the automatic software YouTubeReviewBot, which confirmed that this video was available there under the stated Creative Commons license on that date. This file should not be deleted if the license has changed in the meantime. The Creative Commons license is irrevocable.
The bot only checks for the license, human review is still required to check if the video is a derivative work, has freedom of panorama related issues and other copyright problems that might be present in the video. Visit licensing for more information. If you are a license reviewer, you can review this file by manually appending |
|
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 01:42, 11 June 2019 | 17 min 38 s, 1,920 × 1,080 (162.23 MB) | Sikander (talk | contribs) | Imported media from https://www.youtube.com/watch?v=SNMZWxi7A_s |
You cannot overwrite this file.
File usage on Commons
The following 2 pages use this file: