Real-time Data-Pipeline from inception to production
6 years ago
| 34 interested
Big Data being the buzzword of the industry, organizations want to arrive at actionable insights from their data quickly. Both historic and incoming data needs to be ingested through data pipelines onto a single data lake to help derive real-time analytics. To build real time streaming pipelines, we need to take care of data veracity, reliability of the system, out of order events, complex transformations and easier integration for future purposes.
This session will cover our experience of building such real-time pipelines for financial data, the various open source libraries we experimented with and the impacts we saw in a very brief time.
34 Interested
thenair•thecodeartist•sanjay•nivedita•kiran-mv•sathyabhat••mallikarjuna_jalageri•prathammehta•pancham•rkbunt•harshendar•rajatarora•karan_sharma•suparna-sirsikar•shravangurram•zudokod•krunal-naidu•darkjedi•dharshan•kira2566•sameerahmed•vvh•teja-puram•chethan_n•donna•rohitshetty•anil100nair•sachin_phatak•nagarathna_a•bindu_ketineni•naveen-kumar-p•pavi•tejaswi_babu
Tags
Share this session:
Leave a Reply
You must be logged in to post a comment.