Elastic Map Reduce : Running Hadoop and Big Data in Cloud
Presented by: amnigos
15 years ago
| 103 interested

As big data is becoming a common use case and we need distributed systems that can take advantage of parallel processing.

I will be talking about Hadoop, Map Reduce in general and how to run Hadoop Map Reduce jobs using Amazon EMR service. Will be sharing insights from managing hyper scale production Hadoop clusters and tuning for performance in general – Think 68400 GB RAM, 26000 CPUs and 1700000 GB Disks 🙂

Session Details :

1. Big Data and Use cases

2. Hadoop and Map Reduce – Streaming and Custom Jar jobs

3. Local hadoop setup for development

4. Launching Hadoop cluster using EMR

5. Profiling and Performance tuning

Drop a comment here if you want me to discuss any other specific topics as part of this session.

103 Interested
amnigos•shunmuganathan•tejvalluru•amnigos•skyrocknroll•amsharma•amnigos•pnh•apnerve•deepujain•raghava007•vishnur•puru•sathyabhat•ravee-bhat69•vardhan•amnigos•gouthamvel•rohit-athanikar•amnigos•sugandha•venkat-gattamaneni•delta0uc•raghub•amnigos•baseev•siva•amnigos•akarsh•ramesh_np2002•amnigos•gauravlochan•varunthacker•pidusd•akshayms•aritraghosh007•amnigos•rajesh•rahulsinghal19•pigol•sameer•amnigos•sivasubramaniam•xadhix•meenakshi-jain•shehjar•jacksonj•amnigos•aggala•amnigos•amnigos•high•vidya1729•hava_101•hstejas•amnigos•jaasti•msramachandran•amnigos•pravinmuppala•amnigos•vick4523zf•sunil-jayaprakash•amnigos•shaju•dhruvasagar•amnigos•amanmanglik•abhisheknath•amnigos•rajugt•yevlempy•lohithmv019•amnigos•amnigos•niranjanb•awin•a-d-vishnu-prasad•amnigos•thava•rajan-soundar•amnigos•joshnikhil234•dhiraj•amnigos•vijaykalangi•vellalpavani•vijayg•sid810•zuselegacy•ulyssesjayakar•conquistador•vivekjuneja•johnyjoshi•tjshankar•rgodha•amnigos•shiva-kumar•prashanthraghu•abhinandkr•ylchaithanya•prashanthhebbar•omprakr
Tags
| | | | |

Share this session:

Comments

Leave a Reply