Scalable Indexing with Google App Engine’s MapReduce

Posted on: Monday, July 6th, 2015, under Development.

David by David Lippa, Principal Software Engineer at RealMassive

 

An Introduction to Mapreduce

Google’s Mapreduce framework traces its roots back to 2003, where its first incarnation was used to build its eponymous search engine. It is designed for linear scalability, to allow for processing ever-increasing quantities of data that they collect. Google has since released its Mapreduce framework under an open-source license as part of Google App Engine and Google Cloud Platform [1].

(more…)