E-memories attempt to digitally encode all life experiences in an archive for later search and real-time recommendation. In this paper we describe a prototype real-time e-memory gathering infrastructure and system, that uses smartphones to gather and organise semantically rich e-memory. © 2012 Springer-Verlag.