Angular Memory of Photonic Metasurfaces