Deep learning techniques have demonstrated great success in many application domains such as computer vision, speech recognition, and natural language processing. It has been shown that the memory subsystem is the main bottleneck in executing DNN applications, including the capacity and bandwidth walls.  This talk covers recent researches for tackling the memory wall challenges.  