Abstract　 　　
　 Understanding the Galactic structure is non-trivial, mostly because we are located in the disk plane. The boxy, parallelogram-shaped bulge in the Milky Way in Infrared imagery can be well explained with a tilted bar structure. A vertical X-shaped structure in the Galactic bulge was recently reported. We present evidence of a similar X-shaped structure in Shen et al. (2010) bar/boxy bulge model that simultaneously matches the stellar kinematics successfully. The X-shaped structure is found in the central region of our bar/boxy bulge model and is qualitatively consistent with the observed one in many aspects. End-to-end separations of the X-shaped structure in the radial and vertical directions are roughly 3 kpc and 1.8 kpc, respectively. It is mainly associated with orbits trapped around the vertically extended x1 family. The existence of the X-shaped structure suggests that the formation of the Milky Way bulge is shaped mainly by internal disk dynamical instabilities. In this talk, I will also describe our recent results on the kinematics of the X-shaped component (Qin et al. 2013 to be submitted) and the discovery of a cold high velocity stream to the Galactic bulge in the APOGEE commissioning results (Li & Shen 2013 to be submitted).