Symmetry and its breaking sit at the core of condensed matter physics research and determine the ordering and unique functionalities of solid-state materials. Ultrashort light pulses from visible to THz wavelength ranges offer the opportunity to probe and control the electronic, phononic, magnetic, and even time ordering in those materials. The related studies are crucial for understanding the microscopic mechanisms of phenomena such as superconductivity, ferroicity, and optoelectronics, as well as for achieving ultrafast control of corresponding devices. In this talk, I will introduce our previous works of studying the photo-carrier induced ordering, ferroelectric ordering, and charge density ordering by using nonlinear optical spectroscopy and imaging techniques. Those studies help us to understand the fundamentals of the charge carrier protection of dynamically disordered semiconductors, domain formations advancing thermoelectricity, and the electron correlation in noncentrosymmetric superconductors.