Traditional Chinese architecture are mostly of wooden structure, yet there are no wooden architectures before Tang dynasty persevered in China. However, some grottoes and tomb paintings and other related archaeological evidences elucidate the ancient architectural styles of Shanxi before the Tang dynasty.

Yungang Grottoes in Datong illustrate rock-cut architecture dating back to the Northern Wei dynasty. Tianlongshan Grottoes in Taiyuan was constructed over a number of centuries, as early as the Northern Qi dynasty.

The oldest preserved wooden structures in China are found in Shanxi.^[1] The four preserved Tang architectures are Foguang Temple and Nanchan Temple in Mount Wutai, Five Dragons Temple in Ruicheng County, Tiantai Temple in Changzhi (Some scholars argue that Tiantai Temple was first constructed in Later Tang of the Five Dynasties, instead of the Tang dynasty).

Among these four surviving Tang architectures, Foguang Temple is the best preserved, partly due to its remote location outside of the central areas surrounded by the five mountains of Mount Wutai.

Jinci temple in Taiyuan is one of the most prominent temples in Shanxi, and the oldest surviving architecture there—the Goddess Temple was constructed from 1023 to 1032 during the Song dynasty.^[2]

The Buddhist Texts Library of the Huayan Temple in Datong was established in 1038, during the Liao dynasty (907–1125). The Mahavira Hall of the Huayan Temple in Datong was originally built in the Liao dynasty, but was rebuilt in 1140 during the Jin dynasty. It is nine-room wide, five-room deep and covers an area of 1,559-square-metre (16,780 sq ft).^[3] It is the largest architecture in China built during the Liao and Jin dynasties.

The Sakyamuni Pagoda of Fogong Temple in Ying County, Shuozhou, also known as "Yingxian Muta" was built in 1056 during the Liao dynasty. It has survived several large earthquakes throughout the centuries. It is the oldest existent fully wooden pagoda still standing in China.^[4][5][6][7]

The Amitabha Hall and the Mahayana bodhisattva (Guanyin) Hall of the Chongfu Temple in Shuozhou were built in the Jin dynasty, which is famous for its statues and murals.

Yuan Buddhist temples and Taoist palaces in southern Shanxi have world-renowned dry fresco paintings. It's mostly because of the painting school led by Zhu Haogu. This painting school with many famous painters was very active in southern Shanxi during that historic time.

Yongle Palace in Yuncheng has preserved dry fresco murals in unparalleled integrity in China. The palace is one of "Three Great Ancestral Courts" of the Quanzhen School of Taoism. The "Homage to the First Principle" (Chaoyuan tu) on the walls of the Yongle Palace are the largest mural paintings of Yuan dynasty in China.

Some of these Shanxi mural paintings are now preserved in western museums. For example, Paradise of Bhaisajyaguru was originally housed in Guangsheng Lower Monastery, now in Metropolitan Museum of Art, New York, United States; Homage to the First Principle, which depicts a procession of Daoist deities and their celestial attendants, sometimes referred to as Chaoyuan tu or the ‘Heavenly Court’, similarly in style as those found in the Yongle Palace, was originally housed in Wansheng Guan in Linfen (then-named Pingyang Fu (平阳府)). Paradise of Maitreya was originally housed in the Xinghua Temple of Xiaoning, Jishan County, Shanxi. Both paintings are now in the Royal Ontario Museum (ROM) of Toronto, Canada. However, the Wansheng Guan and the Xinghua Temple were both completely destroyed during the tumultuous second world war and Chinese civil war periods. Some of the fresco paintings are preserved.

Longshan Grottoes in Taiyuan is the only grottoes site dedicated for Taoism in China.

During the Ming and Qing dynasties, the Shanxi merchants accumulated enormous wealth, particularly through the international trade of tea to Russia and the development of draft banks, or "Piaohao", which secured Shanxi as the financial center in the Qing dynasty.^[8][9]

Pingyao ancient city is a well-preserved city with numerous ancient architectures. There are also a number of family complexes scattered throughout Shanxi that were built during these two dynasties, which are representative of vernacular architecture in North China. The notable Shanxi family complexes include:

• Wang Family Compound in Lingshi, which is the largest of the Shanxi Courtyard Houses;
• Qiao Family Compound in Qi County;
• Qu Family Compound in Qi County;
• Chang Family Compound in Yuci;
• Cao Family Compound in Taigu;
• The Kung Family Residence in Taigu, where the family of H. H. Kung used to live;
• The Meng Family Courtyard in Taigu, later, this private family compound was transformed to the Ming Hsien school (铭贤学校), which is further incorporated as part of Shanxi Agricultural University;
• Shen Family Compound, (申家大院) in Changzhi.

Other than the Yungang Grottoes and Tianlongshan Grottoes as two notable religious architectures, Mount Wutai has the largest concentration of buddhist architectures in Shanxi, with temples constructed throughout thousands of years from the Tang dynasty to modern days.

In Southern Shanxi, Qinglian Temple in Jincheng, and Guangsheng Temple in Hongtong County are among the most notable religious architectures.

Yaodong is a special form of vernacular architecture, commonly found in the Loess Plateau in North China. Yaodong are commonly seen in the mountainous areas of Shanxi, in contrast to the more elaborate aforementioned family compounds, which are usually found in flat plains or basins of Shanxi.

Yaodong is a type of earth shelter, usually carved out of a hillside. Sometimes, Yaodong can be found in relatively flat areas with the entire central courtyard dug out from the flat land, and then the rooms are carved from the surrounding walls. The earth shelter serves as a good insulator and keeps the indoor space cool in hot summers and warm in cold winters.^[10]