SI (Skeleton and Infill) housing system can significantly improve residential adaptability and flexibility, and provides easier access to housing maintenance compared to traditional building structures. However the promotion of this system in China's building industry remains sluggish. By conducting an investigation and applying Factor Analysis method, this paper explored the factors that inhibit the promotion of SI housing system. Findings revealed that costs and benefits, technology and management, industrial chain and enterprise capacity, as well as policies and regulations are the four major factors that confine the application and widespread of SI housing system in China. In addition, Mean Score method was conducted to explore other critical factors for different stakeholders. The results indicate that the government sectors consider enterprise capacity and industry development as the main barriers while other stakeholders lay emphasis on government support and cost. These findings provide a valuable reference for different stakeholders to identify the major barriers, and make appropriate strategies to participate in promoting CSI housing system.