Background There was no consistent recognition of the association between high or low body mass index (BMI) and health related quality of life (HRQL). The aim of this research was to study the association between BMI and HRQL in Chinese adults, and to further explore the stability of that association in the subgroup analysis stratified by status of chronic conditions. Methods A total of 21,218 adults aged 18 and older were classified as underweight, normal weight, overweight, class I obese, and class II obese based on their BMI. HRQL was measured by the SF-36 Health Survey. The independent impact of each BMI category on HRQL was examined through standard least squares regression by comparing the difference of SF-36 scores and the minimum clinically important differences (MCID), which was defined as 3 points. Results Compared to the normal weight, the class I obese was significantly associated with better HRQL scores in the mental component summary (MCS) (75.1 vs. 73.4, P<0.001). The underweight had the lowest score in both the physical components summary (PCS) (75.4 vs. 77.5, P<0.001) and mental components summary (MCS) (71.8 vs. 73.4, P<0.001). For the MCID, the HRQL score was reduced by more than 3 points in the physical functioning for the class II obese (D=-3.43) and the general health for the underweight (D=-3.71). Stratified analyses showed a similar result in the health subjects and chronic conditions, and it was significant in the chronic conditions. Conclusions The class I obese showed the best HRQL, especially in the mental domain. The worst HRQL was found in the underweight. The class II obese reduced HRQL in the physical functioning only. "Obesity paradox" was more obvious in the participants with chronic conditions.