Structural damage should consider coupling effect of maximum inelastic deformation and cumulative hysteretic energy when subjected to the ground motion. A solution procedure of hysteretic energy spectra (simply called “VH spectra”), based on coupling effect of maximum inelastic deformation, is proposed in this paper. VH spectra can consider coupling effect of maximum inelastic deformation and cumulative hysteretic energy, more reasonably in accord with the actual inelastic behavior of structure under the rare earthquake action. Due to programming DBHS, a set of VH spectra are obtained. Finally, corresponding to lots of time history analysis of SDOF oscillators and regress of the datum, an expression about VH spectra of 4 site types is presented. The regressive parameters are also obtained at the same time. The results can be applied to energy-based seismic design or estimation of structure in the future.