Rational thinking is the most basic way of thinking in military decision-making, and cognitivereflection is an important condition for obtaining rational thinking. This study developed a cognitivereflection initial test through literature analysis, and based on item response theory, the initial test wassubjected to question reduction and dimensionality determination, ultimately forming a one-dimensionalcognitive reflection test. The reliability and validity of the test were tested in the Chinese militarypopulation. The results show that the test has good reliability and validity, meets the requirements ofpsychometrics, and can be used as an effective tool to measure the reflective tendency in the rationalthinking of soldiers.