NCIDQ Exam Development

HOW THE NCIDQ EXAM IS DEVELOPED

To ensure the NCIDQ Examination is valid, fair, and reliable, CIDQ complies with the guidelines and standards published in The Standards for Educational and Psychological Testing (published jointly by the American Psychological Association, the National Council on Measurement in Education and the American Educational Research Association).

​

​To develop, administer, and score the NCIDQ Examination, CIDQ works with a professional testing company that specializes in the development of certification and licensure exams. CIDQ follows accepted procedures for developing such exams and carefully document each step in the test-development process.

​

​1. PRACTICE ANALYSIS

​CIDQ updated its Practice Analysis in 2019 to identify current knowledge and skills that define a minimally competent professional in interior design. During the practice analysis process, a panel of subject-matter experts defines the overall practice areas and distinct tasks, knowledge and skills required for competent performance. We then validate the job responsibilities developed by the experts through a survey of 2,000 practicing interior designers who review and rate the areas and tasks according to their level of importance and criticality to competent practice.

​

​2. DEVELOPING A TEST BLUEPRINT

​CIDQ uses the results from the practice analysis to develop a ‘blueprint’ or template, for the NCIDQ Exam. Information from the analysis is used to determine the importance of each area of practice or task, and is then translated into the percentage of questions allotted a given area in the multiple-choice sections of the exam. The analysis also determines how the scoring formula is weighted in the design part of the exam.

​

​3. ITEM DEVELOPMENT AND VALIDATION

The question-writing process uses both interior design and testing experts to ensure the appropriate content and form. All exam questions are written and reviewed by volunteer subject-matter experts in interior design who are trained in developing questions and problems for the exam. During and after development these experts review all of the questions to ensure they adhere to accepted principles for multiple-choice questions and design problems, as well as grammatical and usage conventions.

 

Questions accepted for use in the exam are judged, by consensus of the volunteers, to meet the following standards:​

​

• The knowledge tested by the question is essential for competent interior design and the protection of public health, safety and welfare.

• The knowledge tested by the question is either moderately or extremely important in assessing competent interior design.

• A correct response to the question would moderately or clearly differentiate adequate from inadequate performance for the competent interior designer.

• The question has a verified reference.

• The question is appropriate for the competent interior designer.

• The answer or solution is correct.

• The answer or solution can be defended if necessary.

• The other answer choices are incorrect, but plausible to those without sufficient knowledge.

​

4. PRETESTING TEST QUESTIONS

To verify the validity and quality of exam questions, CIDQ pretests new questions and problems before including them as scored items on the exam. Candidates do not know which questions are scored or unscored. The pretest results are analyzed statistically to ensure the quality and reliability of the overall exam. Even though the test questions change, we use a statistical procedure to ensure that one test is no harder or easier than another test.

​

​5. EXAMINATION ASSEMBLY

​Each part of the NCIDQ Exam is created by selecting the appropriate number of questions from each content area, as specified in the test blueprint. A panel of interior designers works with testing experts during test assembly and validation to ensure maximum quality (in accordance with the considerations listed above) and an appropriate mixture of content.

​

​6. EXAMINATION REVIEW AND REVISION

​The draft exams are again reviewed by interior designers for technical accuracy and by testing experts to ensure integrity.

​

​7. PASSING POINT

​An exam must have a defensible, criterion-referenced passing score. The score that separates candidates who pass from candidates who fail must be based on the minimum competence required to protect the public from harm. CIDQ works with our testing consultant to determine this passing point, which we define as the level of an interior designer's ability to practice independently (without supervision) in a manner that will protect the public health, safety and welfare.

​

​8. TEST ADMINISTRATION

​Test administration procedures for the NCIDQ Exam ensure consistent, comfortable testing conditions for all candidates. Test administration guidelines specify a process for admitting candidates into the exam room, verifying their identity, providing security, allotting testing times, and other important considerations. Testing facilities meet CIDQ guidelines for security, proper room size, ventilation, restroom facilities, accessibility and noise control. Test administration personnel are thoroughly trained in the requirements for administering the test.

​

9. PSYCHOMETRIC ANALYSIS

​Following each exam administration, CIDQ’s consultant conducts systematic analysis studies to ensure the proper function of each question and problem and of the test as a whole. Psychometric analysis also includes extensive reliability analysis as well as other studies that evaluate the quality of the exam.