Profiling Educational Technology Integration (PETI)
SETDA/Metiri Resources for Assessing Readiness & Use

Validity and Reliability cont'd

Item Writing and Review

Metiri Group then developed specific survey items (questions) designed to gather information that would answer the key questions. Items were drawn from existing sources where applicable and permissible, but were modified for the specific demands of the SETDA framework and the key questions. Items were written to provide multi-item scales to address each key question, so a scale can, for these purposes, be seen as a score for any given question. Each survey item is assigned a score, and where there are multiple items that answer part of a key question, these are averaged together in order to provide one score for the scale. The key questions were also allocated to the respondent groups most likely to have accurate information, and were in some cases not asked of other groups. For example, regarding time spent doing certain technology-related activities with students, we ask only teachers. Regarding details on building infrastructure, we ask only the building survey respondent.

The entire survey sets were then reviewed by SETDA staff and the Common Data Elements committee, resulting in significant revision and reduction of questions. Four different processes were used in this analysis: Inter-item correlations, reliability analysis, and overall review. With this iterative process, it took approximately six months to finalize the first version of the surveys that were field-tested. The full Technical Manual is available online.

<- Previous