View all jobs

Testing Specialist / Test Items Developer

Pensacola, FL · Information Technology
Testing Specialist / Test Items Developer
NMOTC, Pensacola (Hybrid Work Schedule)
DOD Secret Clearance Required

Nationwide IT Services is seeking a Testing Specialist to become a part of a close-knit group of professionals to support our Navy customer located aboard Naval Air Station in Pensacola, Florida.

The Navy Medicine Operational Training Command (NMOTC) supports Navy Medicine’s life-saving mission by training these medical professionals for theater-specific contingencies.

  • Manage data collection protocol design and oversight, test item development, test bank management, and advanced data analytic support, to include the following:
  • Troubleshoot and continually evaluate functionality and design of adaptive test engines and test library usage/exposure over time using GOTS and COTS software systems.
  • Evaluate and maintain data on test library content coverage for 4,000 cognitive and non-cognitive items measuring 5 different aptitudes in 3-10 content areas each, as well as 11 non-cognitive trait facet categories.
  • Develop scales and test forms to capture traits, facets, or aptitudes related to effective job performance. Scale and form development typically involve simultaneous design of numerous measures to be used for adaptive test library expansion, requiring focus on psychometric equivalence, content redundancy, establishment of linking items, and grammatical and stylistic quality.
  • Perform data management and cleaning for transfer of trait and aptitude measures data into formats and datasets amenable to analysis using item response theory and factor analysis. Perform parameter estimation and scale linkage analyses across forms to ensure comparability of scores generated using different forms targeting the same construct.
  • Oversee data collection protocol requirements for delivery of up to 30 different test forms to participant samples ranging in size from 10-300 people, to include maintenance of materials requirements and test form requirements by participant.
  • Document summaries for analyses of test bank development work, scale validation, scale bias estimation, and data-model fit for customized measurement scales.
  • Develop psychological test questions in a military aviation environment
  • Provide effective communication and customer service skills
  • Analyze and document information and testing results
  • Apply and deploy testing instruments in a web-based application
  • Analyze test questions for accuracy and feasibility
  • Display extensive experience using BILOG-MG3& SPSS statistical software

  • Bachelor's Degree Required or 3 years of Professional Experience as a Testing Developer
  • Degree in Psychology related field or two years' specialized experience
  • Experience using the following data analysis / statistics software:  IBM SPSS, Minitab, R software

About Nationwide IT Services
NIS is an IT and Management consulting company, designated 8(a) by the SBA, and a CVE-verified Service Disabled Veteran Owned Small Business. Our mission is to deliver value-added services to our customers, leveraging technology, people, and industry best practices to implement innovative solutions through our trusted employees and team members.  
Our benefits package includes medical, dental, and vision insurance, life and disability insurance, 401(k) plan with employer match, paid holidays, PTO (sick/vacation), commuter benefits, employee assistance program (EAP) and educational reimbursement.
Nationwide IT Services, Inc. provides equal employment opportunities (EEO) to all qualified applicants for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, genetics, disability or protected veteran status.


Share This Job

Powered by