How To Test Your Survey Script

 

Overview 

Testing the survey script is an essential part of the project creation process. Testing is done by the scripter during the creation of the script to verify that specific script parts that are added behave as required (unit testing and debugging) and after the script is ready it is then tested by other teams (acceptance teams) to ensure it is coherent with the requirements from all aspects i.e. visually, logically and with the data structure that it generates.

Below is short description of how each team is performing the tests:

Online Videos 

Direct Youtube link (for full screen): https://youtu.be/ZWVYGGmMID4

Testing and Acceptance Process

During Script Development

Testing should begin during survey design to ensure that the script behaves as expected.

Use the Studio Emulator

The SurveyToGo Studio Emulator allows survey scripters to test survey behavior during development.

Common uses include:

• Verifying survey flow.

• Testing calculations and logic.

• Checking question rendering.

• Validating scripts before deployment.

Debugging Survey Logic

Use the Emulator Debugger to troubleshoot and validate script code.

The debugger can help identify issues with:

• Scripts

• Validation rules

• Jump rules

• Loop logic

• Calculations

• Dynamic question behavior

Before Delivering for Acceptance Testing

Before a survey is submitted for user acceptance testing, it should be tested on the actual target platform.

This is important because behavior may differ slightly between platforms such as:

• Android Data Collection App

• PC Survey

To perform device testing:

1. Assign a surveyor to the relevant survey or project.

2. Ensure the survey is set to Test Mode.

3. Synchronize the device.

4. Conduct test interviews on the target platform.

Acceptance Testing

Visual Testing

Verify that the survey displays correctly on the target platform.

Check:

• Question layouts

• Images and media

• Fonts and formatting

• Grid questions

• Language translations

• Device-specific display behavior

Testing should always be performed on the actual data collection platform that will be used in the field.

Logic Testing

Validate all survey logic and respondent flows, including:

• Entrance Rules

• Validation Rules

• Jump Rules

• Randomization

• Loops and Nested Loops

• Quotas

• Dynamic filtering

• Calculations

Conduct these tests on the target platform to ensure behavior matches expectations.

Data Consistency and Structure Testing

Validate that the collected data is structured correctly and can be processed successfully.

Recommended steps:

1. Use the Dummy Data Generator to create a large volume of test interviews.

2. Export the generated data.

3. Provide the exported data to the data processing team for review.

4. Verify that all variables, codes, and structures match project requirements.

Export Validation

In addition to dummy data testing, conduct real test interviews using the data collection devices.

After uploading the interviews:

1. Export the collected data.

2. Verify that all responses are exported correctly.

3. Confirm that the data can be successfully imported, analyzed, and processed by the data processing team.

This final validation step helps ensure that the survey behaves correctly in the field and that the resulting data meets all reporting and analysis requirements.