From Maisqual Private Wiki

This page describes the process of data retrieval, extraction and treatment for Historic Batch Process.

It should be used as a template for defining Jenkins projects for analysis.^[1]

From an architectural point of view, we have a single Perl script for all steps.

Contents 1 Process overview 2 Data Retrieval 3 Project Processing 3.1 Project pre-processing 3.2 Project processing 3.3 Project post-processing 4 Data Processing 4.1 Data pre-processing 4.2 Data processing 4.3 Data post-processing 5 Data publishing 6 References

[edit] Process overview

This is to be executed on-demand.

The whole process has been divided into the following parts:

Data retrieval:

• Get raw data from data sources: SVN, Bugzilla, etc.
• Build survey.

Project processing:

• Project pre-processing: run any data provider: Checkstyle, PMD, etc.
• Project processing: build project, run tests, run SQuORE analysis.
• Project post-processing: extract and consolidate data issued from project processing.

Data processing:

• Data pre-processing: gather, import, and format data.
• Data processing: Run R scripts, plot data.

Data Publishing:

• Data post-processing & Publishing.

[edit] Data Retrieval

[edit] Project Processing

[edit] Project pre-processing

[edit] Project processing

[edit] Project post-processing

[edit] Data Processing

[edit] Data pre-processing

[edit] Data processing

[edit] Data post-processing

[edit] Data publishing

[edit] References

1. ↑ Following maisqual:12 Steps to Useful Software Metrics we automated the whole process of data processing.