Historic Data Retrieval Process

From Maisqual Private Wiki

Jump to: navigation, search

This page describes the process of data retrieval, extraction and treatment for Historic Batch Process.

It should be used as a template for defining Jenkins projects for analysis.[1]

From an architectural point of view, we have a single Perl script for all steps.


Contents

[edit] Process overview

This is to be executed on-demand.

The whole process has been divided into the following parts:

Data retrieval:

  • Get raw data from data sources: SVN, Bugzilla, etc.
  • Build survey.

Project processing:

  • Project pre-processing: run any data provider: Checkstyle, PMD, etc.
  • Project processing: build project, run tests, run SQuORE analysis.
  • Project post-processing: extract and consolidate data issued from project processing.

Data processing:

  • Data pre-processing: gather, import, and format data.
  • Data processing: Run R scripts, plot data.

Data Publishing:

  • Data post-processing & Publishing.


[edit] Data Retrieval

[edit] Project Processing

[edit] Project pre-processing

[edit] Project processing

[edit] Project post-processing

[edit] Data Processing

[edit] Data pre-processing

[edit] Data processing

[edit] Data post-processing

[edit] Data publishing

[edit] References

  1. Following maisqual:12 Steps to Useful Software Metrics we automated the whole process of data processing.
Personal tools