Metrics Process

Details

DateVersionStatusInformation ClassificationDocument Template IDDocument No
22-01-20201.3ApprovedInternalAMS DOCAMS-QP-03

Revision History

DateVersionDescriptionAuthorReviewed byApproved byApproved date
01-02-20171.0New ModuleRamanujan N CSuresh Kumar B V
20-06-20181.1Add Admin & Facilities
07-05-20191.2Updated the objectives & metrics
30-12-20191.3Annual Review 2020 - Changes made to align with the standard document formatUshaShailaSuresh Kumar B V22-01-2020

Acronym Used

AcronymExpanded Form
PMProject Manager
QAQuality Assurance
SEPGSoftware Engineering Process Group

Introduction

  • To provide a set of guidelines and procedures to assist Project/Process Managers and SEPG to identify and implement appropriate metrics throughout the organizational functions including software development life cycle and to track and improve process effectiveness and product quality.

  • The scope of metrics covers all the development & maintenance projects and related functions (e.g. configuration management, project management, testing, training and other activities/functions related to the product deployment and support).

Entry Criteria

  • Whenever data is to be collected and / or analyzed, as defined in the Product realization or Metrics Process.

Inputs

  • The inputs for individual metrics are unique to the particular metric. They typically consist of periodic timesheets, planned and actual schedules, cost schedules, etc.

Roles and Responsibilities

  • The Project/Process Manager is responsible for collection of project/process related data, filling up and submitting the metrics data sheets along with raw data (time sheet) to the Head of SEPG/QA on a periodic basis.

  • Head of SEPG and QAs are responsible for collecting audit related data, and support function related data. Head of SEPG/QA is responsible for updating the metrics database on a periodic basis. The control of the metrics database (the metrics data collected over a period of specified time along with metrics sheet is metrics database) will be with Head of SEPG/QA.

  • SEPG/QA to analyze and review metrics results and to decide upon the appropriate actions.

Tasks

Collections of Data

  • Process/Project Manager will be the Data owner.

  • Data is collected generally from timesheets, metrics datasheets, schedules/estimation sheets, Audit NC Reports, Training Needs and defect logs, etc on periodic basis.

Compute Metric

  • The appropriate input data is applied to the metric and the results computed. Note that the computational logic for each metric is unique. Please refer to Appendix A and metrics data sheets for development/other processes for details.

  • The metrics data sheets along with raw data needs to be saved into the metrics data base (part of SPDB) on a periodic basis.

Analyze and Review Results

  • Business Manager and Project/Process Manager will do computation (filling up of metrics data sheets) and analysis of metrics data at the project/process level. Analysis will involve investigation for reasons of variance. Appropriate corrective action needs to be decided thereon.

  • SEPG will compile and analyze metrics data at the organization level for all the metrics including actual effort distribution by activities, number of non-conformances in internal audits, etc. Analysis will involve comparison across difference projects/releases/process. The organization level analysis will be placed in the SEPG meetings and the results shall be documented in SEPG minutes of meetings. The results of the review need to be documented and saved.

Actions

  • SEPG/QA will share the feedback to the relevant project/process manager.

  • Findings or statistics gathered/generated by the QA from the metric process need to be handed to SEPG. The findings will be the source of reference for enhancement related to the same product/process or future projects, and for further process improvement according to the Organizational Process Development and Improvement Process.

Outputs

  • Filled up Metrics datasheets

  • Updated SPDB including the organization level analysis.

Exit Criteria

  • Metric output generated and appropriate corrective actions taken.

Formats & Guidelines

  • Metrics datasheet, templates for development, and other projects/processes.

Source of data

  • Software Quality Assurance Metrics

    • Audit Report
  • Training Metrics

    • Training Plan

    • Training Calendar

    • Feedback Forms

  • HR

    • HRF & Hiring Plan

    • Joining Docket

    • Employee Feedback & Survey Forms

  • BD

    • Complaints/Service Calls from IMS Sapphire

    • Customer Survey/Feedback Forms

  • IT

    • OP Manager Reports

    • Complaints-IMS Sapphire

    • IT N/W diagram

    • Incidents count from IMS

Details of Metrics

  • Refer ams_objectives for metrics details.

References

Srl.Document/Section Name
AMS_Objectives Document