Help Manual

Contents






Sigma Magic Help Version 19

Scorecard

Overview

The scorecard can be used to document the current status of the project CTQs. Scorecards are typically used in a Design for Six Sigma project to document the most critical CTQs and whether we can meet the requirements. There are different types of scorecards you can create:
  • Design Scorecard: A design scorecard is a tool used to evaluate and measure the quality, effectiveness, and completeness of a design—whether it's for a product, service, user interface, or system. It typically includes a set of criteria or metrics that are important to stakeholders (e.g., designers, product managers, users), and it helps ensure the design meets strategic goals.
  • Part Scorecard: A part scorecard (sometimes called a part evaluation scorecard or supplier part scorecard) is a tool used primarily in manufacturing, engineering, or supply chain management to evaluate and rate a specific component or part—often supplied by a vendor—based on certain performance and quality criteria.
  • Process Scorecard: A process scorecard is a tool used to evaluate and monitor the performance of a specific business process over time. It's like a report card for how well a process is functioning, and it helps teams measure efficiency, effectiveness, and quality against defined goals or benchmarks.
  • Performance Scorecard: A performance scorecard is a structured tool used to measure and track the performance of an individual, team, department, or organization against predefined goals and metrics. Think of it as a dashboard that shows how well someone or something is doing relative to expectations.
  • Software Scorecard: A software scorecard is a structured tool used to evaluate and monitor the quality, performance, and effectiveness of a software product or system. It helps teams—especially product managers, QA testers, developers, and stakeholders—assess whether a software product meets expectations across technical, functional, and user experience dimensions.
  • Overall Scorecard: An overall scorecard is a high-level summary tool that combines multiple performance metrics or scorecards into one unified view. It provides a big-picture assessment of how well a person, team, project, product, or organization is performing across various key areas.


This tool can be added to your active workbook by clicking on Project and then selecting Design Scorecard.

Inputs

Click on Analysis Setup to open the menu options for this tool.

Setup

A sample screenshot of the setup menu is shown below.
inputs
1
Template Type: In this dialog box, specify the template you would like to use for this analysis. The following templates are available:
OptionDescription
Design scorecardUse the design scorecard for your analysis. Identify the critical metrics critical for your design and track if you are able to meet them.
Part scorecardUse the part scorecard for your analysis. Identify all the parts in your design and see if you can meet the specifications.
Process scorecardUse the process scorecard for your analysis. Identify all the processes used in your system and see if they meet the required specifications.
Performance scorecardUse the performance scorecard for your analysis. Identify all the performance metrics for your product/service and see if they meet the specifications.
Software scorecardUse the software scorecard for your analysis. Check if your software process meets the required specifications.
Overall scorecardUse the overall scorecard for your analysis. Combine scorecards from multiple locations and look at the overall performance.
2
Num Metrics: Specify the number of metrics you want to display on the scorecard. This information will be used to format the worksheet. The number of metrics dictates the number of rows on your worksheet.
3
View Example: Click on this button to open the example file. You can view the example to get an idea of how to fill out this tool, or you can use the example as a starting point and modify it to meet your project needs.
4
Help Button: Click on this button to open the help file on this topic.
5
Cancel Button: Click on this button to exit without saving any changes.
6
Create: If this is your first time using this template, click this button to format the worksheet template. You can also update the worksheet format any time, but remember that you may lose any data entered on this worksheet. Once you are happy with the worksheet template layout, you must enter any required data on the worksheet. When the data entered into the worksheet is complete, you can click on Analysis Setup and then Compute Outputs to generate analysis results.
7
Analyze: Click on this button to save all changes and compute the outputs for this analysis. Review the results of your analysis and make changes to your inputs if required to update analysis results.

Design Scorecard Worksheet

A sample design scorecard worksheet is shown below. Design Scorecard Example Enter the following information in the worksheet:
  • Enter the information for critical CTQs, the capability metric (Cpk, Sigma Level, or DPMO), and the goal for the process capability metric.
  • As information becomes available, enter the predicted capability (typically during the design and optimization phase of a DFSS project) or the measured capability (typically during the Verify phase of the DFSS project).

Part Scorecard Worksheet

A sample part scorecard worksheet is shown below. Design Scorecard Example Enter the following information in the worksheet:
  • Part name and number for easy identification.
  • The number of parts that are contained in the final product. The default is 1.
  • If the part is measured on a continuous scale, specify the mean, standard deviation, and the specification limits.
  • If the part is measured on an attribute scale, specify the sample size and the number of defectives found.
  • If data exists (from simulation, measurements, etc.) you can specify the effective PPM of the part.
  • Any notes you want to capture for each part, like its cost or other characteristics.

Process Scorecard Worksheet

A sample process scorecard worksheet is shown below. Design Scorecard Example Enter the following information in the worksheet:
  • Enter the details of the process steps.
  • The number of process steps that are contained in the final product. The default is 1.
  • The number of opportunities for error (OFE) for the given process step. If only 1 opportunity, specify 1 here.
  • If the process is measured on a continuous scale, specify the mean, standard deviation, and the specification limits.
  • If the process is measured on an attribute scale, specify the sample size and the number of defectives found.
  • If data exists (from simulation, measurements, etc.) you can specify the effective PPM of the process.
  • Any notes you want to capture for each process, like its cost, time to process, or other characteristics.

Performance Scorecard Worksheet

A sample performance scorecard worksheet is shown below. Design Scorecard Example Enter the following information in the worksheet:
  • Enter the details of the performance measure.
  • If the performance is measured on a continuous scale, specify the mean, standard deviation, and the specification limits.
  • If the performance is measured on an attribute scale, specify the sample size and the number of defectives found.
  • If data exists (from simulation, measurements, etc.) you can specify the effective PPM of the performance.
  • Any notes you want to capture for each performance characteristic, like its cost, time to process, or other characteristics.

Software Scorecard Worksheet

A sample software scorecard worksheet is shown below. Design Scorecard Example Enter the following information in the worksheet:
  • Enter the details of the software stages.
  • The number of opportunities for error (OFE) for the given process stage. If only 1 opportunity, specify 1 here.
  • The number of defectives identified in each stage of the process. We could also track the number of defects found at the customer location due to each stage.
  • Any notes you want to capture for each software stage, like its cost, time to process, or other characteristics.

Overall Scorecard Worksheet

A sample overall scorecard worksheet is shown below. Design Scorecard Example Enter the following information in the worksheet:
  • Enter the details of the overall breakdown of the system into subgroups.
  • Enter the number of units for each row.
  • Enter the total defectives per unit found in each row.
  • Enter the yield of each row.
  • Enter the Defects per Million Opportunities (DPMO) for each row.
  • Enter the Sigma Level (Z) for each row.

Verify

If you click the Verify button, the software will perform some checks on the data you entered. A sample screenshot of the dialog box is shown in the figure below. Verify The software checks if you have correctly specified the input options and entered the required data on the worksheet. The results of the analysis checks are listed on the right. If the checks are passed, they are shown as green checkmarks. If the verification checks fail, they are shown as a red cross. If the verification checks result in a warning, they are shown in the orange exclamation mark. Finally, any checks that are required to be performed by the user are shown as blue info icons.
1
Item: The left-hand side shows the major tabs and the items checked within each section
2
Status: The right-hand side shows the status of the checks.
3
Overall Status: The overall status of all the checks for the given analysis is shown here. The overall status check shows a green thumps-up sign if everything is okay and a red thumps-down sign if any checks have not passed. Note that you cannot proceed with generating analysis results for some analyses if the overall status is not okay.

Outputs

Click on Compute Outputs to update the output calculations. A sample screenshot of the worksheet is shown for each of the templates in the images above. There are no graphs generated for this analysis. The results of the analysis are shown in row 4. It contains the overall number of units for each scorecard, the total defectives per unit, the overall yield of the scorecard, the DPMO level of the scorecard, and the overall sigma level of the scorecard.

For the design scorecard, the output contains information about whether each row meets the specification for the project. The rows that don't meet the specifications are shown in red and the rest of the rows are shown in black. You can use this design scorecard, to focus on each item that does not meet specification and take actions to ensure that changes are made to the design so that they meet the project requirements.

Examples

The following examples are in the Examples folder.
  • Develop a Design Scorecard for the training effectiveness project defined in the attached file (Design Scorecard 1.xlsx)