Requirement Analysis

QVscribe Quality Analysis DOORS Next

Running Quality Analysis from in QVscribe for DOORS NG can be accessed by clicking on the QVscribe icon at the top of any module.

Once selected the Quality Analysis section shows a scorecard where each row corresponds to a marked artifact in the module along with its quality score. The 5-level scoring gives you a succinct picture of which artifacts need the most attention and which ones adhere to best practices.

Quality Analysis Details and Term Highlighting in QVscribe DOORS Next

When viewing the details of any analyzed artifact in QVscribe that has one or more alerts, selecting the alert will highlight the element of the artifact that created the alert.

In the example above the quality alert for “Vague Words” has been generated, selecting the alert will then highlight specific vague word that specific alert has been generated from.

If some analysis results are inconsistent with your company standards, ensure that the QVscribe Configuration being used is appropriate for the document, or talk to your QVscribe administrator about creating a QVscribe Configuration that more directly adheres to your specific standards.

Sorting and Filtering Quality Analysis results in QVscribe DOORS Next

Opening Quality Analysis

Within DOORS Next, QVscribe enables the ability to run Quality Analysis of requirements. To access this analysis start by selecting the “Summary View” icon next to the name of the module you are in.

Within the summary view select “Quality Analysis” from the right hand Navigation Menu.

Quality Analysis

After selecting “Quality Analysis” QVscribe will present the Quality Analysis for each of the Artifacts in the module based on the order they are displayed in the module. You may navigate to any of the individual artifacts to see their detailed analysis. At the top of this view are 2 tools that will help you refine the list of artifacts to focus on the areas you want to look further.

 

Filter Requirement

Filter Requirement provides a drop down list that allows you to display artifacts based on the 1-5 score calculated by QVscribe as well as the different Quality Issues that exist within the list. Selecting any item in the options in the list will filter the artifacts displayed for the selected item.

 

Sort Order

The sort order drop down provides a number of sorting options based on their order, quality and number of warnings associated.

 

 

QVscribe Consistency Analysis in QVscribe DOORS Next

QVscribe’s Consistency feature includes 2 types of analysis, units and terms. You can navigate to these analysis types through the corresponding section in the module view. This analysis displays terms and units enumerated and in sortable and searchable lists.

Term consistency 

All found terms and phrases that appear to be domain-specific are displayed, along with a total count and number of terms similar to it.

You can search for a specific term by entering text beside the magnifying glass icon.

Terms can be organized by selecting the drop-down beside the “Alphabetical Order” text in the top right. The options are:

  • Alphabetical Order: Default option, displays terms alphabetically

  • Most Occurrences: Displays terms in order of the number of times they appear from the highest number of occurrences to least number of occurrences

  • Most Similar: Displays terms in order of the number of similar requirements, from the highest number of similar requirements to the least number of similar requirements

  • Highest % Match: Displays terms based on the highest % match to other identified terms

The terms in the Consistency section can be explored by selecting any term to show all requirements where that term appears, as well as a list of similar terms and the %-similarity for each. Each of these similar terms can be expanded to show the requirements where it appears. This helps rapidly verify that these similar terms are valid in their own right, and reside in the correct requirements.

This similarity can be tuned in real-time with the Matching Strength Min and Max settings located in the User Settings section of the QVscribe Browser Extension. 

The Matching Strength gives the tolerance in the assessment of term similarity, such that a Matching Strength of 100% means the terms have to actually be identical for them to be considered similar, and as this Strength is decreased, then more terms will be considered similar.

Unit Consistency

Unit Consistency displays all units detected, along with their type categorization and total count. Each unit in the list can be expanded to show the requirements where it was found and highlight the unit within. This helps ensure that the right unit is in the right requirement and that there is consistency in the system of units used throughout the document (i.e. metric or imperial).

You can search for a specific unit by entering text beside the magnifying glass icon.

Units can be organized by selecting the drop down beside the “All” text in the top right. The options are:

  • All: Default option, displays all the identified units

  • International System of Units (SI): Displays identified SI units

  • Inconsistent with International System of Units (SI): Displays identified units that are not SI units

Selecting any unit in the list will display all the requirements that include that unit with the unit highlighted.

Unit consistency can be updated any time in the Configurations section of the QVscribe Browser extension.

Units can be customized to suit your team’s needs and can be added, edited, and removed to determine what units are included in the analysis.

QVscribe Similarity Analysis in QVscribe DOORS Next

The Similarity section shows the results of the requirements similarity analysis. The number of similar requirements found is shown beside each requirement in the list. 

The requirements can be sorted by Order of Appearance (default), Number of Similar, or Highest % Match, by selecting the drop-down beside the “Order of Appearance” text in the top right.

Expanding a requirement lists its similar requirements on the right, along with a percentage of how similar they are. Clicking a similar requirement in the list will then display the clicked on requirement below the original with the differences highlighted in light purple.

A Matching Strength min and max setting is available in the User Settings section of the QVscribe Browser Extension.  This lets you adjust how close requirements need to be in structure and terminology to be considered similar. 

It is useful to try different Matching Strength settings within 75% to 95%. This will display requirements that may contradict each other. You can also set the Matching Strength to 100% to review if there are any identical requirements

How to create a report in QVscribe DOORS Next

In the Summary View, click the ‘Create Report’ button in the bottom right-hand corner.

A window will appear for you to configure the report and choose the file name. Once your settings are set, press Create Report.

 

The QVscribe analysis report includes:

  • Document title, analysis date, the configuration used, and a total number of analyzed requirements.

  • Score Summary detailing the number of requirements with each score.

  • Analysis Breakdown showing how many requirements include each of the QVscribe quality indicators.   

  • Summary of EARS Conformance for all requirements (Easy Approach to Requirements Syntax)

  • The list of individual requirements with their corresponding scores, quality indicator/unit highlighting, analysis details, EARS conformance, number of similar requirements, and a terms list

  • A detailed list of all terms and units present

  • A list of highly similar requirements displayed dependent on the Matching Strength Threshold chosen

  • A detailed Appendix of the Configuration settings used during the analysis