View source for Design review (U.S. government)

{{Short description|Key technical evaluation in procurement processes}}
{{about|the U.S. government process|the general principle|Design review}}
In the [[United States military]] integrated acquisition lifecycle <ref>[https://ilc.dau.mil/ Integrated Defense AT&L Lifecycle Management Chart] {{webarchive |url=https://web.archive.org/web/20130213203151/https://ilc.dau.mil/|date=February 13, 2013}} {{PD-notice}}</ref><ref>{{cite web|url=http://www.public.navy.mil/spawar/PEOC4I/ASPG/Documents/APSG_Manuals/files/Integrated_Def_Acq_Management_Frmwk.pdf|title=Integrated Defense Acquisition, Technology, & Logistics Life Cycle Management Framework chart|access-date=2016-05-31|url-status=dead|archive-date=2017-01-06|archive-url=https://web.archive.org/web/20170106210857/http://www.public.navy.mil/spawar/PEOC4I/ASPG/Documents/APSG_Manuals/files/Integrated_Def_Acq_Management_Frmwk.pdf}} {{PD-notice}}</ref> the Technical section has multiple acquisition "Technical Reviews".<ref>[https://acc.dau.mil/CommunityBrowser.aspx?id=294561 Technical Review Definitions] {{Webarchive|url=https://web.archive.org/web/20130220202107/https://acc.dau.mil/CommunityBrowser.aspx?id=294561 |date=2013-02-20 }} {{PD-notice}}</ref> Technical reviews and audits assist the acquisition and the number and types are tailored to the acquisition.<ref>[https://acc.dau.mil/docs/technicalslider/slider.html Systems Engineering Technical Reviews slider] {{Webarchive|url=https://web.archive.org/web/20121020042026/https://acc.dau.mil/docs/technicalslider/slider.html |date=2012-10-20 }} {{PD-notice}}</ref> Overall guidance flows from the Defense Acquisition Guidebook chapter 4,<ref>{{cite web|url=https://dag.dau.mil/Pages/Default.aspx|title=Defense Acquisition Guidebook|access-date=2013-04-11 |archive-url=https://web.archive.org/web/20130213203151/https://dag.dau.mil/Pages/Default.aspx|archive-date=2013-02-13|url-status=dead}} {{PD-notice}}</ref> with local details further defined by the review organizations.<ref>[https://acc.dau.mil/CommunityBrowser.aspx?id=640018 NAVSEA Technical Review Manual] {{Webarchive|url=https://web.archive.org/web/20150901013656/https://acc.dau.mil/CommunityBrowser.aspx?id=640018 |date=2015-09-01 }} {{PD-notice}}</ref><ref>{{cite web |url=http://www.navair.navy.mil/nawctsd/Resources/Library/Acqguide/NAVAIRINST-4355-19.pdf|title=NAVAIR INST 4355.19D, Systems Engineering Technical Review Process|access-date=2015-08-12}} {{PD-notice}}</ref><ref>{{cite web |url=http://everyspec.com/USN/NAVAIR/4355x19D_13732/|title=Everyspec NAVAIRINST 4355.19 Systems Engineering Technical Review (incl supplement B)|access-date=2015-08-12}} {{PD-notice}}</ref><ref>[http://www.dau.mil/publications/publicationsDocs/SEFGuide%2001-01.pdf ''Systems Engineering Fundamentals.''] {{webarchive |url=https://web.archive.org/web/20170131231503/http://www.dau.mil/publications/publicationsdocs/sefguide%2001-01.pdf|date=2017-01-31}}, Ch. 11 Technical Reviews and Audits; App 16-a Schedules Defense Acquisition University Press, 2001 {{PD-notice}}</ref> Typical topics examined include adequacy of program/contract metrics, proper staffing, risks, budget, and schedule.
In [[NASA]]'s engineering [[Systems Development Life Cycle|design life cycle]], '''design reviews''' are held for technical and programmatic accountability and to authorize the release of funding to a project.<ref>NASA Procedural Requirements, [http://nodis3.gsfc.nasa.gov/displayDir.cfm?Internal_ID=N_PR_7123_001B_&page_name=AppendixG Subject: NASA Systems Engineering Processes and Requirements, Appendix G]
Responsible Office: Office of the Chief Engineer, NPR 7123.1B, Effective Date: April 18, 2013, Expiration Date: April 18, 2018 {{PD-notice}}</ref> A design review provides an in-depth assessment by an independent team of discipline experts and managers that the design (or concept) is realistic and attainable from a programmatic and technical sense.
Design review is also required of [[medical device]] developers as part of a system of [[design controls]] described in the US [[Food and Drug Administration]]'s governing regulations in 21CFR820. In 21CFR820.3(h), design review is described as "documented, comprehensive, systematic examination of the design to evaluate the adequacy of the design requirements, to evaluate the capability of the design to meet these requirements, and to identify problems". The FDA also specifies that a design review should include an [[independent reviewer]].
== Review process ==
The list of reviews done by an effort and the content, nature, process, and objectives any review uses vary enormously by the organization involved and the particular situation of the effort. For example, even within the [[United States Department of Defense|U.S. Department of Defense]], System Requirements Review cases include, for example, (1) a 5-day perusal of each individual requirement, or (2) a 2-day discussion of development plan documents allowed only after the system requirements have been approved and the development documents reviewed with formal action items required, or (3) a half-day powerpoint with content determined by the Project Manager with attendance limited to high-level (non-technical) stakeholders with no output other than the PM being able to claim "SRR done".
Some of the reviews that may be done on an effort include:
=== Mission Concept Review (MCR) ===
The MCR affirms the mission need and examines the proposed mission's objectives and the concept for meeting those objectives.
=== System Requirements Review (SRR) ===
The SRR examines the [[functional requirements]] and [[non-functional requirements|performance requirements]] defined for the system and the preliminary program or project plan and ensures that the requirements and the selected concept will satisfy the mission.
=== Mission Definition Review (MDR) ===
The MDR examines the proposed requirements, the mission architecture, and the flow down to all functional elements of the mission to ensure that the overall concept is complete, feasible, and consistent with available resources.
=== System Design Review (SDR) ===
The [[System Design Review|SDR]] examines the proposed system architecture and design and the flow down to all functional elements of the system.
=== Preliminary Design Review (PDR) ===
The PDR demonstrates that the preliminary design meets all system requirements with acceptable risk and within the cost and schedule constraints and establishes the basis for proceeding with detailed design. It will show that the correct design options have been selected, interfaces have been identified, and verification methods have been described.<ref>{{cite web|url=http://www.hyperthot.com/pm_desreviews.htm |title=Engineering Design Reviews|author=James Chapman}}</ref><ref>{{cite web|url=https://acc.dau.mil/CommunityBrowser.aspx?id=518699#10.5.3.1|title=Defense Acquisition Guidebook 10.5.3 Preliminary Design Review|access-date=14 January 2016}} {{PD-notice}}</ref>
The following are typical objectives of a PDR:
* Ensure that all system requirements have been validated, allocated, the requirements are complete, and the flowdown is adequate to verify system performance
* Show that the proposed design is expected to meet the functional and performance requirements
* Show sufficient maturity in the proposed design approach to proceed to final design
* Show that the design is verifiable and that the risks have been identified, characterized, and mitigated where appropriate.
=== Critical Design Review (CDR) ===
{{expand section|with how does the CDR fit in with the new model firm-fixed price milestone-based contracts like NASA is doing with programs like [[Starship HLS]], which NASA says has a CDR slated for late 2025|date=November 2024}}
The CDR demonstrates that the maturity of the design is appropriate to support proceeding with full-scale fabrication, assembly, integration, and test. CDR determines that the technical effort is on track to complete the flight and ground system development and mission operations, meeting mission performance requirements within the identified cost and schedule constraints.<ref>http://www.navair.navy.mil/nawctsd/Resources/Library/Acqguide/cdr.htm {{Webarchive|url=https://web.archive.org/web/20150527134205/http://www.navair.navy.mil/nawctsd/Resources/Library/Acqguide/cdr.htm |date=2015-05-27 }} "Critical Design Review" Published 2013-4-4 Retrieved 2015-5-12 {{PD-notice}}</ref>
The following are typical objectives of a CDR:{{cn|date=November 2024}}
* Ensure that the "build-to" baseline contains detailed hardware and software specifications that can meet functional and performance requirements
* Ensure that the design has been satisfactorily audited by production, verification, operations, and other specialty engineering organizations
* Ensure that the production processes and controls are sufficient to proceed to the fabrication stage
* Establish that planned Quality Assurance (QA) activities will establish perceptive verification and screening processes for producing a quality product
* Verify that the final design fulfills the specifications established at PDR.
=== Production Readiness Review (PRR) ===
A PRR is held for Flight System and Ground Support projects developing or acquiring multiple or similar systems greater than three or as determined by the project. The PRR determines the readiness of the system developers to efficiently produce the required number of systems. It ensures that the production plans; fabrication, assembly, and integration enabling products; and personnel are in place and ready to begin production.
=== Test Readiness Review (TRR) ===
A TRR ensures that the [[test article (engineering)|test article]] (hardware/software), test facility, support personnel, and test procedures are ready for testing and data acquisition, reduction, and control. This is not a prerequisite for Key Decision Point entry.
=== System Acceptance Review (SAR) ===
The SAR verifies the completeness of the specific end products in relation to their expected maturity level and assesses compliance to stakeholder expectations. The SAR examines the system, its end products and documentation, and test data and analyses that support verification. It also ensures that the system has sufficient technical maturity to authorize its shipment to the designated operational facility or launch site.
=== Operational Readiness Review (ORR) ===
The ORR examines the actual system characteristics and the procedures used in the system or end product's operation and ensures that all system and support (flight and ground) hardware, software, personnel, procedures, and user documentation accurately reflect the deployed state of the system.
The following are typical objectives of an ORR:
* Establish that the system is ready to transition into an operational mode through examination of available ground and flight test results, analyses, and operational demonstrations
* Confirm that the system is operationally and logistically supported in a satisfactory manner considering all modes of operation and support (normal, contingency, and unplanned)
* Establish that operational documentation is complete and represents the system configuration and its planned modes of operation
* Establish that the training function is in place and has demonstrated capability to support all aspects of system maintenance, preparation, operation, and recovery.
=== Flight Readiness Review (FRR) ===
The FRR examines tests, demonstrations, analyses, and audits that determine the system's readiness for a safe and successful flight or launch and for subsequent flight operations. It also ensures that all flight and ground hardware, software, personnel, and procedures are operationally ready.
The following are typical objectives{{Citation needed|date=July 2019}} of a FRR:
* Receive certification that flight operations can safely proceed with acceptable risk.
* Confirm that the system and support elements are properly configured and ready for launch.
* Establish that all interfaces are compatible and function as expected.
* Establish that the system state supports a launch "go" decision based on go/no-go criteria.
== See also ==
{{Portal|Spaceflight}}
* [[Critical path method]]
* [[Engineering design process]]
* [[Systems Development Life Cycle]]
* [[Technical peer review]]
== References ==
{{Reflist}}
[[Category:Project management]]
[[Category:NASA spin-off technologies]]
[[Category:Systems engineering]]