|
Masters Research Thesis (Vol I) - Conceptualisation and Automatic Generation of Test & Evaluation Master Plans (TEMPs) for Defence Acquisition Test Programs (DATPs)
This thesis investigates a method to support an important facet of the Test & Evaluation (T&E) process, in particular, the conceptualisation and consequent automation via the assistance of a computer, the manual generation of Test & Evaluation Master Plans, from the functional requirements specification of any defence acquisition test program, for the real-time test & evaluation (T&E) of complex systems, such as the highly instrumented fighter aircraft F/A-18 Hornet of the RAAF. The aim of the research was to reduce the performance risk associated with Systems Engineering (SE), Test & Evaluation (T&E) processes via a process known as Master Planned Test & Evaluation (MPT&E) for non-traditional regimented systems. A further aim was to produce a set of generic principles for applying as a set of guidelines to the various SE, T&E processes that would set up a framework in which to carry out performance risk management to any given process.
|
Masters Thesis (PDF 1.64M)
|
|
Chapter One
Chapter 1 gives an introduction to the research undertaken, the aim of the research, a detailed background of the research and its contribution to Australia, and structure of the Thesis. The thesis details the work accomplished on the research project “Performance Risk Reduction for Systems Engineering, Test & Evaluation Processes”. John S. Nissyrios, working under the guidance of Professor Peter Sydenham at the Australian Centre for Test & Evaluation (ACTE) conducted this work. This research was conducted on a full-time basis at the Levels Campus of the University of South Australia (UniSA), over 1997 to 1999 inclusive.
|
Chapter 1
(PDF 40.4k)
|
|
Chapter Two
The origins of Test & Evaluation are described in Chapter two, where the history, types of T&E, interests, reasons, importance, objectives and the need for conducting T&E are discussed. This Chapter hypothesises that T&E is essentially a process and synonymous to the systems engineering process, and as the phrase implies, a two part process, i.e., testing and evaluating.
|
Chapter 2
(PDF 163.6K)
|
|
Chapter Three
Chapter three then outlines a brief genealogy of the discipline of this research, i.e., aircraft flight testing, giving a short introduction to flight test, flight test planning, test resources, and telemetry formats used in flight testing that could assist in the design of telemetry data formats. This Chapter reveals that T&E practitioners are taking more measurements than are required, and as a consequence increasing the cost of testing not to mention human resources required to carry out these tests, hence the importance of keeping tests simple, small, economical and manageable, i.e., adhering to the philosophy of parsimony.
|
Chapter 3
(PDF 217.1K)
|
|
Chapter Four
Chapter four analyses and compares two most prominent T&E structures and processes, namely, that of the United States of America and Australia. It is determined that one of best documented T&E systems in the world, is that originating from to the United States of America and due to this fact, many non-US based countries have adopted its basic principles, terminology, and structure.
|
Chapter 4
(PDF 147K)
|
|
Chapter Five
Chapter five gives a concise description on the research methodology utilised in the attempt to conceptualise and automate the Australian T&E process. The importance of adhering to and regularly updating a Test & Evaluation Master Plan (TEMP) is emphasised as the most vital part of any defence acquisition test program, as it outlines very crucial elements that all such test should adhere to.
|
Chapter 5
(PDF 129K)
|
|
Chapter Six
Chapter six describes the results of this research, namely, a software tool known as AutoTEMP© Beta 2.0, outlining descriptions of all three modules, namely, the US defence phased acquisition process tutorial, the TEMP generation module, and the automatic generation of the TEMP document. It was designed to comply to the Australian Defence Force Capital Equipment Procurement Manual, often referred to as the CEPMAN 1, instruction.
|
Chapter 6
(PDF 430K)
|
|
Chapter Seven
Chapter seven is essentially the conclusion and the recommendations for further research. This research was considered important as it was the first time ever that this problem has been researched using an academic methodology, as opposed to picking up from something well known. The development of this project has provided a tool that can save the agencies involved in high volume testing, hundreds of millions of dollars, due to a reduction in time, cost, and effort taken to manually produce a TEMP, whilst offering more thorough and reliable testing, as well as increasing confidence in the safety and predictability of complex systems, such as the highly instrumented fighter aircraft, F/A-18 Hornet.
|
Chapter 7
(PDF 39.9K)
|
|
Defence Capability Development Manual 2006
In 2004 the Australian Government announced major changes to the way the Australian Defence Organisation (ADO) is organised and operates with regard to the development of major proposals for new Defence capabilities. These changes followed the publication of the Defence Procurement Review 2003, also known as the ‘Kinnaird Review’, and resulted in the Capability Development Group (CDG) releasing the inaugural Defence Capability Development Manual (DCDM) in February 2005. Replacing the Capability Systems Life Cycle Management Manual (2002), the DCDM provides authoritative guidance to CDG staff in carrying out the Group’s core tasks of developing investment proposals (including options) for new Defence capabilities for consideration by Government and managing the Major Capital Equipment program. A further benefit of the DCDM is its value to the very wide range of organisational stakeholders in the capability development process in the ADO and with whom CDG needs to engage fully if it is to carry out its role effectively.This second edition of the DCDM reflects the continued evolution of capability development activities within the ADO and incorporates feedback from those who use the processes in the conduct of their daily business.
|
Defence Capability Development Manual 2006
(PDF 3.3M)
|
|
Defence Capability Systems Life Cycle Management Guide 2002
This manual is intended as a primer for those with little or no previous experience of capability systems life cycle management. It emphasises the management of the front end of the life cycle, especially the management of Major Capital Investment projects. Only general reference is made to Defence organisations. Where a Defence Executive is identified as having a specific accountability the authority inherent in that accountability may be delegated to a subordinate, but the Defence Executive remains accountable for how that delegated authority is exercised. A knowledge of the basic principles of financial accounting and management accounting will assist in understanding those parts of the manual dealing with financial management.
|
Defence Capability Life Management Guide 2002 (PDF 2.33M)
|
|
DMO Material Lifecycle Guide
The processes involved in equipping and sustaining the ADF are complex and involve many elements of the Australian Defence Organisation (ADO) and industry. Managing these processes more effectively is a responsibility of all managers and staff in the DMO and the ADO. This Guide is an important first step in defining high-level materiel life cycle processes across the ADO.This Guide provides a high-level view of the DMO Business Model processes which support the Defence Capability Systems Life Cycle. The DMO Business Model provides the governance, core and enabling processes.
|
DMO Material Lifecyle Guice (PDF 355k) |
|
DMO Material Lifecycle Management Guide
This is a graphic representation of the DMO Material Lifecycle Management Guide. The Guide graghically describes how these processes are managed and how they will mature over time. It has been developed for Defence personnel but will also be a useful reference for industry. The Guide is centred on the core business processes of Acquire Materiel Systems and Equipment and Provide In-Service Capability Support (including Disposal). It is not intended to describe the full extent of the DMO business process model.
|
DMO Material Lifecycle Management Guide (PDF 706.5K) |
|
DMO Guidance for the Preparation of an OCD, FPS and TCD
Guidance for the Preparation of an OCD, FPS and TCD is issued for use as guidance in developing the Operational Concept Document, Function and Performance Specification and Test Concepts Document as specified by the Capability Systems Life Cycle Management Guide 2001, December 2001. The purpose of this document is to provide guidance for the preparation of the set of documents that forms the basis of agreement of requirements between Capability Staff, Knowledge Staff and the Defence Materiel Organisation.
|
OCD, FPS and TCD 2001 (PDF 947k)
|
|
|
|
|
US Systems Engineering Fundamentals Guide 2001
This book provides a basic, conceptual-level description of engineering management disciplines that relate to the development and life cycle management of a system. For the non-engineer it provides an overview of how a system is developed. For the engineer and project manager it provides a basic framework for planning and assessing system development. The book is divided into four parts: Introduction; Systems Engineering Process; Systems Analysis and Control; and Planning, Organizing, and Managing.
|
US Systems Engineering Fundamentals 2001 (PDF 1.31M)
|
|
US Test & Evaluation Management Guide 2001
This book is one of many technical management educational guides written from a Department of Defense (DoD) perspective; i.e., non-Service peculiar. They are intended primarily for use in the courses at the Defense Systems Management College (DSMC), Defense Acquisition University (DAU), and secondarily as a desk reference for program and project management personnel. These guidebooks are written for current and potential acquisition management personnel who are familiar with basic terms and definitions employed in program offices. They are designed to assist government and industry personnel in executing their management responsibilities relative to the acquisition and support of defense systems.
|
US Test & Evaluation Management Guide 2001 (PDF 2.19M)
|
|
US SMC Systems Engineering Handbook 2004
This Systems Engineering handbook is written to provide the US Air Force Space and Missile Systems Center (SMC) personnel with fundamental systems engineering concepts and techniques as they apply to space and launch systems and the SMC environment. The handbook was written with prior recognition that Systems Engineering subject matter is very broad and approaches to performing Systems Engineering varies greatly. This exposition is not intended to cover them all. It addresses general concepts and common processes, tools, and techniques that are mostly familiar to SMC. It also provides recommended Systems Engineering practices and pitfalls to avoid. Many references are provided for the reader to consult for more in-depth knowledge.
|
SMC Systems Engineering Handbook (PDF 2.553M)
|
|
INCOSE Systems Engineering Handbook v3.0
The INCOSE Systems Engineering Handbook, version 3, represents a shift in paradigm toward global industry application consistent with the Systems Engineering Vision. The objective for this document is to provide an updated description of the key process activities performed by systems engineers. The intended audience is the new systems engineer, an engineer in another discipline who needs to perform systems engineering or an experienced systems engineer who needs a convenient reference.
|
INCOSE Systems Engineering Handbook v3.0 (PDF 4.366M)
|
|
Engineering Compex Systems
This book describes how to combine text descriptions and rigorous modeling to analyze and describe large or small complex systems. The systems engineering work begins with the needs of users, owners, and operators and with the realities of the marketplace.The systems engineering work transforms these needs into a description of a system architecture and design that specifies the components to be designed, implemented and integrated. The fundamental process for the engineering of systems is an optimization process. That process finds a near optimal solution for the system out of a multitude of possible solutions. The process produces rigorous descriptions of the near optimal solution by defining what the components are, what they must do, and how they interact to perform as a system. This book focuses on the technical engineering work of transforming needs to a near optimal system solution for complex systems that require multiple engineering disciplines to do the work.
|
Engineering Complex Systems (PDF 2.763M)
|
|
IEAust, The Engineering Professsion - A Statistical Overview 2006
This Handbook is designed to provide an overview of the engineering profession in Australia. In many spheres of life ideal statistics to achieve such a task are not available. This proved to be the case for the engineering profession. To overcome this limitation statistics from a wide variety of sources have been combined to provide the best available overview. Gaps remain and in coming years Engineers Australia will endeavour to remedy these by negotiating with responsible authorities, refining existing collections and analyses and, where possible, considering new ways to obtain the necessary information.
|
Statistical Overview 2006 (PDF 358k)
|
