http://www.open-do.org Toward a cooperative and open framework for the development of certifiable software Mon, 26 Jul 2010 09:49:12 +0000 en hourly 1 http://www.open-do.org/2010/02/24/do-178-couverture-and-the-source-code-vs-object-code-coverage-debate/ http://www.open-do.org/2010/02/24/do-178-couverture-and-the-source-code-vs-object-code-coverage-debate/#comments Wed, 24 Feb 2010 09:43:55 +0000 matteo bordin http://www.open-do.org/?p=1022 Couverture is a qualifiable tool to measure structural coverage. This paper describes how the Couverture technology copes with the “Souce Code VS Object Code Coverage” debate in a DO-178 context.

The Couverture project is hosted on the Open-DO Forge.

The attached paper is also published in the Ada User Journal, December 2009 issue.
]]> http://www.open-do.org/2010/02/24/do-178-couverture-and-the-source-code-vs-object-code-coverage-debate/feed/ 0 http://www.open-do.org/2009/12/02/the-open-do-qualifying-machine/ http://www.open-do.org/2009/12/02/the-open-do-qualifying-machine/#comments Wed, 02 Dec 2009 09:29:24 +0000 matteo bordin http://www.open-do.org/?p=903 Qualifying Machine (QM) is an agile and lean infrastructure to ease DO-178 tool qualification. The main goal of a QM is to ease the manipulation of all artifacts within the whole application life cycle and to track the activities performed by the development team.

Within Open-DO, we released an instantiation of the QM concept for GNATcheck, a coding standard checking tool qualifiable for DO-178. The infrastructure and qualification material (including the Tool Qualification Plan and the testing framework) are freely available as open source in the Open-DO forge. With this initiative, we intend to promote open collaborations in the high-assurance domain and to show how to deploy a lean and agile qualification process.

You can get more information on the Open-DO Qualifying Machine and download its instantiation for GNATcheck here.]]> http://www.open-do.org/2009/12/02/the-open-do-qualifying-machine/feed/ 0 http://www.open-do.org/2009/06/04/is-it-finally-time-for-agile-do-178-certificationqualification/ http://www.open-do.org/2009/06/04/is-it-finally-time-for-agile-do-178-certificationqualification/#comments Thu, 04 Jun 2009 20:13:16 +0000 matteo bordin http://www.open-do.org/?p=467 problems encountered within the AirBus 400M program highlight the importance of deploying an effective infrastructure when developing high-integrity systems. The core of DO-178 is indeed really about:

• the quality of artifacts (how good is a requirement/algorithm/test/etc.?)
• the quality of relations between artifacts (can I justify the existence of an artifact by tracing it to other artifacts?)
• the evidence a well-defined process has been followed (was I faithful to my plan?)

The major issue within DO-178 is thus to provide evidence of the points above at a reasonable cost. The DO-178 standard enforces a requirement-driven process  with a focus on verification activities: the connection with Test-Driven Development is thus evident, as explained in the Open-DO Concepts and Ideas. 

So far, I’ve seen two major experiments to support lean and agile DO-178 certification/qualification. The first is through the use of complete tools such as OSEE. OSEE is able to track each user activity along with the artifacts it involves: it is “basically” an Application Lifecycle Management System integrated with an Action Tracking System, an Automated Testing Framework, a Requirement Management System and advanced Version Control System. Evidence of the quality of  artifacts  and of their mutual relations is provided by checking that appropriate verification activities have been performed; on the other side, evidence that a given plan has been followed is provided by analyzing the flow of tracked actions against a user-defined workflow. OSEE has been extensively used at Boeing for the Apache Program.

An alternative approach can be applied for more lightweight processes, for example the qualification of a verification tool. We have been using an hacked version of FitNesse (a web-based tool for acceptance testing) to support:

• requirements, test cases and (unit) tests management;
• tests execution;
• editing of qualification documentation (Tool Qualification Plan, Quality Assurance Plan, etc.);
• tracking of verification and quality assurance activities when needed.

We are able to track verification and quality assurance activities for each atomic artifact and we use our Version Control System to check that artifacts are modified following a precise order (a verification activity for a given artifact shall take place after the editing of the same artifact). This lightweight approach is effective, but so far we have applied it just for the qualification of verification tools.

Applying lean and agile methodologies to DO-178 certification/qualification requires investing on tools – but the reward is well worth the cost. What is your experience with this? Which tools do you use? Comments are welcome!]]> http://www.open-do.org/2009/06/04/is-it-finally-time-for-agile-do-178-certificationqualification/feed/ 3