SQuAT Session (Software Quality Assurance Track)
Keys of Open Source Software Testing
Speaker: Hao KONG, Changfeng.
Abstract: Open source is one of the most popular strategy in software enterprise. With the source every one can study and develop the function of every open source software, how to ensure the quality of open source software is one of the
most import work we should do.
BSTQC（Beijing Software Testing & QA Center）has experience in quality control process of open source software include tester management, bug and testing process management testing tools and standards. With the lead and trainning of our professional testing engineer, many users become proper testers then joined the open source community.
The introduction of component based software production line of Peking University
Speaker: Yasha WANG (Peking University).
Abstract: The component based software production line (CBSPL) built by Peking University is a set of tools which can be integrated to support the whole lifecycle of CBSD (component based software development). The CBSPL support 3 processes of the CBSD. The producer reuse process is for the domain engineers to develop reusable components for future reuse opportunities. The consumer reuse process is for the application engineers to develop applications with the reusable components. The component management process is for the component managers to measure, test and organize components to support the producer reuse and consumer reuse process.
The CBSPL consists of 8 tools. The cooperative requirement elicitation and analysis tool, named as CRE, is a web based application. By this tool, different stakeholders, including requirement analyst, programmer, testers, clients, users, and other stakeholders, can communicate with each other in a set of pre‐defined scenarios and thus to decide the requirements of each scenario and related solution. The results of CRE are organized as a set of use cases and the commonalities and variabilities between different applications in the same domain can be identified through an automatic or semi‐automatic analysis. The feature oriented domain modeling tool, named as FODM, is a tool for domain engineers to define feature models for domains or for application engineers to customize an existing feature model to generate an application model according to specific requirements in the given domain. The meta‐model modeling tool, named as JB. MetaModeler, is a GUI‐based tool to define meta‐models, and it can generate modeling tools according to the defined meta‐model. The UML modeling tool, named as JB UML Modeler, is a GUI‐based modeler supporting OMG UML 2.0 standard, and it’s generated by the JB MetaModeler. The Round Trip Engineering Tool, named as OODIA, is a tool for programmers to write java codes and it always synchronizes the codes with related UML models. The component Measurement Tool, named as PKUMetric, is a tool to measure the component source code to analyze the class inheritance depth, lines of codes, McCabe complexity, and etc., which is the useful data to decide the trustiness of components. The Junit based test case management tool, named as Jtop, is a test case generator and also a test case manager for component testing. The software resource library, named as TSR (Trustie Software Resource Repository), can be used as
a component managing tool which provides provide mechanism to describe, collect, evaluate, classify and manage software resources’ trustworthiness, to support trust software development.
QualiPSO quality assessment methodology
Speaker:Prof. Alberto Sillitti, University of Bolzano-Bozen, Italy and Prof. Sandro Morasca, Università degli Studi dell'Insubria in Como and Varese, Italy.
Abstract: The assessment of the FLOSS quality, and specifically its trustworthiness, is one of the main issues for FLOSS adoption. The talk will present the approach to the evaluation of the quality of FLOSS products and processes introduced by the QualiPSo project, which is a EU-funded research project that specifically addresses these issues. The QualiPSo project has involved 19 industrial, institutional, and academic partners from the EU, China, and Brasil.
As for FLOSS product quality, two assessment models have been developed.
- MOSST (Model of Open Source Software Trustworthiness) provides an estimation of the probability/percentage of FLOSS stakeholders that would favorably rate a FLOSS product according to several qualities like trustworthiness, reliability, usability etc. So, if you are a developer of a FLOSS product, MOSST will give you an assessment of how well your product will be received and how to improve it. If you are a user, MOSST will tell you how other people may estimate the product’s trustworthiness. MOSST has been built based on a large number of interviews and the analysis of several FLOSS products.
- OP2A (Open source Product Portal Assessment) is a model for evaluating the quality of web portals that store FLOSS products. We carefully examined repositories and websites hosting a number of well-known FLOSS projects, and we found out that many of them should provide more complete and useful information to FLOSS stakeholders. OP2A assesses and classifies repositories and websites on three levels, bronze, silver, and gold, and shows what needs to be added to web portals. So, if you are a developer of a FLOSS product, OP2A will give you guidelines on how to improve the information on your product so you can promote it better. If you are a user, OP2A will provide an assessment of the information available and point out what missing pieces of information may be important to you to base your decisions.
As for FLOSS process quality, an assessment model have been developed.
- OMM (Open Maturity Model) is a CMMI-like capability maturity model specifically developed to address the needs of companies and structured communities developing and/or using open source software. OMM has been designed to assess quantitatively the ability of delivering and supporting open source products in an industrial context helping in the identification of the weaknesses of the process and providing suggestions for improvement. OMM is compatible with CMMI and cover all the aspects related to open source software.