Workshop on Reliability and Testing for Artificial Intelligence System (RTAIS 2020)

Description

Artificial intelligence system has played an important role in many fields such as image recognition, speech recognition, machine translation, and intrusion detection. At present, artificial intelligence system has an increasing use in safety-critical systems, which makes its correctness and reliability crucial. The intelligent characteristic and learning capability of artificial intelligence systems bring a new failure type which traditional software does not have. Therefore, it is necessary to put forward suitable and effective testing techniques and reliability assurance methods for artificial intelligence systems.

This workshop seeks to bring together researchers and practitioners working toward the improvement of reliability for intelligent system by discussing recent developments and current challenges and exchanging their research findings and experiences. The workshop welcomes papers and presentations in the field of artificial intelligence system, dealing with intelligent software reliability and testing.

Topics

The list of topics includes, but is not limited to:

• Artificial intelligence system failure mechanism
• Machine learning attack and threat models
• Defect detection, defect removal, and fault tolerance in artificial intelligence system
• Test method, test workflow, and test adequacy for artificial intelligence system
• Fuzz testing and mutation testing for machine learning and deep learning
• Testing technology of autopilot software, internet of things (IoT), and natural language interface (NLI)
• Artificial intelligence system reliability evaluation methodologies and metrics
• Correctness and predictability of artificial intelligence system behavior
• Reliability, robustness, and vulnerability of machine learning and deep learning
• Robustness and adversarial perturbation in neural network
• Dependability, reliability, safety and robustness of autopilot software, internet of things (IoT), and natural language interface (NLI)
• Architecture, design, and implementation of reliable artificial intelligence system
• Data quality of artificial intelligence system and bug detection in data
• Practical experiences, empirical studies, and testbeds for artificial intelligence system
• Industrial experiences and best practices for artificial intelligence system testing
• Reliability and testing studies of any other artificial intelligence related systems

Submission

Authors are invited to submit original unpublished research papers as well as industrial practice papers. Simultaneous submissions to other conferences are not permitted.

Papers should be written in English and submitted in the PDF format. The length of a camera ready paper will be limited to ten pages, including the title of the paper, the name and affiliation of each author, a 150-word abstract, and up to 6 keywords. Shorter version papers (up to four pages) are also allowed.

Authors must follow the IEEE 8.5x11 2-column conference proceedings format (PDF | Word DOC | LaTeX) to prepare their papers. Each submission will be reviewed by at least three program committee members. Paper selection is based on the originality, technical contribution, presentation quality, and relevance to the workshop.

At least one of the authors of each accepted paper is required to pay full registration fee and present the paper at the workshop. Arrangements are being made to publish selected accepted papers in reputable journals.

Program Chair

Jun Ai

Beihang University

Program Committee