Morest: Industry Practice of Automatic RESTful API Testing

Many big companies are providing cloud services through RESTful APIs nowadays. With the growing popularity of RESTful API, testing RESTful API becomes crucial. To address this issue, researchers have proposed several automatic RESTful API testing techniques. At Huawei, we design and implement an automatic RESTful API testing framework named Morest. Morest has been used to test ten RESTful API services and helped to detected 83 previously unknown bugs which were all confirmed and fixed by the developers. On one hand, we find that Morest shows great capability of detecting bugs in RESTful API s. On the other hand, we also notice that human effort is inevitable and important when applying automatic RESTful API techniques in practice. In this paper, we focus on discussing the industry practice of using automatic RESTful API testing techniques. We share our experience of building automatic RESTful API testing pipelines. Furthermore, we find that manual effort is essential for maintaining RESTful API specifications to increase the level of automation as well as generating regression test cases.