To quantify the noise, we generated mock server code from the ground-truth Swagger files.
The generated servers only allow requests that are strictly in line with what is described in the corresponding Swagger files.
We performed requests against the generated servers using the unique URLs of the associated APIs and tracked whether they succeed or what errors they produce.
Table I denotes the percentage of errors found in this experiment in the columns marked “Errors in unique URLs”.
Endpoint errors relate to requests to endpoints that are not part of the Swagger definition. They occur, including for example, due to trailing slashes (“/”) ignored by the server or as correct endpoints are invoked with the wrong HTTP method.
Query errors correspond to requests containing query parameters that are not defined for that endpoint.