-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Milestone
Description
When switching to schemathesis/action
2.1.0 the numerous API tests fail while the test suite passes with 1.1.0. We need to look into this and find solutions before can upgrade.
Here is the relevant part of the action output:
=================================== FAILURES ===================================
__________________________________ GET /info ___________________________________
1. Test Case ID: tO7zqn
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/info
_________________________________ GET /corpora _________________________________
1. Test Case ID: SCSnsi
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/corpora?include=metrics'
__________________________ GET /corpora/{corpusname} ___________________________
1. Test Case ID: I3Xyb1
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger
______________________ GET /corpora/{corpusname}/metadata ______________________
1. Test Case ID: 0Lj72V
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/metadata
____________________ GET /corpora/{corpusname}/metadata/csv ____________________
1. Test Case ID: rE7Zne
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/metadata/csv
__________________ GET /corpora/{corpusname}/plays/{playname} __________________
1. Test Case ID: apxfgB
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti
______________ GET /corpora/{corpusname}/plays/{playname}/metrics ______________
1. Test Case ID: YAxxyo
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/metrics
________________ GET /corpora/{corpusname}/plays/{playname}/tei ________________
1. Test Case ID: cdvZ7D
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/tei
________________ GET /corpora/{corpusname}/plays/{playname}/txt ________________
1. Test Case ID: nBrpE4
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/txt
____________ GET /corpora/{corpusname}/plays/{playname}/characters _____________
1. Test Case ID: M3OzBw
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/characters
__________ GET /corpora/{corpusname}/plays/{playname}/characters/csv ___________
1. Test Case ID: j4no6x
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/characters/csv
_________ GET /corpora/{corpusname}/plays/{playname}/networkdata/gexf __________
1. Test Case ID: CbVwN7
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/networkdata/gexf
__________ GET /corpora/{corpusname}/plays/{playname}/networkdata/csv __________
1. Test Case ID: WHV2HR
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/networkdata/csv
___________ GET /corpora/{corpusname}/plays/{playname}/relations/csv ___________
1. Test Case ID: lGfLF3
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/relations/csv
________ GET /corpora/{corpusname}/plays/{playname}/networkdata/graphml ________
1. Test Case ID: hHlfAu
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/networkdata/graphml
_________ GET /corpora/{corpusname}/plays/{playname}/relations/graphml _________
1. Test Case ID: 6se8DN
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/relations/graphml
__________ GET /corpora/{corpusname}/plays/{playname}/relations/gexf ___________
1. Test Case ID: RJDEZp
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/relations/gexf
_____ GET /corpora/{corpusname}/plays/{playname}/spoken-text-by-character ______
1. Test Case ID: fJ1q6R
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/spoken-text-by-character
_________ GET /corpora/{corpusname}/plays/{playname}/stage-directions __________
1. Test Case ID: iVbsMJ
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/stage-directions
__ GET /corpora/{corpusname}/plays/{playname}/stage-directions-with-speakers ___
1. Test Case ID: AclqWH
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/stage-directions-with-speakers
_________________________________ GET /id/{id} _________________________________
1. Test Case ID: ECkqVq
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/id/ger000023
_____________________________ GET /character/{id} ______________________________
1. Test Case ID: lRaSIU
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/character/Q131412
___________________________________ GET /dts ___________________________________
1. Test Case ID: iWqJaL
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/dts
____________ GET /corpora/{corpusname}/plays/{playname}/spoken-text ____________
1. Test Case ID: eopeoN
- Server error
[500] Internal Server Error:
`<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/spoken-text: err:XPTY0004 checking function parameter 1 in call {http://www.w3.org/2005/xpath-functions}tokenize(untyped-value-check[xs:string, $sex], ","): XPTY0004: The actual cardinality for parameter 1 does not match the cardi // Output truncated...`
Reproduce with:
curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/spoken-text?sex=null&sex=null'
_____________________________ GET /dts/collection ______________________________
1. Test Case ID: 0EzdKw
- Server error
[500] Internal Server Error:
`<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/dts/collection: err:FORG0006 effectiveBooleanValue: first item of '(null, null)' is not a node, and sequence length > 1 [at line 195, column 3]
In function:
ddts:collections($id as xs:string*, $page as xs:string*, $nav as xs:string*) as item()+ [-1:-1:/db/apps/dracor // Output truncated...`
Reproduce with:
curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/dts/collection?id=null&id=null'
______________________________ GET /dts/document _______________________________
1. Test Case ID: r7NQ4l
- Server error
[500] Internal Server Error:
`<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/dts/document: err:FORG0006 effectiveBooleanValue: first item of '(null, null)' is not a node, and sequence length > 1 [at line 939, column 23]
In function:
ddts:document($resource as item()*, $ref as item()*, $start as item()*, $end as item()*, $tree as item()*, $med // Output truncated...`
Reproduce with:
curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/dts/document?resource=https%3A%2F%2Fdracor.org%2Fid%2Fger000088&start=null&start=null'
__________________________ GET /wikidata/author/{id} ___________________________
1. Test Case ID: vfukZs
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/wikidata/author/Q34628
___________________________ GET /wikidata/mixnmatch ____________________________
1. Test Case ID: HXc86Z
- Server error
[501] Not Implemented:
<EMPTY>
Reproduce with:
curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/wikidata/mixnmatch
_____________________________ GET /dts/navigation ______________________________
1. Test Case ID: FnWrwG
- Server error
[500] Internal Server Error:
`<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/dts/navigation: err:FORG0006 effectiveBooleanValue: first item of '(null, null)' is not a node, and sequence length > 1 [at line 1803, column 23]
In function:
ddts:navigation($resource as item()*, $ref as item()*, $start as item()*, $end as item()*, $level as item()* // Output truncated...`
Reproduce with:
curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/dts/navigation?resource=https%3A%2F%2Fdracor.org%2Fid%2Fger000088&start=null&start=null'
=================================== WARNINGS ===================================
Missing test data: 23 operations repeatedly returned 404 Not Found, preventing tests from reaching your API's core logic
- GET /corpora/{corpusname}
- GET /corpora/{corpusname}/metadata
- GET /corpora/{corpusname}/metadata/csv
+ 20 more
💡 Provide realistic parameter values in your config file so tests can access existing resources
Schema validation mismatch: 4 operations mostly rejected generated data due to validation errors, indicating schema constraints don't match API validation
- GET /character/{id}
- GET /dts/collection
- GET /dts/document
+ 1 more
💡 Check your schema constraints - API validation may be stricter than documented
=================================== SUMMARY ====================================
API Operations:
Selected: 29/35
Tested: 29
Test Phases:
✅ API probing
✅ Examples
❌ Coverage
✅ Fuzzing
⏭ Stateful (not applicable)
Failures:
❌ Server error: 29
Metadata
Metadata
Assignees
Labels
No labels