+
Skip to content

Solve issues with schemathesis/action to 2.x #328

@cmil

Description

@cmil

When switching to schemathesis/action 2.1.0 the numerous API tests fail while the test suite passes with 1.1.0. We need to look into this and find solutions before can upgrade.

Here is the relevant part of the action output:

=================================== FAILURES ===================================
__________________________________ GET /info ___________________________________
1. Test Case ID: tO7zqn

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/info

_________________________________ GET /corpora _________________________________
1. Test Case ID: SCSnsi

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/corpora?include=metrics'

__________________________ GET /corpora/{corpusname} ___________________________
1. Test Case ID: I3Xyb1

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger

______________________ GET /corpora/{corpusname}/metadata ______________________
1. Test Case ID: 0Lj72V

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/metadata

____________________ GET /corpora/{corpusname}/metadata/csv ____________________
1. Test Case ID: rE7Zne

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/metadata/csv

__________________ GET /corpora/{corpusname}/plays/{playname} __________________
1. Test Case ID: apxfgB

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti

______________ GET /corpora/{corpusname}/plays/{playname}/metrics ______________
1. Test Case ID: YAxxyo

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/metrics

________________ GET /corpora/{corpusname}/plays/{playname}/tei ________________
1. Test Case ID: cdvZ7D

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/tei

________________ GET /corpora/{corpusname}/plays/{playname}/txt ________________
1. Test Case ID: nBrpE4

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/txt

____________ GET /corpora/{corpusname}/plays/{playname}/characters _____________
1. Test Case ID: M3OzBw

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/characters

__________ GET /corpora/{corpusname}/plays/{playname}/characters/csv ___________
1. Test Case ID: j4no6x

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/characters/csv

_________ GET /corpora/{corpusname}/plays/{playname}/networkdata/gexf __________
1. Test Case ID: CbVwN7

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/networkdata/gexf

__________ GET /corpora/{corpusname}/plays/{playname}/networkdata/csv __________
1. Test Case ID: WHV2HR

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/networkdata/csv

___________ GET /corpora/{corpusname}/plays/{playname}/relations/csv ___________
1. Test Case ID: lGfLF3

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/relations/csv

________ GET /corpora/{corpusname}/plays/{playname}/networkdata/graphml ________
1. Test Case ID: hHlfAu

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/networkdata/graphml

_________ GET /corpora/{corpusname}/plays/{playname}/relations/graphml _________
1. Test Case ID: 6se8DN

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/relations/graphml

__________ GET /corpora/{corpusname}/plays/{playname}/relations/gexf ___________
1. Test Case ID: RJDEZp

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/relations/gexf

_____ GET /corpora/{corpusname}/plays/{playname}/spoken-text-by-character ______
1. Test Case ID: fJ1q6R

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/spoken-text-by-character

_________ GET /corpora/{corpusname}/plays/{playname}/stage-directions __________
1. Test Case ID: iVbsMJ

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/stage-directions

__ GET /corpora/{corpusname}/plays/{playname}/stage-directions-with-speakers ___
1. Test Case ID: AclqWH

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/stage-directions-with-speakers

_________________________________ GET /id/{id} _________________________________
1. Test Case ID: ECkqVq

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/id/ger000023

_____________________________ GET /character/{id} ______________________________
1. Test Case ID: lRaSIU

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/character/Q131412

___________________________________ GET /dts ___________________________________
1. Test Case ID: iWqJaL

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/dts

____________ GET /corpora/{corpusname}/plays/{playname}/spoken-text ____________
1. Test Case ID: eopeoN

- Server error

[500] Internal Server Error:

    `<html>
    <head>
    <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
    <title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/spoken-text: err:XPTY0004 checking function parameter 1 in call {http://www.w3.org/2005/xpath-functions}tokenize(untyped-value-check[xs:string, $sex], &quot;,&quot;): XPTY0004: The actual cardinality for parameter 1 does not match the cardi // Output truncated...`

Reproduce with: 

    curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/corpora/ger/plays/lessing-emilia-galotti/spoken-text?sex=null&sex=null'

_____________________________ GET /dts/collection ______________________________
1. Test Case ID: 0EzdKw

- Server error

[500] Internal Server Error:

    `<html>
    <head>
    <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
    <title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/dts/collection: err:FORG0006 effectiveBooleanValue: first item of &apos;(null, null)&apos; is not a node, and sequence length &gt; 1 [at line 195, column 3]
    In function:
    	ddts:collections($id as xs:string*, $page as xs:string*, $nav as xs:string*) as item()+ [-1:-1:/db/apps/dracor // Output truncated...`

Reproduce with: 

    curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/dts/collection?id=null&id=null'

______________________________ GET /dts/document _______________________________
1. Test Case ID: r7NQ4l

- Server error

[500] Internal Server Error:

    `<html>
    <head>
    <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
    <title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/dts/document: err:FORG0006 effectiveBooleanValue: first item of &apos;(null, null)&apos; is not a node, and sequence length &gt; 1 [at line 939, column 23]
    In function:
    	ddts:document($resource as item()*, $ref as item()*, $start as item()*, $end as item()*, $tree as item()*, $med // Output truncated...`

Reproduce with: 

    curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/dts/document?resource=https%3A%2F%2Fdracor.org%2Fid%2Fger000088&start=null&start=null'

__________________________ GET /wikidata/author/{id} ___________________________
1. Test Case ID: vfukZs

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/wikidata/author/Q34628

___________________________ GET /wikidata/mixnmatch ____________________________
1. Test Case ID: HXc86Z

- Server error

[501] Not Implemented:

    <EMPTY>

Reproduce with: 

    curl -X PATCH -H 'Authorization: [Filtered]' http://localhost:8081/exist/restxq/v1/wikidata/mixnmatch

_____________________________ GET /dts/navigation ______________________________
1. Test Case ID: FnWrwG

- Server error

[500] Internal Server Error:

    `<html>
    <head>
    <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
    <title>Error 500 javax.servlet.ServletException: javax.servlet.ServletException: An error occurred while processing request to /exist/restxq/v1/dts/navigation: err:FORG0006 effectiveBooleanValue: first item of &apos;(null, null)&apos; is not a node, and sequence length &gt; 1 [at line 1803, column 23]
    In function:
    	ddts:navigation($resource as item()*, $ref as item()*, $start as item()*, $end as item()*, $level as item()* // Output truncated...`

Reproduce with: 

    curl -X GET -H 'Authorization: [Filtered]' 'http://localhost:8081/exist/restxq/v1/dts/navigation?resource=https%3A%2F%2Fdracor.org%2Fid%2Fger000088&start=null&start=null'

=================================== WARNINGS ===================================

Missing test data: 23 operations repeatedly returned 404 Not Found, preventing tests from reaching your API's core logic

  - GET /corpora/{corpusname}
  - GET /corpora/{corpusname}/metadata
  - GET /corpora/{corpusname}/metadata/csv
  + 20 more

💡 Provide realistic parameter values in your config file so tests can access existing resources

Schema validation mismatch: 4 operations mostly rejected generated data due to validation errors, indicating schema constraints don't match API validation

  - GET /character/{id}
  - GET /dts/collection
  - GET /dts/document
  + 1 more

💡 Check your schema constraints - API validation may be stricter than documented

=================================== SUMMARY ====================================

API Operations:
  Selected: 29/35
  Tested: 29

Test Phases:
  ✅ API probing
  ✅ Examples
  ❌ Coverage
  ✅ Fuzzing
  ⏭  Stateful (not applicable)

Failures:
  ❌ Server error: 29

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载