diff --git a/TSF/README.md b/TSF/README.md index 3c21f114bc..0359b6760d 100644 --- a/TSF/README.md +++ b/TSF/README.md @@ -75,7 +75,7 @@ For these files, and in particular the workflow files, caution must be exercised Moreover, some parts of the documentation must be adapted to the new version. -### What can not be updated without further precautions? +### What cannot be updated without further precautions? * ``cmake/ci.cmake`` This file defines, in particular, the various custom cmake targets; in particular, the various configurations for the execution of the unit- and integration-tests are defined. @@ -83,8 +83,8 @@ Moreover, some parts of the documentation must be adapted to the new version. In order to do this efficiently, the ctest command is adapted to automatically generate the junit-logs of each test-run. For this, the option ``--output-junit`` is set with output path ``../my_logs/TARGETNAME_junit.xml``, where TARGETNAME is replaced by the name of the respective cmake target; in case that this convention is insufficient to uniquely identify the logs, TARGETNAME is amended by a number. When updating, it must be ensured that these adaptations are preserved. - Moreover, if the update introduces new cmake targets or new executions of ctest, it must be ensured, that the junit-log is generated and stored with a similar naming convention in the folder "../my_logs/". - Otherwise, it can not be ensured that the test data are accurately captured. + Moreover, if the update introduces new cmake targets or new executions of ctest, it must be ensured that the junit-log is generated and stored with a similar naming convention in the folder "../my_logs/". + Otherwise, it cannot be ensured that the test data are accurately captured. * ``cmake/download_test_data.cmake`` This file is modified to ensure that the test-data are not downloaded from the original test-data repository, but instead from the copy of that repository within the Eclipse S-CORE organisation. @@ -94,16 +94,16 @@ Moreover, some parts of the documentation must be adapted to the new version. This file collects, in particular, the files containing the unit- and integration-tests in a list, which is given to cmake. Custom tests were added in TSF/tests to document the fulfillment of the expectations. To ensure that these tests are run, the file tests/CMakeLists.txt has been modified. - During the update, it must be ensured, that the custom tests are still being executed. + During the update, it must be ensured that the custom tests are still being executed. * ``.github/workflows/parent-workflow.yml`` - To ensure a specific execution order for the individual github workflows, their execution is orchestrated by the parent-workflow. + To ensure a specific execution order for the individual GitHub workflows, their execution is orchestrated by the parent-workflow. To guarantee that this order is respected, it must be ensured that every workflow except for ``comment_check_amalgamation.yml``, ``docs-cleanup.yml``, ``parent-workflow.yml``, ``scorecards.yml`` and ``stale.yml`` runs ``on workflow_call``, only. * ``.github/workflows/ubuntu.yml`` The ubuntu workflow orchestrates the parallel execution of various cmake targets with varying configurations running on the latest version of ubuntu. The first TSF related adaptation of this workflow is that every step, in which a junit-report is generated, generates an artifact. - It must be ensured, that these artifacts are still generated after the update. + It must be ensured that these artifacts are still generated after the update. The second adaptation is that the test-results are captured, processed and persistently stored or stored in the ubuntu-artifact. Therefore, it must be ensured that the jobs ``publish_test_data_success``, ``publish_test_data_failure``, ``publish_test_data_cancellation`` and ``ubuntu_artifact`` are executed. Moreover, in case that any further job is added by nlohmann, it must be ensured that this job is added to the list of jobs required before the latter workflows are executed. @@ -126,7 +126,7 @@ Moreover, some parts of the documentation must be adapted to the new version. For every workflow, it must be ensured that the conditions of their execution are unchanged. The workflows ``check_amalgamation``, ``codeql``, ``dependency_review``, ``labeler`` and ``test_trudag_extensions`` generate an artifact, which must not be changed. New workflows should be carefully reviewed. - If it is determined that their execution within the project is beneficial, and that they do not interfere with, then they should be integrated within the parent workflow at an appropriate place and their execution condition should be set to on ``workflow``, or their execution should be scheduled appropriately. + If it is determined that their execution within the project is beneficial, and that they do not interfere, then they should be integrated within the parent workflow at an appropriate place and their execution condition should be set to on ``workflow``, or their execution should be scheduled appropriately. It is strongly recommended that the new workflow produces an artifact on success, and that the validator ``check_artifact_exists`` is adapted accordingly. If nlohmann deletes any of the currently executed workflows, in particular ``check_amalgamation.yml``, ``codeql.yml``, ``dependency_review.yml``, ``labeler.yml``, ``test_trudag_extensions.yml`` and ``ubuntu.yml``, then it is strongly recommended to keep the currently executed version, since the automatic validator ``check_artifact_exists`` depends on the existence of these workflows. In case that it is determined that these workflows should be deleted also in the documented copy of ``nlohmann/json``, then the validator ``check_artifact_exists`` and all its occurrences must be adapted accordingly. @@ -144,7 +144,7 @@ The following adaptation is recommended, and has, unfortunately, not been automa The following adaptations to the documentation have been automated; the python-script TSF/scripts/update_helper.py may be used to assist with these changes. -For the error-free execution is it necessary, however, to adhere to the naming scheme json_version_X_XX_X, and to not change the structure of the directories. +For error-free execution, it is, however, necessary to adhere to the naming scheme json_version_X_XX_X, and not to change the structure of the directories. * ``TSF/Trustable/statements/JLS-11.md`` It must be ensured that the correct release date is used. @@ -168,7 +168,7 @@ Based on the above observations, the following steps are recommended for each up 1. Merge branch master from the original nlohmann/json into an external fork of the eclipse-score/inc_nlohmann_json repository, where steps 2-12 shall be performed. 2. Confirm the deletion of cifuzz.yml, macos.yml and windows.yml. 3. Resolve the potential merge conflict in publish-documentation.yml by rejecting the incoming changes. -4. Update the versions of the github actions, if necessary. +4. Update the versions of the GitHub Actions, if necessary. 5. Resolve the potential merge conflicts in check_amalgamation.yml, codeql.yml, dependency_review.yml, labeler.yml and test_trudag_extensions.yml to ensure that the artifacts are generated, i.e. the jobs ``Generate XXX artifact`` and ``Upload XXX artifact`` are retained. 6. Resolve the potential merge conflict in ubuntu.yml following the above instructions. 7. Resolve the potential merge conflicts in cmake/download_test_data.cmake and cmake/ci.cmake following the above instructions. @@ -197,7 +197,7 @@ The following should be considered: * How has the algorithm for the accumulation of the trustable score changed? Ideally, it is not changed, otherwise the necessity for a new review arises. * How has the data store interface changed? Ideally, it is not changed, but if it does and the expected schema format changes, data_store.py needs to be updated accordingly. -* How has the the expected configuration for the TSF items changed? It is known that this configuration changed (at least) once before. What does the potential change mean? +* How has the expected configuration for the TSF items changed? It is known that this configuration changed (at least) once before. What does the potential change mean? * Do all custom references and validators as well as the data store interface work as before? * Has the algorithm for the hashing changed, or are there any changes to the trustable scores? If so, investigate carefully! diff --git a/TSF/docs/ci_failure_rate_analysis.md b/TSF/docs/ci_failure_rate_analysis.md index c5f2e6669e..d614c117a2 100644 --- a/TSF/docs/ci_failure_rate_analysis.md +++ b/TSF/docs/ci_failure_rate_analysis.md @@ -52,7 +52,7 @@ This job was a short-lived Clang coverage experiment. In the selected time windo ### `ci_static_analysis_clang (ci_clang_tidy)` -In the analyzed period, most failed `ci_static_analysis_clang (ci_clang_tidy)` runs come from a few PRs that deliberately changed static analysis or CI tooling, plus real bug fix. In particular, PR [#4654](https://github.com/nlohmann/json/pull/4654) "Fix ~basic_json causing std::terminate", PR [#4663](https://github.com/nlohmann/json/pull/4663) "Add clang-tidy plugin to convert implicit conversions to explicit ones", and the change referenced as [#4701](https://github.com/nlohmann/json/pull/4701) "Suppress clang-analyzer-webkit.NoUncountedMemberChecker" all show multiple failed Ubuntu workflow runs while their clang-tidy / analyzer configuration was being tuned. Because this job treats every clang-tidy or analyzer diagnostic as a hard error, each new or stricter check initially makes the job fail until the warnings are fixed or suppressed. The resulting ~14 % failure rate is therefore explained by intentional tightening and maintenance of the static-analysis pipeline (plus normal PR iteration), rather than by unexplained or unaddressed misbehaviour in the library itself. +In the analysed period, most failed `ci_static_analysis_clang (ci_clang_tidy)` runs come from a few PRs that deliberately changed static analysis or CI tooling, plus real bug fixes. In particular, PR [#4654](https://github.com/nlohmann/json/pull/4654) "Fix ~basic_json causing std::terminate", PR [#4663](https://github.com/nlohmann/json/pull/4663) "Add clang-tidy plugin to convert implicit conversions to explicit ones", and the change referenced as [#4701](https://github.com/nlohmann/json/pull/4701) "Suppress clang-analyzer-webkit.NoUncountedMemberChecker" all show multiple failed Ubuntu workflow runs while their clang-tidy / analyzer configuration was being tuned. Because this job treats every clang-tidy or analyzer diagnostic as a hard error, each new or stricter check initially makes the job fail until the warnings are fixed or suppressed. The resulting ~14 % failure rate is therefore explained by intentional tightening and maintenance of the static-analysis pipeline (plus normal PR iteration), rather than by unexplained or unaddressed misbehaviour in the library itself. ### `ci_test_coverage` @@ -103,7 +103,7 @@ branch / permission issues) rather than to the execution of the tests themselves. The job `clone_missing_labels` belongs to the separate “Labeler Workflow” and -synchronizes GitHub issue/PR labels for this repository with the organisation +synchronises GitHub issue/PR labels for this repository with the organisation defaults. Its 2.63 % failure rate corresponds to 1 failed run out of 38, and is related to repository/label management rather than to building or testing the JSON library. @@ -113,7 +113,7 @@ observed high failure rates were confined to publishing or repository-management ## Conclusion -Taken together, a period of there months show that all test-related +Taken together, a period of three months shows that all test-related jobs in the Parent Workflow have 0 % failures, while the few non-zero failure rates are confined to meta-jobs that handle publishing of historical test data and label synchronization. This indicates a stable CI setup for diff --git a/TSF/docs/introduction/index.rst b/TSF/docs/introduction/index.rst index c2418a1297..751d17e93a 100644 --- a/TSF/docs/introduction/index.rst +++ b/TSF/docs/introduction/index.rst @@ -28,27 +28,27 @@ The JSON library by Niels Lohmann was developed with several design goals in min - **Trivial Integration**: Comprising a single header file `json.hpp`, this library demands no complex build systems or dependencies, facilitating easy integration into any project using vanilla C++11. -- **Serious Testing**: Extensive unit tests ensure 100% coverage of the code, including exceptional behavior. Tools like Valgrind and Clang Sanitizers verify memory safety, while Google OSS-Fuzz performs continuous fuzz testing. +- **Serious Testing**: Extensive unit tests ensure 100% coverage of the code, including exceptional behaviour. Tools like Valgrind and Clang Sanitizers verify memory safety, while Google OSS-Fuzz performs continuous fuzz testing. Notably, memory efficiency and speed were not primary focuses, allowing for slight trade-offs in these areas to prioritize ease of integration and reliability. Baselibs Project Context ------------------------ -The integration effort is situated within the baselibs project, aimed at qualifying library performance and compliance with internal standards. As part of this project, the TSF process has been embedded into the score repository to generate and analyze evidence regarding software trustability. +The integration effort is situated within the baselibs project, aimed at qualifying library performance and compliance with internal standards. As part of this project, the TSF process has been embedded into the score repository to generate and analyse evidence regarding software trustability. Component Classification Strategy ----------------------------------- -- **Process Overview**: The baselibs project is upholding the TSF to define guidelines and generate reliable evidence of compliance, analyzing specific requirements such as MISRA and functionality consistency. +- **Process Overview**: The baselibs project is upholding the TSF to define guidelines and generate reliable evidence of compliance, analysing specific requirements such as MISRA and functionality consistency. - **Challenges and Decisions**: - Divergence from the original library code has been discussed to minimize unnecessary interference while adhering to project needs. - MISRA compliance is selectively applied, and necessary adaptations are considered at the upstream level where applicable. - **Strategic Directions**: - - Evidence requirements are mapped and analyzed for gaps, leading to possible code amendments or forks. - - Questions concerning the library's behavior are systematically answered, providing coverage details and tracing requirements to standards like ISO. + - Evidence requirements are mapped and analysed for gaps, leading to possible code amendments or forks. + - Questions concerning the library's behaviour are systematically answered, providing coverage details and tracing requirements to standards like ISO. Find more descriptions on the ongoing process and requirements at `Eclipse Process Description `_. diff --git a/TSF/docs/nlohmann_closed_misbehaviours.md b/TSF/docs/nlohmann_closed_misbehaviours.md index adc4543fc5..4f2f693c57 100644 --- a/TSF/docs/nlohmann_closed_misbehaviours.md +++ b/TSF/docs/nlohmann_closed_misbehaviours.md @@ -13,7 +13,7 @@ issue-id | applies to S-CORE | problem | resolution | closed after ---------|-------------------|---------|------------|------------- [2147](https://github.com/nlohmann/json/issues/2147) | No | Compilation error report for very old GCC (4.8.5) with `std::bind`/`std::function`. | Was labeled as a compiler bug; closed as stale after no further comment from author after trial of workaround. | 2.5 months [2574](https://github.com/nlohmann/json/issues/2574) | No | `get>()` fails for non-default-constructible element types. | Was fixed in https://github.com/nlohmann/json/pull/2576 and ticket closed after release in 3.10. | 3.5 months -[2655](https://github.com/nlohmann/json/issues/2655) | No | `std::pair` serialization expectation mismatch, object serialized instead of arrays. | Documentation updated to better explain behavior. | 5 months +[2655](https://github.com/nlohmann/json/issues/2655) | No | `std::pair` serialization expectation mismatch, object serialized instead of arrays. | Documentation updated to better explain behaviour. | 5 months [2676](https://github.com/nlohmann/json/issues/2676) | No | NVCC warnings when instantiating templates under CUDA. | Was fixed in https://github.com/nlohmann/json/pull/3227 after release in 3.10.5. | 10 months [2725](https://github.com/nlohmann/json/issues/2725) | No | Build with `-fno-exceptions` (and/or `JSON_NOEXCEPTIONS`) still hits `throw`. | Was already fixed in https://github.com/nlohmann/json/pull/2347. | the same day [3025](https://github.com/nlohmann/json/issues/3025) | No | Brace-initialization in function calls was reported to select a copy path (`func({j});` prints `10` instead of `[10]`). | Was a duplicate of https://github.com/nlohmann/json/issues/2311 and that issue was declared not a bug and solved by referencing to Docu. | next day diff --git a/TSF/docs/non_reproducible_tests.md b/TSF/docs/non_reproducible_tests.md index 2b50d69c8a..bf122d31e5 100644 --- a/TSF/docs/non_reproducible_tests.md +++ b/TSF/docs/non_reproducible_tests.md @@ -65,7 +65,7 @@ Verifies that the library can be embedded directly into a CMake project using `a - Builds multiple executables (`with_namespace_target`, `without_namespace_target`, `without_exceptions`) - Each build creates object files, executables with embedded timestamps - Subsequent runs create new artifacts with different timestamps -- CMake's incremental build cache persists between runs, causing different behavior +- CMake's incremental build cache persists between runs, causing different behaviour --- diff --git a/TSF/scripts/README.md b/TSF/scripts/README.md index 4095db22e9..aad99a9ef2 100644 --- a/TSF/scripts/README.md +++ b/TSF/scripts/README.md @@ -4,7 +4,7 @@ The following scripts are used in the automatic compilation of the trustable rep ## capture_test_data.py -The python-script [capture_test_data.py](capture_test_data.py) is intended to run at the end of the [ubuntu-workflow](../../.github/workflows/ubuntu.yml). It collects and combines the test-results that were collected in the individual jobs, appends the persistent test data storage and generates a database containing the results of the most recent tests only. Since storage space on the github is limited, the storage of test data is limited to two weeks only. It must be noted that this implementation is only intended as a temporary proof of concept! +The python-script [capture_test_data.py](capture_test_data.py) is intended to run at the end of the [ubuntu-workflow](../../.github/workflows/ubuntu.yml). It collects and combines the test-results that were collected in the individual jobs, appends the persistent test data storage and generates a database containing the results of the most recent tests only. Since storage space on GitHub is limited, the storage of test data is limited to two weeks only. It must be noted that this implementation is only intended as a temporary proof of concept! ## capture_test_data_memory_sensitive.py @@ -23,7 +23,7 @@ Moreover, a size-check is performed on the persistent storage, using the followi * It is expected, that less than 1,000 workflow runs, where a record of the test-result is triggered, happen per year, since these are only triggered once daily and on each push to main. * It is expected, that a ten-year-record of test-results is sufficient for documentation purposes. -In view of these assumptions, we limit the storage to approximately 100,000 test-results and 100,000 workflow-metadata, which guarantees *en passant* that github's file size limit of 100MB is respected. +In view of these assumptions, we limit the storage to approximately 100,000 test-results and 100,000 workflow-metadata, which guarantees *en passant* that GitHub's file size limit of 100MB is respected. In the worst case that every recorded test result is detected as a relevant change, this restraint collects test-results from 27 workflows in total. Whenever either limit of 100,000 test-results and 100,000 workflow-metadata in the persistent data storage is violated, the script returns the error "The persistent data storage is too large! Please move persistent data to external storage.", thereby failing the workflow, which advises the maintainer to take up action. diff --git a/TSF/scripts/capture_test_data.py b/TSF/scripts/capture_test_data.py index 4383c13962..673d1f4054 100644 --- a/TSF/scripts/capture_test_data.py +++ b/TSF/scripts/capture_test_data.py @@ -145,7 +145,7 @@ def get_all_xml_files(directory: str = '.') -> list[str]: # Due to storage space constraints, only most recent 100 test-results are stored. # Heuristic calculations have demonstrated that this should ensure that - # the TestResultData.db is below 100MiB, which is github's hard file size limit. + # the TestResultData.db is below 100MiB, which is GitHub's hard file size limit. cursor.execute("SELECT COUNT(*) FROM workflow_info") saved_test_data = int(cursor.fetchone()[0]) @@ -166,7 +166,7 @@ def get_all_xml_files(directory: str = '.') -> list[str]: saved_test_data = int(cursor.fetchone()[0]) # fill in metadata - # OBSERVE: This script expects the status of the github workflow as argument + # OBSERVE: This script expects the status of the GitHub workflow as argument repo = environment.get('GITHUB_REPOSITORY') run_id = environment.get('GITHUB_RUN_ID') run_attempt = environment.get('GITHUB_RUN_ATTEMPT') @@ -212,7 +212,7 @@ def get_all_xml_files(directory: str = '.') -> list[str]: cursor.execute(command) connector.commit() - # storage space on the github is limited. + # storage space on GitHub is limited. # finally, most recent test data are stored separately diff --git a/TSF/scripts/capture_test_data_memory_sensitive.py b/TSF/scripts/capture_test_data_memory_sensitive.py index 707e6a394a..6fb3e43682 100644 --- a/TSF/scripts/capture_test_data_memory_sensitive.py +++ b/TSF/scripts/capture_test_data_memory_sensitive.py @@ -195,7 +195,7 @@ def find_most_recent_results(target: str, name: str, compiler: str, cpp_standard raise RuntimeError("The persistent data storage is too large! Please move persistent data to external storage.") # fill in metadata - # OBSERVE: This script expects the status of the github workflow as argument + # OBSERVE: This script expects the status of the GitHub workflow as argument repo = environment.get('GITHUB_REPOSITORY') run_id = environment.get('GITHUB_RUN_ID') run_attempt = environment.get('GITHUB_RUN_ATTEMPT') diff --git a/TSF/scripts/generate_list_of_misbehaviours.py b/TSF/scripts/generate_list_of_misbehaviours.py index c6cac25d12..80d90e350f 100644 --- a/TSF/scripts/generate_list_of_misbehaviours.py +++ b/TSF/scripts/generate_list_of_misbehaviours.py @@ -28,7 +28,7 @@ print("# Misbehaviours Report\n") print(f"This report lists known misbehaviours or bugs of version {version} of the nlohmann/json repository.") - print("The misbehaviours are compiled from github issues of the nlohmann/json repository, and link to each corresponding issue.\n") + print("The misbehaviours are compiled from GitHub issues of the nlohmann/json repository, and link to each corresponding issue.\n") print("## Open issues\n") diff --git a/TSF/trustable/assertions/TA-ANALYSIS-CHECKLIST.md b/TSF/trustable/assertions/TA-ANALYSIS-CHECKLIST.md deleted file mode 100644 index b1b19b5e98..0000000000 --- a/TSF/trustable/assertions/TA-ANALYSIS-CHECKLIST.md +++ /dev/null @@ -1,64 +0,0 @@ -#### Checklist for TA-ANALYSIS from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* What fraction of Expectations are covered by the test data? - - **Answer**: The two expectations are JLEX-01 and JLEX-02. Every statement supporting both of the expectations is ultimately supported by a test, except for WFJ-06. For WFJ-06 it is impossible to provide a direct tests, since this is a statement on infinitely many cases. Indirect tests are provided by the rejection of ill-formed json data. - -* What fraction of Misbehaviours are covered by the monitored indicator data? - - **Answer**: For the intended use-case, no misbehaviours have been identified. Furthermore, no indicator data are collected. - -* How confident are we that the indicator data are accurate and timely? - - **Answer**: No indicator data are collected. - -* How reliable is the monitoring process? - - **Answer**: Due to no indicator data being collected, there is no monitoring process. - -* How well does the production data correlate with our test data? - - **Answer**: Due to the general nature of the library, there are no production data. - -* Are we publishing our data analysis? - - **Answer**: Since we have no production data with which to compare our not collected indicator data or our test data, no data analysis is done, which is not published. - -* Are we comparing and analysing production data vs test? - - **Answer**: There are no production data. - -* Are our results getting better, or worse? - - **Answer**: Neither. - -* Are we addressing spikes/regressions? - **Answer**: There are no spikes in the non-existent indicator data. If a test ever fails, then the spike is investigated. The results of fuzz testing are investigated in the original nlohmann/json. - -* Do we have sensible/appropriate target failure rates? - - **Answer**: For the unit and integration tests, zero. The target failure rate of fuzz testing is not under our control. - -* Do we need to check the targets? - - **Answer**: For the unit and integration tests, no. Since the fuzz testing runs and is investigated in the original nlohmann/json, there is no need to check the target. - -* Are we achieving the targets? - - **Answer**: For the unit and integration tests, yes. The achieving of the targets for the fuzz-testing is evaluated within the original nlohmann/json. - -* Are all underlying assumptions and target conditions for the analysis specified? - - **Answer**: Since none of the unit and integration tests are expected to fail, there is no further analysis of the results besides verifying the expectation. In case any test fails ever, the failure of the CI-pipeline encourages the maintainer to investigate. - -* Have the underlying assumptions been verified using known good data? - - **Answer**: The assumption that all unit and integration tests succeed under the expected conditions is demonstrated by the non-failure of the CI-Pipeline. - -* Has the Misbehaviour identification process been verified using known bad data? - - **Answer**: Misbehaviours published on nlohmann/json usually provide minimal working examples for reproducing the faulty behaviour, enabling everyone to verify the identified misbehaviours. There is, however, no automatic process for the identification of misbehaviours. - -* Are results shown to be reproducible? - - **Answer**: It is expected that the tests can be reproduced on every modern sufficiently powerful machine. diff --git a/TSF/trustable/assertions/TA-ANALYSIS_CONTEXT.md b/TSF/trustable/assertions/TA-ANALYSIS_CONTEXT.md index 24d2a44437..82f1a08e80 100644 --- a/TSF/trustable/assertions/TA-ANALYSIS_CONTEXT.md +++ b/TSF/trustable/assertions/TA-ANALYSIS_CONTEXT.md @@ -61,7 +61,7 @@ that may indicate problems in development, test, or production. - What fraction of Expectations are covered by the test data? - **Answer**: The two expectations are JLEX-01 and JLEX-02. Every statement supporting either of these expectations is ultimately supported by a test, except for WFJ-06. WFJ-06 specifies that `basic_json::accept` must accept exactly JSON values for all possible inputs. Since there are infinitely many possible inputs, this cannot be tested exhaustively. Indirect tests are provided by the rejection of ill-formed json data. This traceability is established by requiring each supporting statement under JLEX-01/02 to reference the relevant CI test(s), and the suitability of the referenced tests as evidence is validated during SME review as part of the scoring process (see JLS-74). - What fraction of Misbehaviours are covered by the monitored indicator data? - - **Answer**: Currently there is no indicators implemented, that focus on runtime behavior. The only indicators implemented are a coverage gate and PR count gate that are both part of the CI. The data therefore is available via the GitHub actions history. + - **Answer**: Currently there are no indicators implemented that focus on runtime behaviour. The only indicators implemented are a coverage gate and PR count gate that are both part of the CI. The data is therefore available via the GitHub Actions history. - How confident are we that the indicator data are accurate and timely? - **Answer**: See the previous question. Since we just implemented a coverage gate and PR count gate as general indicators, that data is produced automatically by the CI and therefore is generated consistently for every run. We are confident that the values are timely, as they are updated on each CI execution, and accurate to the extent that GitHub Actions reflects the executed workflows and their recorded outputs. - How reliable is the monitoring process? @@ -69,7 +69,7 @@ that may indicate problems in development, test, or production. - How well does the production data correlate with our test data? - **Answer**: There are no production data. - Are we publishing our data analysis? - - **Answer**: Analyses of CI tests failure rates are published in the TSF documentation on GitHub (via ci_failure_rate_analysis.md), but there is currently no published analysis of production monitoring data. + - **Answer**: Analyses of CI test failure rates are published in the TSF documentation on GitHub (via ci_failure_rate_analysis.md), but there is currently no published analysis of production monitoring data. - Are we comparing and analysing production data vs test? - **Answer**: There is no production data. - Are our results getting better, or worse? @@ -83,7 +83,7 @@ that may indicate problems in development, test, or production. - Are we achieving the targets? - **Answer**: For the unit and integration tests, yes. The degree of target achievement for the fuzz-testing is evaluated within the original nlohmann/json repository. - Are all underlying assumptions and target conditions for the analysis specified? - - **Answer**: For all tests, the underlying assumption and target condition is that they should cover all expectations, and that no test is expected to fail. Any failed tests are analyzed and reasonably justified or fixed. + - **Answer**: For all tests, the underlying assumption and target condition is that they should cover all expectations, and that no test is expected to fail. Any failed tests are analysed and reasonably justified or fixed. - Have the underlying assumptions been verified using known good data? - **Answer**: The input data from [nlohmann/json_test_data](https://github.com/nlohmann/json_test_data/tree/master) which is used for the tests contain both known good data and known bad data. As each expectation is mapped to a sub-set of tests, it is indeed verified that the underlying assumption is reasonably verified. - Has the Misbehaviour identification process been verified using known bad data? diff --git a/TSF/trustable/assertions/TA-BEHAVIOURS-CHECKLIST.md b/TSF/trustable/assertions/TA-BEHAVIOURS-CHECKLIST.md deleted file mode 100644 index b73565646d..0000000000 --- a/TSF/trustable/assertions/TA-BEHAVIOURS-CHECKLIST.md +++ /dev/null @@ -1,50 +0,0 @@ -#### Checklist for TA-BEHAVIOURS from [Codethink](https://pages.eclipse.dev/eclipse/tsf/tsf/print_page.html) - -* How has the list of Expectations varied over time? - - **Answer**: The list of expectations is taken from [here](https://eclipse-score.github.io/score/main/modules/baselibs/json/docs/requirements/index.html), whose development can be retraced using git. - -* How confident can we be that this list is comprehensive? - - **Answer**: The list of expectations has been collected amongst the stakeholders in S-CORE, so that we are very confident that the list is comprehensive. - The expectation to serialize user data into JSON format - -* Could some participants have incentives to manipulate information? - - **Answer**: We can not imagine any reason. - -* Could there be whole categories of Expectations still undiscovered? - - **Answer**: It is unlikely, but the parsing of CBOR could become relevant at some time. - -* Can we identify Expectations that have been understood but not specified? - - **Answer**: No. - -* Can we identify some new Expectations, right now? - - **Answer**: No. - -* How confident can we be that this list covers all critical requirements? - - **Answer**: We can not think of any more critical requirement of a JSON parser in the sense of RFC8259 than to parse JSON data in the sense of RFC8259. - -* How comprehensive is the list of tests? - - **Answer**: Currently, the branch coverage is 93.865% and the line coverage is 99.186%, cf. JLS-27. - -* Is every Expectation covered by at least one implemented test? - - **Answer**: Yes, both of the expectations are covered by at least one implemented test. Moreover, each statement supporting the expectations is covered by a test with the exception of WFJ-06. - -* Are there any Expectations where we believe more coverage would help? - - **Answer**: No. - -* How do dependencies affect Expectations, and are their properties verifiable? - - **Answer**: The library nlohmann/json does not have external dependencies, so that there are in particular none that affect Expectations. - -* Are input analysis findings from components, tools, and data considered in relation to Expectations? - - **Answer**: No findings have been found. diff --git a/TSF/trustable/assertions/TA-CONFIDENCE-CHECKLIST.md b/TSF/trustable/assertions/TA-CONFIDENCE-CHECKLIST.md deleted file mode 100644 index 0160733b07..0000000000 --- a/TSF/trustable/assertions/TA-CONFIDENCE-CHECKLIST.md +++ /dev/null @@ -1,17 +0,0 @@ -#### Checklist for TA-CONFIDENCE from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* What is the algorithm for combining/comparing the scores? - - **Answer**: It is the standard algorithm of trudag. - -* How confident are we that this algorithm is fit for purpose? - - **Answer**: We have no reason to assume that the standard algorithm is not fit for our purpose. - -* What are the trends for each score? - - **Answer**: CAN NOT BE ANSWERED NOW - -* How well do our scores correlate with external feedback signals? - - **Answer**: CAN NOT BE ANSWERED NOW \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-CONFIDENCE_CONTEXT.md b/TSF/trustable/assertions/TA-CONFIDENCE_CONTEXT.md index 18053d06a9..5fb34efdcf 100644 --- a/TSF/trustable/assertions/TA-CONFIDENCE_CONTEXT.md +++ b/TSF/trustable/assertions/TA-CONFIDENCE_CONTEXT.md @@ -44,4 +44,4 @@ scores given to Statements - What are the trends for each score? - **Answer**: At the moment, there are no trends as all statements have the review-status 'unreviewed'. However, the infrastructure for saving history of scores is already in place (see JLS-20). - How well do our scores correlate with external feedback signals? - - **Answer**: Such correlation can not be measured yet due to missing data. + - **Answer**: Such correlation cannot be measured yet due to missing data. diff --git a/TSF/trustable/assertions/TA-CONSTRAINTS-CHECKLIST.md b/TSF/trustable/assertions/TA-CONSTRAINTS-CHECKLIST.md deleted file mode 100644 index dfecb0c259..0000000000 --- a/TSF/trustable/assertions/TA-CONSTRAINTS-CHECKLIST.md +++ /dev/null @@ -1,29 +0,0 @@ -#### Checklist for TA-CONSTRAINTS from [Codethink](https://pages.eclipse.dev/eclipse/tsf/tsf/print_page.html) - -* Are the constraints grounded in realistic expectations, backed by real-world examples? - - **Answer**: The constraints originate from S-CORE (e.g. AOU-04, AOU-05, AOU-07, AOU-21), the standard RFC-8259 (e.g. AOU-05, AOU-20, AOU-21) and the library nlohmann/json itself (AOU-06, AOU-20) in order to ensure that the expectations are met. - -* Do they effectively guide downstream consumers in expanding upon existing Statements? - - **Answer**: ????? - -* Do they provide clear guidance for upstreams on reusing components with well-defined claims? - - **Answer**: ????? - -* Are any Statements explicitly designated as not reusable or adaptable? - - **Answer**: No statement has been intentionally designated as not reusable or adaptable. - -* Are there worked examples from downstream or upstream users demonstrating these constraints in practice? - - **Answer**: ???? - -* Have there been any documented misunderstandings from users, and are these visibly resolved? - - **Answer**: Yes, it is documented that the [brace initialisation](https://json.nlohmann.me/home/faq/) (cf. AOU-06) regularly leads to confusion, cf. [here](https://github.com/nlohmann/json/issues/4898). - -* Do external users actively keep up with updates, and are they properly notified of any changes? - - **Answer**: External users of the library are not necessarily automatically notified of an update, and are neither assumed nor required to keep up to date. If the external user forks the github repository, however, then github shows automatically whenever the upstream changes. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-CONSTRAINTS_CONTEXT.md b/TSF/trustable/assertions/TA-CONSTRAINTS_CONTEXT.md index db19c997dc..72754ef4fc 100644 --- a/TSF/trustable/assertions/TA-CONSTRAINTS_CONTEXT.md +++ b/TSF/trustable/assertions/TA-CONSTRAINTS_CONTEXT.md @@ -84,7 +84,7 @@ contradictions and obvious pitfalls within the defined Statements. - **Answer**: As the nlohmann/json library is widely used, its constraints (like the installation manual) are regularly read and applied and therefore demonstrated. - Have there been any documented misunderstandings from users, and are these visibly resolved? - - **Answer**: Yes, some recurring misunderstandings are explicitly documented and addressed via upstream documentation and closed issues. For example, brace-initialization unexpectedly yielding arrays and differing across compilers is called out in the [FAQ](https://json.nlohmann.me/home/faq/) and referenced from issues [here](https://github.com/nlohmann/json/issues/4898), and duplicate-key behavior is clarified in the release notes as unspecified by RFC-8259 (see [release notes](https://json.nlohmann.me/home/releases) and issue [#2667](https://github.com/nlohmann/json/discussions/2667)). + - **Answer**: Yes, some recurring misunderstandings are explicitly documented and addressed via upstream documentation and closed issues. For example, brace-initialization unexpectedly yielding arrays and differing across compilers is called out in the [FAQ](https://json.nlohmann.me/home/faq/) and referenced from issues [here](https://github.com/nlohmann/json/issues/4898), and duplicate-key behaviour is clarified in the release notes as unspecified by RFC-8259 (see [release notes](https://json.nlohmann.me/home/releases) and issue [#2667](https://github.com/nlohmann/json/discussions/2667)). - Do external users actively keep up with updates, and are they properly notified of any changes? - **Answer**: External users of the library are not necessarily automatically notified of an update, and are neither assumed nor required to keep up to date. If the external user forks the GitHub repository, however, then GitHub shows automatically whenever the upstream changes. diff --git a/TSF/trustable/assertions/TA-DATA-CHECKLIST.md b/TSF/trustable/assertions/TA-DATA-CHECKLIST.md deleted file mode 100644 index a0830a0fd2..0000000000 --- a/TSF/trustable/assertions/TA-DATA-CHECKLIST.md +++ /dev/null @@ -1,41 +0,0 @@ -#### Checklist for TA-DATA from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* Is all test data stored with long-term accessibility? - - **Answer**: If we assume that github is long-term accessible, then yes. - -* Is all monitoring data stored with long-term accessibility? - - **Answer**: There are no monitoring data. - -* Are extensible data models implemented? - - **Answer**: The data are stored in an sqlite database. - -* Is sensitive data handled correctly (broadcasted, stored, discarded, or anonymised) with appropriate encryption and redundancy? - - **Answer**: There are no sensitive data produced, collected or stored. - -* Are proper backup mechanisms in place? - - **Answer**: Not more than the default mechanisms of github. - -* Are storage and backup limits tested? - - **Answer**: No. - -* Are all data changes traceable? - - **Answer**: Yes, due to the usage of github. - -* Are concurrent changes correctly managed and resolved? - - **Answer**: Yes, due to the usage of github. - -* Is data accessible only to intended parties? - - **Answer**: Since the library is open source, there are no unintended parties. - -* Are any subsets of our data being published? - - **Answer**: Yes, the collected data are publicly available. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-FIXES-CHECKLIST.md b/TSF/trustable/assertions/TA-FIXES-CHECKLIST.md deleted file mode 100644 index aa0d619c07..0000000000 --- a/TSF/trustable/assertions/TA-FIXES-CHECKLIST.md +++ /dev/null @@ -1,62 +0,0 @@ -#### Checklist for TA-FIXES from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - - -* How many faults have we identified in XYZ? - - **Answer**: There are no identifiable faults concerning the expectations. - -* How many unknown faults remain to be found, based on the number that have been processed so far? - - **Answer**: It is unlikely that there are unknown faults concerning the expectations. - -* Is there any possibility that people could be motivated to manipulate the lists (e.g. bug bonus or pressure to close). - - **Answer**: Since the project is entirely open source, it is quite unlikely. - -* How many faults may be unrecorded (or incorrectly closed, or downplayed)? - - **Answer**: There may be none, at least when it concerns the expectations. - -* How do we collect lists of bugs and known vulnerabilities from components? - - **Answer**: We pull the list from the issues reported to nlohmann/json labelled as bug and open or opened since the last release. This list is then stored using github, thereby enabling a traceability of the list. - -* How (and how often) do we check these lists for relevant bugs and known vulnerabilities? - - **Answer**: Whenever we generate the documentation, the list is pulled. If there is an issue previously unrecorded, then the maintainer is encouraged by the change of the trustable score to check this issue on applicability. - -* How confident can we be that the lists are honestly maintained? - - **Answer**: We can not imagine a reason why the list could be dishonestly maintained. - -* Could some participants have incentives to manipulate information? - - **Answer**: We can not think of a reason why. - -* How confident are we that the lists are comprehensive? - - **Answer**: We have no reason to assume that discovered bugs are not reported to nlohmann/json. - -* Could there be whole categories of bugs/vulnerabilities still undiscovered? - - **Answer**: There could be a mislabelling of issues, but it is unlikely that there are bugs or vulnerabilities not labelled as bug, instead it is likely that perceived issues due to a misunderstanding of how the library works are labelled as bug. - -* How effective is our triage/prioritisation? - - **Answer**: ????? Since it is not intended to fix the library within S-CORE, but instead leave the development to the original nlohmann/json, there is no need to have a triage or prioritisation. - -* How many components have never been updated? - - **Answer**: None, the single component is up to date. - -* How confident are we that we could update them? - - **Answer**: If nlohmann/json would release an new version, we are very confident that we can update to that version. - -* How confident are we that outstanding fixes do not impact our Expectations? - - **Answer**: We have not found any outstanding fixes impacting our expectations. - -* How confident are we that outstanding fixes do not address Misbehaviours? - - **Answer**: For all of the none identified misbehaviours, we are very confident that none of the outstanding fixes do not address them. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-FIXES_CONTEXT.md b/TSF/trustable/assertions/TA-FIXES_CONTEXT.md index 10f561d79e..2c05b332a1 100644 --- a/TSF/trustable/assertions/TA-FIXES_CONTEXT.md +++ b/TSF/trustable/assertions/TA-FIXES_CONTEXT.md @@ -83,7 +83,7 @@ Each iteration, we should improve the algorithm based on measurements - How many faults may be unrecorded (or incorrectly closed, or downplayed)? - **Answer**: Few or none, considering the wide use of the nlohmann/json library (see JLS-05). - How do we collect lists of bugs and known vulnerabilities from components? - - **Answer**: We pull the list from the issues reported to nlohmann/json labelled as bug and are currently open or were opened since the last release. This list is then stored using GitHub, thereby enabling a traceability of the list. + - **Answer**: We pull the list from the issues reported to nlohmann/json labelled as bug and that are currently open or were opened since the last release. This list is then stored using GitHub, thereby enabling traceability of the list. - How (and how often) do we check these lists for relevant bugs and known vulnerabilities? - **Answer**: Whenever we generate the documentation, the list is pulled. If there is an issue previously unrecorded, then the maintainer is encouraged by the change of the trustable score to check the relevance of the issue. - How confident can we be that the lists are honestly maintained? diff --git a/TSF/trustable/assertions/TA-INDICATORS-CHECKLIST.md b/TSF/trustable/assertions/TA-INDICATORS-CHECKLIST.md deleted file mode 100644 index 2b6929c89a..0000000000 --- a/TSF/trustable/assertions/TA-INDICATORS-CHECKLIST.md +++ /dev/null @@ -1,49 +0,0 @@ -#### Checklist for TA-INDICATORS from [Codethink](https://pages.eclipse.dev/eclipse/tsf/tsf/print_page.html) - -* How appropriate/thorough are the analyses that led to the indicators? - - **Answer**: Since no misbehaviours for the use of the library for parsing and verification of JSON data according to RFC8259 have been identified, no warning indicators are implemented. - -* How confident can we be that the list of indicators is comprehensive? - - **Answer**: There are no warning indicators implemented, of which we are very confident. - -* Could there be whole categories of warning indicators still missing? - - **Answer**: Yes, there could. Within S-CORE, however, any warning indicator that is not natively implemented within the original nlohmann/json should be implemented in the wrapper defining the interface between the library and the project using it. - -* How has the list of advance warning indicators varied over time? - - **Answer**: It has stayed constant. - -* How confident are we that the indicators are leading/predictive? - - **Answer**: There are none. - -* Are there misbehaviours that have no advance warning indicators? - - **Answer**: There are no misbehaviours identified. - -* Can we collect data for all indicators? - - **Answer**: There are currently no implemented indicators, so that no data are collected. - -* Are the monitoring mechanisms used included in our Trustable scope? - - **Answer**: No, but there are also none. - -* Are there gaps or trends in the data? - - **Answer**: There are no data where gaps or trends could be identified. - -* If there are gaps or trends, are they analysed and addressed? - - **Answer**: There are no data. - -* Is the data actually predictive/useful? - - **Answer**: There are no data. - -* Are indicators from code, component, tool, or data inspections taken into consideration? - - **Answer**: There are no indicators. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-INPUTS-CHECKLIST.md b/TSF/trustable/assertions/TA-INPUTS-CHECKLIST.md deleted file mode 100644 index d624636ceb..0000000000 --- a/TSF/trustable/assertions/TA-INPUTS-CHECKLIST.md +++ /dev/null @@ -1,63 +0,0 @@ -#### Checklist for TA-INPUTS from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -The single_include/nlohmann/json.hpp is the single and only component of the library. - -* Are there components that are not on the list? - - **Answer**: No. - -* Are there assessments for all components? - - **Answer**: ????? - -* Has an assessment been done for the current version of the component? - - **Answer**: ????? - -* Have sources of bug and/or vulnerability data been identified? - - **Answer**: There are no bug and/or vulnerability data. - -* Have additional tests and/or Expectations been documented and linked to component assessment? - - **Answer**: ?????? - -* Are component tests run when integrating new versions of components? - - **Answer**: There are no further components. - -* Are there tools that are not on the list? - - **Answer**: The library does not use external tools, except for the tools provided by the C++ standard library. - -* Are there impact assessments for all tools? - - **Answer**: ?????? The library does not use external tools for which an impact assessment has to be done. - -* Have tools with high impact been qualified? - - **Answer**: There are no tools with high impact. - -* Were assessments or reviews done for the current tool versions? - - **Answer**: ????? The library does not use external tools for which an impact assessment has to be done. - -* Have additional tests and/or Expectations been documented and linked to tool assessments? - - **Answer**: No. - -* Are tool tests run when integrating new versions of tools? - - **Answer**: The library does not use external tools for which a new version needs to be integrated. - -* Are tool and component tests included in release preparation? - - **Answer**: Yes, the tests of the library are included in the release. - -* Can patches be applied, and then upstreamed for long-term maintenance? - - **Answer**: Yes, if ever a misbehaviour is found and patched, then a pull-request to the original nlohmann/json repository can be opened to upstream the changes. - -* Do all dependencies comply with acceptable licensing terms? - - **Answer**: Yes, the library is licensed under MIT License . \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-ITERATIONS-CHECKLIST.md b/TSF/trustable/assertions/TA-ITERATIONS-CHECKLIST.md deleted file mode 100644 index 5a26f8b75e..0000000000 --- a/TSF/trustable/assertions/TA-ITERATIONS-CHECKLIST.md +++ /dev/null @@ -1,21 +0,0 @@ -#### Checklist for TA-ITERATIONS from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* How much of the software is provided as binary only, expressed as a fraction of the BoM list? - - **Answer**: None. - -* How much is binary, expressed as a fraction of the total storage footprint? - - **Answer**: None. - -* For binaries, what claims are being made and how confident are we in the people/organisations making the claims? - - **Answer**: There are no binaries. - -* For third-party source code, what claims are we making, and how confident are we about these claims? - - **Answer**: There is no third-party source code in the library. - -* For software developed by us, what claims are we making, and how confident are we about these claims? - - **Answer**: This is the remainder of the documentation. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-METHODOLOGIES-CHECKLIST.md b/TSF/trustable/assertions/TA-METHODOLOGIES-CHECKLIST.md deleted file mode 100644 index ad204c8b3d..0000000000 --- a/TSF/trustable/assertions/TA-METHODOLOGIES-CHECKLIST.md +++ /dev/null @@ -1,43 +0,0 @@ -#### Checklist for TA-METHODOLOGIES from [Codethink](https://pages.eclipse.dev/eclipse/tsf/tsfprint_page.html) - -This project follows purely the Methodologies of Eclipse S-CORE. - -* Are the identified gaps documented clearly to justify using a manual process? - - **Answer**: - -* Are the goals for each process clearly defined? - - **Answer**: - -* Is the sequence of procedures documented in an unambiguous manner? - - **Answer**: - -* Can improvements to the processes be suggested and implemented? - - **Answer**: - -* How frequently are processes changed? - - **Answer**: - -* How are changes to manual processes communicated? - - **Answer**: - -* Are there any exceptions to the processes? - - **Answer**: - -* How is evidence of process adherence recorded? - - **Answer**: - -* How is the effectiveness of the process evaluated? - - **Answer**: - -* Is ongoing training required to follow these processes? - - **Answer**: \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-METHODOLOGIES_CONTEXT.md b/TSF/trustable/assertions/TA-METHODOLOGIES_CONTEXT.md index 70aa167546..c9bbcd2aaf 100644 --- a/TSF/trustable/assertions/TA-METHODOLOGIES_CONTEXT.md +++ b/TSF/trustable/assertions/TA-METHODOLOGIES_CONTEXT.md @@ -59,7 +59,7 @@ in comparison to the analysed results - Is the sequence of procedures documented in an unambiguous manner? - **Answer**: Largely yes. Where necessary, examples and templates make the expected sequence explicit. - Can improvements to the processes be suggested and implemented? - - **Answer**: Improvements are proposed via GitHub issues or pull request. + - **Answer**: Improvements are proposed via GitHub issues or pull requests. - How frequently are processes changed? - **Answer**: Process changes are infrequent and usually happen with a new nlohmann/json release, when a need for improvement is identified. - How are changes to manual processes communicated? diff --git a/TSF/trustable/assertions/TA-MISBEHAVIOURS-CHECKLIST.md b/TSF/trustable/assertions/TA-MISBEHAVIOURS-CHECKLIST.md deleted file mode 100644 index 57a0eaddbb..0000000000 --- a/TSF/trustable/assertions/TA-MISBEHAVIOURS-CHECKLIST.md +++ /dev/null @@ -1,49 +0,0 @@ -#### Checklist for TA-MISBEHAVIOURS from [Codethink](https://pages.eclipse.dev/eclipse/tsf/tsf/print_page.html) - -* How has the list of misbehaviours varied over time? - - **Answer**: The list of misbehaviours is collected using github and its development is thereby understandable. - -* How confident can we be that this list is comprehensive? - - **Answer**: Due to the collaborative nature of the open source community, we deem it quite unlikely that there are any known misbehaviours which are not reported to the repository nlohmann/json. - -* How well do the misbehaviours map to the expectations? - - **Answer**: There are no identified misbehaviours that tangent the expectations. - -* Could some participants have incentives to manipulate information? - - **Answer**: We could not think of an incentive that any collaborateur could have to manipulate the information. - -* Could there be whole categories of misbehaviours still undiscovered? - - **Answer**: Due to the wide use and long-standing development of the library it is quite unlikely that any major misbehaviors, in particular regarding the parsing and validating of JSON data in the sense of RFC-8259, is undiscovered. - -* Can we identify misbehaviours that have been understood but not specified? - - **Answer**: No. - -* Can we identify some new misbehaviours, right now? - - **Answer**: No. - -* Is every misbehaviour represented by at least one fault induction test? - - **Answer**: Since there are no misbehaviours that concern the use within S-CORE, no. - -* Are fault inductions used to demonstrate that tests which usually pass can and do fail appropriately? - - **Answer**: ?????? No. - -* Are all the fault induction results actually collected? - - **Answer**: ?????? No. - -* Are the results evaluated? - - **Answer**: ?????? No. - -* Do input analysis findings on verifiable tool or component claims and features identify additional misbehaviours or support existing mitigations? - - **Answer**: Currently, there is no analysis which identifies additional misbehaviours. The only such analysis is indirectly via the analysis of the fuzz testing, which currently does not identifies additional misbehaviours. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-MISBEHAVIOURS_CONTEXT.md b/TSF/trustable/assertions/TA-MISBEHAVIOURS_CONTEXT.md index 17f06e3e4a..7d3686c3e2 100644 --- a/TSF/trustable/assertions/TA-MISBEHAVIOURS_CONTEXT.md +++ b/TSF/trustable/assertions/TA-MISBEHAVIOURS_CONTEXT.md @@ -100,7 +100,7 @@ established and reusable solutions. - Exception handling tests - **Answer**: The nlohmann/json library contains a set of exception handling tests, along with custom exception types, as described in JLS-24. - Stress tests. - - **Answer**: Stress tests target system-level behavior under load, while nlohmann/json is a stateless JSON library. There is no long-lived state, connection pool, thread pool, queue or similar in nlohmann/json. Therefore, stress tests are generally not relevant for nlohmann/json. + - **Answer**: Stress tests target system-level behaviour under load, while nlohmann/json is a stateless JSON library. There is no long-lived state, connection pool, thread pool, queue or similar in nlohmann/json. Therefore, stress tests are generally not relevant for nlohmann/json. - Soak tests - **Answer**: Soak tests are used to investigate long-running behaviour, not single operations like a JSON library. Soak tests are therefore not needed for the nlohmann/json library. @@ -113,19 +113,19 @@ considered against the list of Expectations. **Checklist** - How has the list of misbehaviours varied over time? - - **Answer**: The list of misbehaviours for nlohmann/json (https://github.com/nlohmann/json/issues), as well as its history and development, is collected using Github. Statistics, e.g. about the number of open issues over time, are currently not tracked. + - **Answer**: The list of misbehaviours for nlohmann/json (https://github.com/nlohmann/json/issues), as well as its history and development, is collected using GitHub. Statistics, e.g. about the number of open issues over time, are currently not tracked. - How confident can we be that this list is comprehensive? - **Answer**: Due to the collaborative nature of the open source community, we deem it quite unlikely, but not impossible, that there are any known misbehaviours which are not reported to the nlohmann/json repository. - How well do the misbehaviours map to the expectations? - **Answer**: The identified misbehaviours do not necessarily all have a direct impact on the defined expectations. A mapping of any misbehaviour to the expectations has to be done on a case-by-case basis. - Could some participants have incentives to manipulate information? - - **Answer**: We can not think of any incentive that any collaborateur could have to manipulate the information. + - **Answer**: We cannot think of any incentive that any collaborator could have to manipulate the information. - Could there be whole categories of misbehaviours still undiscovered? - **Answer**: Due to the wide use and long-standing development of the library it is quite unlikely that any major misbehaviours, in particular regarding the parsing and validating of JSON data in the sense of RFC-8259, is undiscovered. - Can we identify misbehaviours that have been understood but not specified? - **Answer**: We currently do not identify any misbehaviours that have been understood but not specified. - Can we identify some new misbehaviours, right now? - - **Answer**: No, currently no new misbehaviors can be identified. + - **Answer**: No, currently no new misbehaviours can be identified. - Is every misbehaviour represented by at least one fault induction test? - **Answer**: The expected behaviour of nlohmann/json is described by JLS-24 and its substatements in the trustable graph. For every substatement at least one fault induction test is performed. Thus, every misbehaviour is represented by at least one fault induction test. - Are fault inductions used to demonstrate that tests which usually pass can and do fail appropriately? diff --git a/TSF/trustable/assertions/TA-RELEASES-CHECKLIST.md b/TSF/trustable/assertions/TA-RELEASES-CHECKLIST.md deleted file mode 100644 index ece1bc453f..0000000000 --- a/TSF/trustable/assertions/TA-RELEASES-CHECKLIST.md +++ /dev/null @@ -1,25 +0,0 @@ -#### Checklist for TA-RELEASES from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* How confident are we that all components are taken from within our controlled environment? - - **Answer**: This library does not take anything from outside of this repository. - -* How confident are we that all of the tools we are using are also under our control? - - **Answer**: The version of nlohmann/json that is documented with this documentation is under the full control of the Eclipse S-CORE organisation. - -* Are our builds repeatable on a different server, or in a different context? - - **Answer**: Since there is no "build" of the header-only library, yes. - -* How sure are we that our builds don't access the internet? - - **Answer**: There is no implemented access to the internet in the library itself. The testsuite is downloaded from a within Eclipse S-CORE. - -* How many of our components are non-reproducible? - - **Answer**: The single component is reproducible. - -* How confident are we that our reproducibility check is correct? - - **Answer**: Quite. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-SUPPLY_CHAIN-CHECKLIST.md b/TSF/trustable/assertions/TA-SUPPLY_CHAIN-CHECKLIST.md deleted file mode 100644 index dbb2e3f0a3..0000000000 --- a/TSF/trustable/assertions/TA-SUPPLY_CHAIN-CHECKLIST.md +++ /dev/null @@ -1,25 +0,0 @@ -#### Checklist for TA-SUPPLY_CHAIN from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* Could there be other components, missed from the list? - - **Answer**: Since the library does not contain any external components, no. - -* Does the list include all toolchain components? - - **Answer**: Since the library does not contain any external components, yes. - -* Does the toolchain include a bootstrap? - - **Answer**: ???? No. - -* Could the content of a mirrored project be compromised by an upstream change? - - **Answer**: Since the library does not contain any external components, no. - -* Are mirrored projects up to date with the upstream project? - - **Answer**: Yes, the library is up to date with the most recent release of the original nlohmann/json - -* Are mirrored projects based on the correct upstream? - - **Answer**: Yes. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-TESTS-CHECKLIST.md b/TSF/trustable/assertions/TA-TESTS-CHECKLIST.md deleted file mode 100644 index 8f05b60bdd..0000000000 --- a/TSF/trustable/assertions/TA-TESTS-CHECKLIST.md +++ /dev/null @@ -1,25 +0,0 @@ -#### Checklist for TA-TESTS from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* How confident are we that our test tooling and environment setups used for tests, fault inductions, and analyses are reproducible? - - **Answer**: The test can be reproduced any time on any machine running the versions of the operating systems and compilers as provided (TODO, cf. AOU-14) - -* Are any exceptions identified, documented and justified? - - **Answer**: To the best of our understanding, there are no exceptions identified. - -* How confident are we that all test components are taken from within our controlled environment? - - **Answer**: All tests are either self-contained or download test data from [within Eclipse S-CORE](https://github.com/eclipse-score/inc_nlohmann_json/tree/json_test_data_version_3_1_0_mirror). - -* How confident are we that all of the test environments we are using are also under our control? - - **Answer**: ???? The environments are standard docker images of ubuntu and standard versions of compilers. - -* Do we record all test environment components, including hardware and infrastructure used for exercising tests and processing input/output data? - - **Answer**: No, since the tests are independent from hard-ware, these data are not collected. - -* How confident are we that all tests scenarios are repeatable? - - **Answer**: All test scenarios are repeated daily in the CI pipeline. \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-UPDATES-CHECKLIST.md b/TSF/trustable/assertions/TA-UPDATES-CHECKLIST.md deleted file mode 100644 index 482d412201..0000000000 --- a/TSF/trustable/assertions/TA-UPDATES-CHECKLIST.md +++ /dev/null @@ -1,25 +0,0 @@ -#### Checklist for TA-UPDATES from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -* Where are the change and configuration management controls specified? - - **Answer**: WIP - -* Are these controls enforced for all of components, tools, data, documentation and configurations? - - **Answer**: The S-CORE Methodology is followed, compliance with which enforces the change process to be followed. - -* Are there any ways in which these controls can be subverted, and have we mitigated them? - - **Answer**: Yes, the change process can just not be followed. We have no real method to enforce it other than to trust that the committers follow the S-CORE processes. - -* Does change control capture all potential regressions? - - **Answer**: Due to the test coverage of 99.186%, it is unlikely that a potential regression is not captured. - -* Is change control timely enough? - - **Answer**: Not applicable, as far as can be understood right now, there is no immanent need to keep the library up to date. - -* Are all guidance and checks understandable and consistently followed? - - **Answer**: WIP \ No newline at end of file diff --git a/TSF/trustable/assertions/TA-VALIDATION-CHECKLIST.md b/TSF/trustable/assertions/TA-VALIDATION-CHECKLIST.md deleted file mode 100644 index 8e23bae526..0000000000 --- a/TSF/trustable/assertions/TA-VALIDATION-CHECKLIST.md +++ /dev/null @@ -1,55 +0,0 @@ -#### Checklist for TA-VALIDATION from [Codethink](https://codethinklabs.gitlab.io/trustable/trustable/print_page.html) - -I DO NOT FEEL CONFIDENT TO **Answer** THIS! - -* Is the selection of tests correct? - - **Answer**: ???? Who could tell this? - -* Are the tests executed enough times? - - **Answer**: ???? Define "enough times" - -* How confident are we that all test results are being captured? - - **Answer**: ???? How fine-grained is a test-result supposed to be? - -* Can we look at any individual test result, and establish what it relates to? - - **Answer**: ???? - -* Can we trace from any test result to the expectation it relates to? - - **Answer**: No, there are more tests than expectations, and in particular tests that relate to the inner workings of the library which are not used by S-CORE. - -* Can we identify precisely which environment (software and hardware) were used? - - **Answer**: ???? How precisely shall that be? Moreover, the tests are supposed to run independent of underlying hardware, since this is a software. - -* How many pass/fail results would be expected, based on the scheduled tests? - - **Answer**: Zero fails. - -* Do we have all of the expected results? - - **Answer**: Yes. - -* Do we have time-series data for all of those results? - - **Answer**: Yes, there are time-series data. - -* If there are any gaps, do we understand why? - - **Answer**: ???? Define gaps - -* Are the test validation strategies credible and appropriate? - - **Answer**: ???? Define test validation strategies - -* What proportion of the implemented tests are validated? - - **Answer**: ???? None. - -* Have the tests been verified using known good and bad data? - - **Answer**: ???? \ No newline at end of file diff --git a/TSF/trustable/assumptions-of-use/AOU-29.md b/TSF/trustable/assumptions-of-use/AOU-29.md index aeeb503b94..8636404506 100644 --- a/TSF/trustable/assumptions-of-use/AOU-29.md +++ b/TSF/trustable/assumptions-of-use/AOU-29.md @@ -3,4 +3,4 @@ level: 1.1 normative: true --- -The integrator shall check the security tab in the GitHub UI on a regular basis, analyze and either fix or dismiss any outstanding CVEs. \ No newline at end of file +The integrator shall check the security tab in the GitHub UI on a regular basis, analyse and either fix or dismiss any outstanding CVEs. \ No newline at end of file diff --git a/TSF/trustable/expectations/JLEX-01.md b/TSF/trustable/expectations/JLEX-01.md index e1b6cffcce..3789b1eceb 100644 --- a/TSF/trustable/expectations/JLEX-01.md +++ b/TSF/trustable/expectations/JLEX-01.md @@ -2,37 +2,37 @@ level: 1.1 normative: true references: - - type: function_reference - name: "basic_json::accept" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `accept`-functionality of nlohmann/json for single inputs" - overload: 1 - - type: function_reference - name: "basic_json::accept" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `accept`-functionality of nlohmann/json for iterator inputs" - overload: 2 - - type: function_reference - name: "basic_json::accept" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `accept`-functionality of nlohmann/json for input buffer" - overload: 3 - - type: function_reference - name: "parser::accept" - path: "include/nlohmann/detail/input/parser.hpp" - description: "the internal `accept`-functionality called by basic_json::accept" - - type: function_reference - name: "parser::sax_parse" - path: "include/nlohmann/detail/input/parser.hpp" - description: "called by parser::accept" - - type: function_reference - name: "parser::sax_parse_internal" - path: "include/nlohmann/detail/input/parser.hpp" - description: "called by parser::sax_parse" - - type: function_reference - name: "lexer::scan" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "scans input, called in parser::sax_parse_internal" + - type: function_reference + name: "basic_json::accept" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `accept`-functionality of nlohmann/json for single inputs" + overload: 1 + - type: function_reference + name: "basic_json::accept" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `accept`-functionality of nlohmann/json for iterator inputs" + overload: 2 + - type: function_reference + name: "basic_json::accept" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `accept`-functionality of nlohmann/json for input buffer" + overload: 3 + - type: function_reference + name: "parser::accept" + path: "include/nlohmann/detail/input/parser.hpp" + description: "the internal `accept`-functionality called by basic_json::accept" + - type: function_reference + name: "parser::sax_parse" + path: "include/nlohmann/detail/input/parser.hpp" + description: "called by parser::accept" + - type: function_reference + name: "parser::sax_parse_internal" + path: "include/nlohmann/detail/input/parser.hpp" + description: "called by parser::sax_parse" + - type: function_reference + name: "lexer::scan" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "scans input, called in parser::sax_parse_internal" --- The requirement regarding [JSON Validation](https://eclipse-score.github.io/score/main/modules/baselibs/json/docs/requirements/index.html#comp_req__json__validation) is fulfilled. \ No newline at end of file diff --git a/TSF/trustable/expectations/JLEX-02.md b/TSF/trustable/expectations/JLEX-02.md index d76809b506..4bd26aa7ee 100644 --- a/TSF/trustable/expectations/JLEX-02.md +++ b/TSF/trustable/expectations/JLEX-02.md @@ -2,37 +2,37 @@ level: 1.1 normative: true references: - - type: function_reference - name: "basic_json::parse" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `parse`-functionality of nlohmann/json for single inputs" - overload: 1 - - type: function_reference - name: "basic_json::parse" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `parse`-functionality of nlohmann/json for iterator inputs" - overload: 2 - - type: function_reference - name: "basic_json::parse" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `parse`-functionality of nlohmann/json for input buffer" - overload: 3 - - type: function_reference - name: "parser::parse" - path: "include/nlohmann/detail/input/parser.hpp" - description: "the internal `parse`-functionality called by basic_json::parse" - - type: function_reference - name: "parser::sax_parse" - path: "include/nlohmann/detail/input/parser.hpp" - description: "called by parser::parse" - - type: function_reference - name: "parser::sax_parse_internal" - path: "include/nlohmann/detail/input/parser.hpp" - description: "called by parser::sax_parse" - - type: function_reference - name: "lexer::scan" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "scans input, called in parser::sax_parse_internal" + - type: function_reference + name: "basic_json::parse" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `parse`-functionality of nlohmann/json for single inputs" + overload: 1 + - type: function_reference + name: "basic_json::parse" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `parse`-functionality of nlohmann/json for iterator inputs" + overload: 2 + - type: function_reference + name: "basic_json::parse" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `parse`-functionality of nlohmann/json for input buffer" + overload: 3 + - type: function_reference + name: "parser::parse" + path: "include/nlohmann/detail/input/parser.hpp" + description: "the internal `parse`-functionality called by basic_json::parse" + - type: function_reference + name: "parser::sax_parse" + path: "include/nlohmann/detail/input/parser.hpp" + description: "called by parser::parse" + - type: function_reference + name: "parser::sax_parse_internal" + path: "include/nlohmann/detail/input/parser.hpp" + description: "called by parser::sax_parse" + - type: function_reference + name: "lexer::scan" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "scans input, called in parser::sax_parse_internal" --- The requirement regarding [JSON Deserialization](https://eclipse-score.github.io/score/main/modules/baselibs/json/docs/requirements/index.html#comp_req__json__deserialization) is fulfilled. \ No newline at end of file diff --git a/TSF/trustable/no-json-faults/NJF-01.md b/TSF/trustable/no-json-faults/NJF-01.md index 2036272639..799939bfc5 100644 --- a/TSF/trustable/no-json-faults/NJF-01.md +++ b/TSF/trustable/no-json-faults/NJF-01.md @@ -2,34 +2,34 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - path: "TSF/tests/unit-class_parser_core.cpp" - name: "parser class - core;accept;null" - - type: JSON_testsuite - name: "nst's JSONTestSuite;test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite/test_parsing/y_structure_lonely_null.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_structure_lonely_null.json" - description: "" - - type: function_reference - name: "lexer::scan_literal" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function to verify whether a candidate literal coincides with its expected value; here called with literal_text = ['n','u','l','l']." + - type: item + items: + - JLEX-01 + - type: cpp_test + path: "TSF/tests/unit-class_parser_core.cpp" + name: "parser class - core;accept;null" + - type: JSON_testsuite + name: "nst's JSONTestSuite;test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite/test_parsing/y_structure_lonely_null.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_structure_lonely_null.json" + description: "" + - type: function_reference + name: "lexer::scan_literal" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function to verify whether a candidate literal coincides with its expected value; here called with literal_text = ['n','u','l','l']." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-02.md b/TSF/trustable/no-json-faults/NJF-02.md index 5ee93f1079..fd39659587 100644 --- a/TSF/trustable/no-json-faults/NJF-02.md +++ b/TSF/trustable/no-json-faults/NJF-02.md @@ -2,38 +2,38 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "parser class - core;accept;true" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "deserialization;contiguous containers;directly" - path: "tests/src/unit-deserialization.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite;test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite/test_parsing/y_structure_lonely_true.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_structure_lonely_true.json" - description: "" - - type: function_reference - name: "lexer::scan_literal" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function to verify whether a candidate literal coincides with its expected value; here called with literal_text = ['t','r','u','e']." + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "parser class - core;accept;true" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "deserialization;contiguous containers;directly" + path: "tests/src/unit-deserialization.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite;test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite/test_parsing/y_structure_lonely_true.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_structure_lonely_true.json" + description: "" + - type: function_reference + name: "lexer::scan_literal" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function to verify whether a candidate literal coincides with its expected value; here called with literal_text = ['t','r','u','e']." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - deserialization + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - deserialization score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-03.md b/TSF/trustable/no-json-faults/NJF-03.md index 6c7b407deb..909db8b822 100644 --- a/TSF/trustable/no-json-faults/NJF-03.md +++ b/TSF/trustable/no-json-faults/NJF-03.md @@ -23,13 +23,13 @@ references: - type: function_reference name: "lexer::scan_literal" path: "include/nlohmann/detail/input/lexer.hpp" - description: "function to verify whether a candidate literal coincides with its expected value; here called with literal_text = ['f','a','l','s','e']." + description: "Function to verify whether a candidate literal coincides with its expected value; here called with literal_text = ['f','a','l','s','e']." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-04.md b/TSF/trustable/no-json-faults/NJF-04.md index 7985dfaad8..10dff7b140 100644 --- a/TSF/trustable/no-json-faults/NJF-04.md +++ b/TSF/trustable/no-json-faults/NJF-04.md @@ -2,50 +2,50 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "parser class - core;accept;parse errors (accept)" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite;test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite/test_parsing/n_incomplete_false.json" - - "/nst_json_testsuite/test_parsing/n_incomplete_null.json" - - "/nst_json_testsuite/test_parsing/n_incomplete_true.json" - - "/nst_json_testsuite/test_parsing/n_structure_number_with_trailing_garbage.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_incomplete_false.json" - - "/nst_json_testsuite2/test_parsing/n_incomplete_null.json" - - "/nst_json_testsuite2/test_parsing/n_incomplete_true.json" - - "/nst_json_testsuite2/test_parsing/n_structure_capitalized_True.json" - description: "" - - type: cpp_test - name: "accept;unicode" - path: "TSF/tests/unit-literals.cpp" - - type: cpp_test - name: "accept;capitalisation" - path: "TSF/tests/unit-literals.cpp" - - type: cpp_test - name: "accept;illegal literals" - path: "TSF/tests/unit-literals.cpp" - - type: function_reference - name: "lexer::scan_literal" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function to verify whether a candidate literal coincides with its expected value; only ever called with the three admissible expected values" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "parser class - core;accept;parse errors (accept)" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite;test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite/test_parsing/n_incomplete_false.json" + - "/nst_json_testsuite/test_parsing/n_incomplete_null.json" + - "/nst_json_testsuite/test_parsing/n_incomplete_true.json" + - "/nst_json_testsuite/test_parsing/n_structure_number_with_trailing_garbage.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_incomplete_false.json" + - "/nst_json_testsuite2/test_parsing/n_incomplete_null.json" + - "/nst_json_testsuite2/test_parsing/n_incomplete_true.json" + - "/nst_json_testsuite2/test_parsing/n_structure_capitalized_True.json" + description: "" + - type: cpp_test + name: "accept;unicode" + path: "TSF/tests/unit-literals.cpp" + - type: cpp_test + name: "accept;capitalisation" + path: "TSF/tests/unit-literals.cpp" + - type: cpp_test + name: "accept;illegal literals" + path: "TSF/tests/unit-literals.cpp" + - type: function_reference + name: "lexer::scan_literal" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function to verify whether a candidate literal coincides with its expected value; only ever called with the three admissible expected values." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - literals + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - literals score: Jonas-Kirchhoff: 1.0 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-05.1.md b/TSF/trustable/no-json-faults/NJF-05.1.md index 050422f656..b8b05be4c5 100644 --- a/TSF/trustable/no-json-faults/NJF-05.1.md +++ b/TSF/trustable/no-json-faults/NJF-05.1.md @@ -2,35 +2,35 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "parser class - core;accept;array;empty array" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite;test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite/test_parsing/y_array_empty.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_array_empty.json" - - "/nst_json_testsuite2/test_parsing/y_array_arraysWithSpaces.json" - description: "Checks that the empty array [] is accepted." - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "parser class - core;accept;array;empty array" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite;test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite/test_parsing/y_array_empty.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_array_empty.json" + - "/nst_json_testsuite2/test_parsing/y_array_arraysWithSpaces.json" + description: "Checks that the empty array [] is accepted." + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-05.2.md b/TSF/trustable/no-json-faults/NJF-05.2.md index 0368ee973d..4f40ea990e 100644 --- a/TSF/trustable/no-json-faults/NJF-05.2.md +++ b/TSF/trustable/no-json-faults/NJF-05.2.md @@ -2,40 +2,40 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "parser class - core;accept;array;nonempty array" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_array_false.json" - - "/nst_json_testsuite2/test_parsing/y_array_heterogeneous.json" - - "/nst_json_testsuite2/test_parsing/y_array_null.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_1_and_newline.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_leading_space.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_several_null.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_trailing_space.json" - description: "Checks that various valid arrays are accepted." - - type: JSON_testsuite - name: "json.org examples" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/1.json" - - "/json.org/2.json" - - "/json.org/3.json" - - "/json.org/4.json" - - "/json.org/5.json" - description: "Checks that various valid arrays in combination with objects are accepted." + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "parser class - core;accept;array;nonempty array" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_array_false.json" + - "/nst_json_testsuite2/test_parsing/y_array_heterogeneous.json" + - "/nst_json_testsuite2/test_parsing/y_array_null.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_1_and_newline.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_leading_space.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_several_null.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_trailing_space.json" + description: "Checks that various valid arrays are accepted." + - type: JSON_testsuite + name: "json.org examples" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/1.json" + - "/json.org/2.json" + - "/json.org/3.json" + - "/json.org/4.json" + - "/json.org/5.json" + description: "Checks that various valid arrays in combination with objects are accepted." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 0.85 diff --git a/TSF/trustable/no-json-faults/NJF-05.3.md b/TSF/trustable/no-json-faults/NJF-05.3.md index 098d52b09d..78a67820b8 100644 --- a/TSF/trustable/no-json-faults/NJF-05.3.md +++ b/TSF/trustable/no-json-faults/NJF-05.3.md @@ -2,37 +2,37 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "deserialization;successful deserialization;stream" - path: "tests/src/unit-deserialization.cpp" - - type: JSON_testsuite - name: "json.org examples" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/1.json" - - "/json.org/2.json" - - "/json.org/3.json" - - "/json.org/4.json" - - "/json.org/5.json" - description: "Checks that various valid arrays in combination with objects are accepted." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_string_in_array.json" - - "/nst_json_testsuite2/test_parsing/y_string_in_array_with_leading_space.json" - - "/nst_json_testsuite2/test_parsing/y_structure_true_in_array.json" - description: "" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "deserialization;successful deserialization;stream" + path: "tests/src/unit-deserialization.cpp" + - type: JSON_testsuite + name: "json.org examples" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/1.json" + - "/json.org/2.json" + - "/json.org/3.json" + - "/json.org/4.json" + - "/json.org/5.json" + description: "Checks that various valid arrays in combination with objects are accepted." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_string_in_array.json" + - "/nst_json_testsuite2/test_parsing/y_string_in_array_with_leading_space.json" + - "/nst_json_testsuite2/test_parsing/y_structure_true_in_array.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - deserialization - - testsuites -score: + type: check_test_results + configuration: + tests: + - deserialization + - testsuites +score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 --- diff --git a/TSF/trustable/no-json-faults/NJF-05.4.md b/TSF/trustable/no-json-faults/NJF-05.4.md index a261990e3b..23a675753c 100644 --- a/TSF/trustable/no-json-faults/NJF-05.4.md +++ b/TSF/trustable/no-json-faults/NJF-05.4.md @@ -2,50 +2,50 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "parser class - core;accept;parse errors (accept)" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "accept;boundaries" - path: "TSF/tests/unit-arrays.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n (previously overflowed)" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_100000_opening_arrays.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_close_unopened_array.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_double_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_end_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_lone-invalid-utf-8.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_array_apostrophe.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_array_comma.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_array_open_object.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_object_close_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_partial_null.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_false.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_true.json" - description: "" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "parser class - core;accept;parse errors (accept)" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "accept;boundaries" + path: "TSF/tests/unit-arrays.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n (previously overflowed)" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_100000_opening_arrays.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_close_unopened_array.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_double_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_end_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_lone-invalid-utf-8.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_array_apostrophe.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_array_comma.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_array_open_object.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_object_close_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_partial_null.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_false.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_true.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - arrays + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - arrays score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-05.5.md b/TSF/trustable/no-json-faults/NJF-05.5.md index fd92407894..e3f30bddac 100644 --- a/TSF/trustable/no-json-faults/NJF-05.5.md +++ b/TSF/trustable/no-json-faults/NJF-05.5.md @@ -2,27 +2,27 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_array_double_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_double_extra_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_just_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_number_and_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_number_and_several_commas.json" - - "/nst_json_testsuite2/test_parsing/n_structure_array_with_unclosed_string.json" - - "/nst_json_testsuite2/test_parsing/n_array_invalid_utf8.json" - - "/nst_json_testsuite2/test_parsing/n_array_just_minus.json" - description: "Checks that various \"proper\" arrays with improper elements are rejected." + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_array_double_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_double_extra_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_just_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_number_and_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_number_and_several_commas.json" + - "/nst_json_testsuite2/test_parsing/n_structure_array_with_unclosed_string.json" + - "/nst_json_testsuite2/test_parsing/n_array_invalid_utf8.json" + - "/nst_json_testsuite2/test_parsing/n_array_just_minus.json" + description: "Checks that various \"proper\" arrays with improper elements are rejected." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-05.6.0.md b/TSF/trustable/no-json-faults/NJF-05.6.0.md index 730e25e775..4954b90ecc 100644 --- a/TSF/trustable/no-json-faults/NJF-05.6.0.md +++ b/TSF/trustable/no-json-faults/NJF-05.6.0.md @@ -2,20 +2,20 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;i -> y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/i_structure_500_nested_arrays.json" - description: "" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;i -> y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/i_structure_500_nested_arrays.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 0.975 Erikhu1: 0.9 diff --git a/TSF/trustable/no-json-faults/NJF-05.6.md b/TSF/trustable/no-json-faults/NJF-05.6.md index b08a379bbd..e947d76b6c 100644 --- a/TSF/trustable/no-json-faults/NJF-05.6.md +++ b/TSF/trustable/no-json-faults/NJF-05.6.md @@ -2,26 +2,26 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "compliance tests from json.org;expected passes" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json_tests/pass2.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;i -> y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/i_structure_500_nested_arrays.json" - description: "" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "compliance tests from json.org;expected passes" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json_tests/pass2.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;i -> y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/i_structure_500_nested_arrays.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-05.7.1.md b/TSF/trustable/no-json-faults/NJF-05.7.1.md index defc79c693..09e97df55d 100644 --- a/TSF/trustable/no-json-faults/NJF-05.7.1.md +++ b/TSF/trustable/no-json-faults/NJF-05.7.1.md @@ -2,32 +2,32 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_array_with_several_null.json" - description: "Checks that [1,null,null,null,2] is accepted." - - type: JSON_testsuite - name: "json.org examples;4.json" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/4.json" - description: "" - - type: JSON_testsuite - name: "json.org examples;5.json" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/5.json" - description: "" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_array_with_several_null.json" + description: "Checks that [1,null,null,null,2] is accepted." + - type: JSON_testsuite + name: "json.org examples;4.json" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/4.json" + description: "" + - type: JSON_testsuite + name: "json.org examples;5.json" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/5.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-05.7.2.md b/TSF/trustable/no-json-faults/NJF-05.7.2.md index 8a51f7002e..33c7f454c4 100644 --- a/TSF/trustable/no-json-faults/NJF-05.7.2.md +++ b/TSF/trustable/no-json-faults/NJF-05.7.2.md @@ -2,20 +2,20 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_array_colon_instead_of_comma.json" - description: "Tests whether colon as value separator is rejected." + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_array_colon_instead_of_comma.json" + description: "Tests whether colon is rejected as value separator." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.1.md b/TSF/trustable/no-json-faults/NJF-06.1.md index f0068b8e84..81cf7cf9c7 100644 --- a/TSF/trustable/no-json-faults/NJF-06.1.md +++ b/TSF/trustable/no-json-faults/NJF-06.1.md @@ -2,25 +2,25 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "parser class - core;accept;object;empty object" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "accept;whitespace;empty object" - path: "TSF/tests/unit-objects.cpp" - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "parser class - core;accept;object;empty object" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "accept;whitespace;empty object" + path: "TSF/tests/unit-objects.cpp" + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - objects + type: check_test_results + configuration: + tests: + - class_parser_core + - objects score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.2.md b/TSF/trustable/no-json-faults/NJF-06.2.md index e1ad561145..d902d34410 100644 --- a/TSF/trustable/no-json-faults/NJF-06.2.md +++ b/TSF/trustable/no-json-faults/NJF-06.2.md @@ -2,26 +2,26 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "deserialization;contiguous containers;error cases;case 15" - path: "tests/src/unit-deserialization.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_comma_instead_of_closing_brace.json" - - "/nst_json_testsuite2/test_parsing/n_structure_object_followed_by_closing_object.json" - - "/nst_json_testsuite2/test_parsing/n_structure_object_unclosed_no_value.json" - description: "" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "deserialization;contiguous containers;error cases;case 15" + path: "tests/src/unit-deserialization.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_comma_instead_of_closing_brace.json" + - "/nst_json_testsuite2/test_parsing/n_structure_object_followed_by_closing_object.json" + - "/nst_json_testsuite2/test_parsing/n_structure_object_unclosed_no_value.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - deserialization - - testsuites + type: check_test_results + configuration: + tests: + - deserialization + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.3.md b/TSF/trustable/no-json-faults/NJF-06.3.md index 9975cd8f39..dab589c75a 100644 --- a/TSF/trustable/no-json-faults/NJF-06.3.md +++ b/TSF/trustable/no-json-faults/NJF-06.3.md @@ -2,21 +2,21 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "deserialization;JSON Lines" - path: "tests/src/unit-deserialization.cpp" - - type: cpp_test - name: "parser class - core;accept;object;nonempty object" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "deserialization;JSON Lines" + path: "tests/src/unit-deserialization.cpp" + - type: cpp_test + name: "parser class - core;accept;object;nonempty object" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - deserialization + type: check_test_results + configuration: + tests: + - class_parser_core + - deserialization score: Jonas-Kirchhoff: 0.95 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-06.4.1.md b/TSF/trustable/no-json-faults/NJF-06.4.1.md index 1c6b532fc3..83ad691144 100644 --- a/TSF/trustable/no-json-faults/NJF-06.4.1.md +++ b/TSF/trustable/no-json-faults/NJF-06.4.1.md @@ -2,51 +2,51 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-06.4 - - type: cpp_test - name: "parser class - core;accept;object;nonempty object" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_object_basic.json" - - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key_and_value.json" - - "/nst_json_testsuite2/test_parsing/y_object_empty.json" - - "/nst_json_testsuite2/test_parsing/y_object_empty_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_escaped_null_in_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_extreme_numbers.json" - - "/nst_json_testsuite2/test_parsing/y_object_long_strings.json" - - "/nst_json_testsuite2/test_parsing/y_object_simple.json" - - "/nst_json_testsuite2/test_parsing/y_object_string_unicode.json" - - "/nst_json_testsuite2/test_parsing/y_object_with_newlines.json" - description: "Checks that various keys, particularly containing unicode characters, are accepted." - - type: cpp_test - name: "accept;names;strings;control characters" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;names;strings;unicode" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;names;strings;escaped UTF-16 surrogates" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - NJF-06.4 + - type: cpp_test + name: "parser class - core;accept;object;nonempty object" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_object_basic.json" + - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key_and_value.json" + - "/nst_json_testsuite2/test_parsing/y_object_empty.json" + - "/nst_json_testsuite2/test_parsing/y_object_empty_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_escaped_null_in_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_extreme_numbers.json" + - "/nst_json_testsuite2/test_parsing/y_object_long_strings.json" + - "/nst_json_testsuite2/test_parsing/y_object_simple.json" + - "/nst_json_testsuite2/test_parsing/y_object_string_unicode.json" + - "/nst_json_testsuite2/test_parsing/y_object_with_newlines.json" + description: "Checks that various keys, particularly containing unicode characters, are accepted." + - type: cpp_test + name: "accept;names;strings;control characters" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;names;strings;unicode" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;names;strings;escaped UTF-16 surrogates" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - objects + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - objects score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 --- -If the service provided by the nlohmann/json library recognises the name candidate as string, then it accepts the name candidate. \ No newline at end of file +If the service provided by the nlohmann/json library recognizes the name candidate as string, then it accepts the name candidate. \ No newline at end of file diff --git a/TSF/trustable/no-json-faults/NJF-06.4.2.md b/TSF/trustable/no-json-faults/NJF-06.4.2.md index 078e4e31f7..9b1f848b58 100644 --- a/TSF/trustable/no-json-faults/NJF-06.4.2.md +++ b/TSF/trustable/no-json-faults/NJF-06.4.2.md @@ -2,38 +2,38 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-06.4 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" - description: "Checks that numbers as keys are rejected." - - type: cpp_test - name: "accept;names;numbers" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;names;arrays" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;names;objects" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;names;literals" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - NJF-06.4 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" + description: "Checks that using numbers as keys is rejected." + - type: cpp_test + name: "accept;names;numbers" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;names;arrays" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;names;objects" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;names;literals" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.4.3.md b/TSF/trustable/no-json-faults/NJF-06.4.3.md index 2579c67ea3..997f7bc9a3 100644 --- a/TSF/trustable/no-json-faults/NJF-06.4.3.md +++ b/TSF/trustable/no-json-faults/NJF-06.4.3.md @@ -2,39 +2,39 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-06.4 - - type: cpp_test - name: "parser class - core;accept;object;nonempty object" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_object_basic.json" - - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key_and_value.json" - - "/nst_json_testsuite2/test_parsing/y_object_empty.json" - - "/nst_json_testsuite2/test_parsing/y_object_empty_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_escaped_null_in_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_extreme_numbers.json" - - "/nst_json_testsuite2/test_parsing/y_object_long_strings.json" - - "/nst_json_testsuite2/test_parsing/y_object_simple.json" - - "/nst_json_testsuite2/test_parsing/y_object_string_unicode.json" - - "/nst_json_testsuite2/test_parsing/y_object_with_newlines.json" - description: "Checks that various strings and numbers are accepted values." - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - NJF-06.4 + - type: cpp_test + name: "parser class - core;accept;object;nonempty object" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_object_basic.json" + - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key_and_value.json" + - "/nst_json_testsuite2/test_parsing/y_object_empty.json" + - "/nst_json_testsuite2/test_parsing/y_object_empty_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_escaped_null_in_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_extreme_numbers.json" + - "/nst_json_testsuite2/test_parsing/y_object_long_strings.json" + - "/nst_json_testsuite2/test_parsing/y_object_simple.json" + - "/nst_json_testsuite2/test_parsing/y_object_string_unicode.json" + - "/nst_json_testsuite2/test_parsing/y_object_with_newlines.json" + description: "Checks that various strings and numbers are accepted values." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - objects + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - objects score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.4.md b/TSF/trustable/no-json-faults/NJF-06.4.md index ba5578ebef..5460baada3 100644 --- a/TSF/trustable/no-json-faults/NJF-06.4.md +++ b/TSF/trustable/no-json-faults/NJF-06.4.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "nst's JSONTestSuite;test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - - type: cpp_test - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - - type: cpp_test - name: "compliance tests from json.org;expected failures" - path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "nst's JSONTestSuite;test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "compliance tests from json.org;expected failures" + path: "tests/src/unit-testsuites.cpp" --- The admissible members of an object provided to the eclipse-score/inc_nlohmann_json have the form name : value. \ No newline at end of file diff --git a/TSF/trustable/no-json-faults/NJF-06.5.1.md b/TSF/trustable/no-json-faults/NJF-06.5.1.md index 616a75d245..ad81a40af7 100644 --- a/TSF/trustable/no-json-faults/NJF-06.5.1.md +++ b/TSF/trustable/no-json-faults/NJF-06.5.1.md @@ -2,37 +2,37 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-06.5 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_single_quote.json" - - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" - - "/nst_json_testsuite2/test_parsing/n_object_key_with_single_quotes.json" - - "/nst_json_testsuite2/test_parsing/n_object_bracket_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" - description: "Checks that invalid names are rejected." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;i -> n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/i_object_key_lone_2nd_surrogate.json" - description: "Checks that string with invalid utf16 surrogate is rejected as name" - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - NJF-06.5 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_single_quote.json" + - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" + - "/nst_json_testsuite2/test_parsing/n_object_key_with_single_quotes.json" + - "/nst_json_testsuite2/test_parsing/n_object_bracket_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" + description: "Checks that invalid names are rejected." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;i -> n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/i_object_key_lone_2nd_surrogate.json" + description: "Checks that strings with invalid UTF-16 surrogates are rejected as name." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.5.2.md b/TSF/trustable/no-json-faults/NJF-06.5.2.md index a36d71d3a1..c6b8170625 100644 --- a/TSF/trustable/no-json-faults/NJF-06.5.2.md +++ b/TSF/trustable/no-json-faults/NJF-06.5.2.md @@ -2,25 +2,25 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-06.5 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_bad_value.json" - description: "Checks that the invalid literal \"truth\" as value is rejected." - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - NJF-06.5 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_bad_value.json" + description: "Checks that the invalid literal \"truth\" is rejected as value." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.5.md b/TSF/trustable/no-json-faults/NJF-06.5.md index 9a2d8f7568..e4843bd760 100644 --- a/TSF/trustable/no-json-faults/NJF-06.5.md +++ b/TSF/trustable/no-json-faults/NJF-06.5.md @@ -2,13 +2,13 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_trailing_comma.json" - - "/nst_json_testsuite2/test_parsing/n_object_two_commas_in_a_row.json" - description: "Checks that the empty member in a nonempty object is rejected." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_trailing_comma.json" + - "/nst_json_testsuite2/test_parsing/n_object_two_commas_in_a_row.json" + description: "Checks that the empty member in a nonempty object is rejected." --- The service provided by the nlohmann/json library does not accept objects with improper members. \ No newline at end of file diff --git a/TSF/trustable/no-json-faults/NJF-06.6.0.md b/TSF/trustable/no-json-faults/NJF-06.6.0.md index 6f8b5d7bf5..4a531821cd 100644 --- a/TSF/trustable/no-json-faults/NJF-06.6.0.md +++ b/TSF/trustable/no-json-faults/NJF-06.6.0.md @@ -2,28 +2,28 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "json.org examples" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/1.json" - - "/json.org/2.json" - - "/json.org/3.json" - - "/json.org/4.json" - - "/json.org/5.json" - description: "Checks that various nested objects are accepted." - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "json.org examples" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/1.json" + - "/json.org/2.json" + - "/json.org/3.json" + - "/json.org/4.json" + - "/json.org/5.json" + description: "Checks that various nested objects are accepted." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 0.975 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-06.6.md b/TSF/trustable/no-json-faults/NJF-06.6.md index bfa1ccca7c..85577c3951 100644 --- a/TSF/trustable/no-json-faults/NJF-06.6.md +++ b/TSF/trustable/no-json-faults/NJF-06.6.md @@ -2,28 +2,28 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "json.org examples" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/1.json" - - "/json.org/2.json" - - "/json.org/3.json" - - "/json.org/4.json" - - "/json.org/5.json" - description: "Checks that various nested objects are accepted." - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "json.org examples" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/1.json" + - "/json.org/2.json" + - "/json.org/3.json" + - "/json.org/4.json" + - "/json.org/5.json" + description: "Checks that various nested objects are accepted." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-06.7.1.md b/TSF/trustable/no-json-faults/NJF-06.7.1.md index 7cededd718..ab02763081 100644 --- a/TSF/trustable/no-json-faults/NJF-06.7.1.md +++ b/TSF/trustable/no-json-faults/NJF-06.7.1.md @@ -2,33 +2,33 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "json.org examples" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/1.json" - - "/json.org/2.json" - - "/json.org/3.json" - - "/json.org/4.json" - - "/json.org/5.json" - - "/json.org/1.json" - - "/json.org/2.json" - - "/json.org/3.json" - - "/json.org/4.json" - - "/json.org/5.json" - description: "Checks that various arrays with more than one value are accepted." - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "json.org examples" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/1.json" + - "/json.org/2.json" + - "/json.org/3.json" + - "/json.org/4.json" + - "/json.org/5.json" + - "/json.org/1.json" + - "/json.org/2.json" + - "/json.org/3.json" + - "/json.org/4.json" + - "/json.org/5.json" + description: "Checks that various arrays with more than one value are accepted." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-06.7.2.md b/TSF/trustable/no-json-faults/NJF-06.7.2.md index 0f8164192b..d228611208 100644 --- a/TSF/trustable/no-json-faults/NJF-06.7.2.md +++ b/TSF/trustable/no-json-faults/NJF-06.7.2.md @@ -2,38 +2,38 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_comma_instead_of_colon.json" - description: "Checks that comma instead of colon is rejected." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_double_colon.json" - description: "Checks that double colon is rejected." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_missing_colon.json" - - "/nst_json_testsuite2/test_parsing/n_object_missing_semicolon.json" - - "/nst_json_testsuite2/test_parsing/n_object_missing_semicolon.json" - description: "Checks that the empty member separator is rejected." - - type: cpp_test - name: "accept;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_comma_instead_of_colon.json" + description: "Checks that comma instead of colon is rejected." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_double_colon.json" + description: "Checks that double colon is rejected." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_missing_colon.json" + - "/nst_json_testsuite2/test_parsing/n_object_missing_semicolon.json" + - "/nst_json_testsuite2/test_parsing/n_object_missing_semicolon.json" + description: "Checks that the empty member separator is rejected." + - type: cpp_test + name: "accept;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.1.md b/TSF/trustable/no-json-faults/NJF-07.1.md index dda4d06d71..3cb9a87354 100644 --- a/TSF/trustable/no-json-faults/NJF-07.1.md +++ b/TSF/trustable/no-json-faults/NJF-07.1.md @@ -3,23 +3,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "parser class - core;accept;string" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "compliance tests from nativejson-benchmark;strings" - path: "tests/src/unit-testsuites.cpp" - + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "parser class - core;accept;string" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "compliance tests from nativejson-benchmark;strings" + path: "tests/src/unit-testsuites.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.2.md b/TSF/trustable/no-json-faults/NJF-07.2.md index cf8e004cf1..f8a2053149 100644 --- a/TSF/trustable/no-json-faults/NJF-07.2.md +++ b/TSF/trustable/no-json-faults/NJF-07.2.md @@ -2,32 +2,32 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "parser class - core;accept;parse errors (accept)" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "deserialization;contiguous containers;error cases" - path: "tests/src/unit-deserialization.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_string_no_quotes_with_bad_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_single_doublequote.json" - - "/nst_json_testsuite2/test_parsing/n_string_single_quote.json" - - "/nst_json_testsuite2/test_parsing/n_string_single_string_no_double_quotes.json" - description: "" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "parser class - core;accept;parse errors (accept)" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "deserialization;contiguous containers;error cases" + path: "tests/src/unit-deserialization.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_string_no_quotes_with_bad_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_single_doublequote.json" + - "/nst_json_testsuite2/test_parsing/n_string_single_quote.json" + - "/nst_json_testsuite2/test_parsing/n_string_single_string_no_double_quotes.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - deserialisation + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - deserialisation score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.3.md b/TSF/trustable/no-json-faults/NJF-07.3.md index 567e44cf3f..06a6a16801 100644 --- a/TSF/trustable/no-json-faults/NJF-07.3.md +++ b/TSF/trustable/no-json-faults/NJF-07.3.md @@ -3,18 +3,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "parser class - core;accept;string;errors" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "parser class - core;accept;string;errors" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.4.md b/TSF/trustable/no-json-faults/NJF-07.4.md index 4479235a45..f99f8c266e 100644 --- a/TSF/trustable/no-json-faults/NJF-07.4.md +++ b/TSF/trustable/no-json-faults/NJF-07.4.md @@ -3,43 +3,43 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "parser class - core;accept;string;escaped" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_string_1_2_3_bytes_UTF-8_sequences.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" - - "/nst_json_testsuite2/test_parsing/y_string_allowed_escapes.json" - - "/nst_json_testsuite2/test_parsing/y_string_backslash_and_u_escaped_zero.json" - - "/nst_json_testsuite2/test_parsing/y_string_backslash_doublequotes.json" - - "/nst_json_testsuite2/test_parsing/y_string_comments.json" - - "/nst_json_testsuite2/test_parsing/y_string_double_escape_a.json" - - "/nst_json_testsuite2/test_parsing/y_string_double_escape_n.json" - - "/nst_json_testsuite2/test_parsing/y_string_escaped_control_character.json" - - "/nst_json_testsuite2/test_parsing/y_string_escaped_noncharacter.json" - description: "Checks that various escaped control and unicode characters are accepted." - - type: cpp_test - name: "Unicode (1/5);\\\\uxxxx sequences;correct sequences" - path: "tests/src/unit-unicode1.cpp" - - type: cpp_test - name: "Unicode;escaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "parser class - core;accept;string;escaped" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_string_1_2_3_bytes_UTF-8_sequences.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" + - "/nst_json_testsuite2/test_parsing/y_string_allowed_escapes.json" + - "/nst_json_testsuite2/test_parsing/y_string_backslash_and_u_escaped_zero.json" + - "/nst_json_testsuite2/test_parsing/y_string_backslash_doublequotes.json" + - "/nst_json_testsuite2/test_parsing/y_string_comments.json" + - "/nst_json_testsuite2/test_parsing/y_string_double_escape_a.json" + - "/nst_json_testsuite2/test_parsing/y_string_double_escape_n.json" + - "/nst_json_testsuite2/test_parsing/y_string_escaped_control_character.json" + - "/nst_json_testsuite2/test_parsing/y_string_escaped_noncharacter.json" + description: "Checks that various escaped control and unicode characters are accepted." + - type: cpp_test + name: "Unicode (1/5);\\\\uxxxx sequences;correct sequences" + path: "tests/src/unit-unicode1.cpp" + - type: cpp_test + name: "Unicode;escaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - unicode1 - - strings + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - unicode1 + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.5.md b/TSF/trustable/no-json-faults/NJF-07.5.md index 86cc8bd931..b721f53532 100644 --- a/TSF/trustable/no-json-faults/NJF-07.5.md +++ b/TSF/trustable/no-json-faults/NJF-07.5.md @@ -3,30 +3,30 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "parser class - core;accept;string;escaped" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" - description: "Checks that single and multiple surrogates are accepted." - - type: cpp_test - name: "Unicode;escaped utf-16 surrogates;well-formed" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "parser class - core;accept;string;escaped" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" + description: "Checks that both single and multiple surrogates are accepted." + - type: cpp_test + name: "Unicode;escaped utf-16 surrogates;well-formed" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - strings + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.6.md b/TSF/trustable/no-json-faults/NJF-07.6.md index 8eea00395e..86095d0f89 100644 --- a/TSF/trustable/no-json-faults/NJF-07.6.md +++ b/TSF/trustable/no-json-faults/NJF-07.6.md @@ -2,64 +2,64 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_string_1_2_3_bytes_UTF-8_sequences.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" - - "/nst_json_testsuite2/test_parsing/y_string_allowed_escapes.json" - - "/nst_json_testsuite2/test_parsing/y_string_backslash_and_u_escaped_zero.json" - - "/nst_json_testsuite2/test_parsing/y_string_backslash_doublequotes.json" - - "/nst_json_testsuite2/test_parsing/y_string_comments.json" - - "/nst_json_testsuite2/test_parsing/y_string_double_escape_a.json" - - "/nst_json_testsuite2/test_parsing/y_string_double_escape_n.json" - - "/nst_json_testsuite2/test_parsing/y_string_escaped_control_character.json" - - "/nst_json_testsuite2/test_parsing/y_string_escaped_noncharacter.json" - - "/nst_json_testsuite2/test_parsing/y_string_in_array.json" - - "/nst_json_testsuite2/test_parsing/y_string_in_array_with_leading_space.json" - - "/nst_json_testsuite2/test_parsing/y_string_last_surrogates_1_and_2.json" - - "/nst_json_testsuite2/test_parsing/y_string_nbsp_uescaped.json" - - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+10FFFF.json" - - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+FFFF.json" - - "/nst_json_testsuite2/test_parsing/y_string_null_escape.json" - - "/nst_json_testsuite2/test_parsing/y_string_one-byte-utf-8.json" - - "/nst_json_testsuite2/test_parsing/y_string_pi.json" - - "/nst_json_testsuite2/test_parsing/y_string_reservedCharacterInUTF-8_U+1BFFF.json" - - "/nst_json_testsuite2/test_parsing/y_string_simple_ascii.json" - - "/nst_json_testsuite2/test_parsing/y_string_space.json" - - "/nst_json_testsuite2/test_parsing/y_string_surrogates_U+1D11E_MUSICAL_SYMBOL_G_CLEF.json" - - "/nst_json_testsuite2/test_parsing/y_string_three-byte-utf-8.json" - - "/nst_json_testsuite2/test_parsing/y_string_two-byte-utf-8.json" - - "/nst_json_testsuite2/test_parsing/y_string_u+2028_line_sep.json" - - "/nst_json_testsuite2/test_parsing/y_string_u+2029_par_sep.json" - - "/nst_json_testsuite2/test_parsing/y_string_uEscape.json" - - "/nst_json_testsuite2/test_parsing/y_string_uescaped_newline.json" - - "/nst_json_testsuite2/test_parsing/y_string_unescaped_char_delete.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicodeEscapedBackslash.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_2.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+10FFFE_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+1FFFE_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+200B_ZERO_WIDTH_SPACE.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+2064_invisible_plus.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FDD0_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FFFE_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_escaped_double_quote.json" - - "/nst_json_testsuite2/test_parsing/y_string_utf8.json" - - "/nst_json_testsuite2/test_parsing/y_string_with_del_character.json" - - "/nst_json_testsuite2/test_parsing/y_structure_lonely_string.json" - description: "Checks that various non-empty valid strings are accepted." + - type: item + items: + - JLEX-01 + - NJF-07 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_string_1_2_3_bytes_UTF-8_sequences.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" + - "/nst_json_testsuite2/test_parsing/y_string_allowed_escapes.json" + - "/nst_json_testsuite2/test_parsing/y_string_backslash_and_u_escaped_zero.json" + - "/nst_json_testsuite2/test_parsing/y_string_backslash_doublequotes.json" + - "/nst_json_testsuite2/test_parsing/y_string_comments.json" + - "/nst_json_testsuite2/test_parsing/y_string_double_escape_a.json" + - "/nst_json_testsuite2/test_parsing/y_string_double_escape_n.json" + - "/nst_json_testsuite2/test_parsing/y_string_escaped_control_character.json" + - "/nst_json_testsuite2/test_parsing/y_string_escaped_noncharacter.json" + - "/nst_json_testsuite2/test_parsing/y_string_in_array.json" + - "/nst_json_testsuite2/test_parsing/y_string_in_array_with_leading_space.json" + - "/nst_json_testsuite2/test_parsing/y_string_last_surrogates_1_and_2.json" + - "/nst_json_testsuite2/test_parsing/y_string_nbsp_uescaped.json" + - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+10FFFF.json" + - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+FFFF.json" + - "/nst_json_testsuite2/test_parsing/y_string_null_escape.json" + - "/nst_json_testsuite2/test_parsing/y_string_one-byte-utf-8.json" + - "/nst_json_testsuite2/test_parsing/y_string_pi.json" + - "/nst_json_testsuite2/test_parsing/y_string_reservedCharacterInUTF-8_U+1BFFF.json" + - "/nst_json_testsuite2/test_parsing/y_string_simple_ascii.json" + - "/nst_json_testsuite2/test_parsing/y_string_space.json" + - "/nst_json_testsuite2/test_parsing/y_string_surrogates_U+1D11E_MUSICAL_SYMBOL_G_CLEF.json" + - "/nst_json_testsuite2/test_parsing/y_string_three-byte-utf-8.json" + - "/nst_json_testsuite2/test_parsing/y_string_two-byte-utf-8.json" + - "/nst_json_testsuite2/test_parsing/y_string_u+2028_line_sep.json" + - "/nst_json_testsuite2/test_parsing/y_string_u+2029_par_sep.json" + - "/nst_json_testsuite2/test_parsing/y_string_uEscape.json" + - "/nst_json_testsuite2/test_parsing/y_string_uescaped_newline.json" + - "/nst_json_testsuite2/test_parsing/y_string_unescaped_char_delete.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicodeEscapedBackslash.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_2.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+10FFFE_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+1FFFE_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+200B_ZERO_WIDTH_SPACE.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+2064_invisible_plus.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FDD0_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FFFE_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_escaped_double_quote.json" + - "/nst_json_testsuite2/test_parsing/y_string_utf8.json" + - "/nst_json_testsuite2/test_parsing/y_string_with_del_character.json" + - "/nst_json_testsuite2/test_parsing/y_structure_lonely_string.json" + description: "Checks that various non-empty valid strings are accepted." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-07.7.md b/TSF/trustable/no-json-faults/NJF-07.7.md index 4333777f8b..19d05a1aed 100644 --- a/TSF/trustable/no-json-faults/NJF-07.7.md +++ b/TSF/trustable/no-json-faults/NJF-07.7.md @@ -2,42 +2,42 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u.json" - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1.json" - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1x.json" - - "/nst_json_testsuite2/test_parsing/n_string_accentuated_char_no_quotes.json" - - "/nst_json_testsuite2/test_parsing/n_string_backslash_00.json" - - "/nst_json_testsuite2/test_parsing/n_string_escape_x.json" - - "/nst_json_testsuite2/test_parsing/n_string_escaped_backslash_bad.json" - - "/nst_json_testsuite2/test_parsing/n_string_escaped_ctrl_char_tab.json" - - "/nst_json_testsuite2/test_parsing/n_string_escaped_emoji.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escaped_character.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate_escape_invalid.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid-utf-8-in-escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid_backslash_esc.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid_unicode_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid_utf8_after_escape.json" - description: "Checks that various illegal control characters and utf-8 characters are rejected." - - type: cpp_test - name: "Unicode;escaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u.json" + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1.json" + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1x.json" + - "/nst_json_testsuite2/test_parsing/n_string_accentuated_char_no_quotes.json" + - "/nst_json_testsuite2/test_parsing/n_string_backslash_00.json" + - "/nst_json_testsuite2/test_parsing/n_string_escape_x.json" + - "/nst_json_testsuite2/test_parsing/n_string_escaped_backslash_bad.json" + - "/nst_json_testsuite2/test_parsing/n_string_escaped_ctrl_char_tab.json" + - "/nst_json_testsuite2/test_parsing/n_string_escaped_emoji.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escaped_character.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate_escape_invalid.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid-utf-8-in-escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid_backslash_esc.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid_unicode_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid_utf8_after_escape.json" + description: "Checks that various illegal control characters and UTF-8 characters are rejected." + - type: cpp_test + name: "Unicode;escaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings - - testsuites + type: check_test_results + configuration: + tests: + - strings + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.8.md b/TSF/trustable/no-json-faults/NJF-07.8.md index 397960c661..835b8c5116 100644 --- a/TSF/trustable/no-json-faults/NJF-07.8.md +++ b/TSF/trustable/no-json-faults/NJF-07.8.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "Unicode;escaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "Unicode;escaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-07.9.md b/TSF/trustable/no-json-faults/NJF-07.9.md index cfa0237635..dde97db5da 100644 --- a/TSF/trustable/no-json-faults/NJF-07.9.md +++ b/TSF/trustable/no-json-faults/NJF-07.9.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-07 - - type: cpp_test - name: "Unicode;unescaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - NJF-07 + - type: cpp_test + name: "Unicode;unescaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 1.0 --- diff --git a/TSF/trustable/no-json-faults/NJF-07.md b/TSF/trustable/no-json-faults/NJF-07.md index 2a60a1f300..7ab4d975bc 100644 --- a/TSF/trustable/no-json-faults/NJF-07.md +++ b/TSF/trustable/no-json-faults/NJF-07.md @@ -2,10 +2,10 @@ level: 1.1 normative: true references: - - type: function_reference - name: "lexer::scan_string" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function which scans a string and verifies *en passant* that the string is in accordance with RFC8259" + - type: function_reference + name: "lexer::scan_string" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that scans a string and verifies *en passant* that the string is in accordance with RFC8259." --- The service provided by the nlohmann/json library accepts and rejects strings according to RFC8259 §7. \ No newline at end of file diff --git a/TSF/trustable/no-json-faults/NJF-08.1.md b/TSF/trustable/no-json-faults/NJF-08.1.md index 72853b3850..5fe48d1e6b 100644 --- a/TSF/trustable/no-json-faults/NJF-08.1.md +++ b/TSF/trustable/no-json-faults/NJF-08.1.md @@ -3,18 +3,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "parser class - core;accept;number;integers" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "parser class - core;accept;number;integers" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.2.md b/TSF/trustable/no-json-faults/NJF-08.2.md index e8374b783d..a7c32cb547 100644 --- a/TSF/trustable/no-json-faults/NJF-08.2.md +++ b/TSF/trustable/no-json-faults/NJF-08.2.md @@ -3,18 +3,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "parser class - core;accept;number;integers;edge cases" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "parser class - core;accept;number;integers;edge cases" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.3.md b/TSF/trustable/no-json-faults/NJF-08.3.md index dd36d6e46b..474d6a2e61 100644 --- a/TSF/trustable/no-json-faults/NJF-08.3.md +++ b/TSF/trustable/no-json-faults/NJF-08.3.md @@ -2,29 +2,29 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" - description: "Checks that NaN and Inf are rejected." - - type: cpp_test - name: "accept;illegal literal numbers" - path: "TSF/tests/unit-literals.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" + description: "Checks that NaN and Inf are rejected." + - type: cpp_test + name: "accept;illegal literal numbers" + path: "TSF/tests/unit-literals.cpp" evidence: - type: check_test_results - configuration: - tests: - - literals - - testsuites + type: check_test_results + configuration: + tests: + - literals + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.4.md b/TSF/trustable/no-json-faults/NJF-08.4.md index 6709d02b39..bbfbe064a3 100644 --- a/TSF/trustable/no-json-faults/NJF-08.4.md +++ b/TSF/trustable/no-json-faults/NJF-08.4.md @@ -3,31 +3,31 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "parser class - core;accept;number;integers;with exponent" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_neg_exp.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_pos_exp.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_exponent.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_fraction_exponent.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_neg_exp.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_pos_exponent.json" - description: "Checks that various numbers with exponent are accepted." + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "parser class - core;accept;number;integers;with exponent" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_neg_exp.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_pos_exp.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_exponent.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_fraction_exponent.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_neg_exp.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_pos_exponent.json" + description: "Checks that various numbers with exponent are accepted." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.5.md b/TSF/trustable/no-json-faults/NJF-08.5.md index 088aca6f05..d36a6f4ec1 100644 --- a/TSF/trustable/no-json-faults/NJF-08.5.md +++ b/TSF/trustable/no-json-faults/NJF-08.5.md @@ -2,21 +2,21 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "accept;exponents;U+0425" - path: "TSF/tests/unit-numbers.cpp" - - type: cpp_test - name: "accept;exponents;U+0436" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "accept;exponents;U+0425" + path: "TSF/tests/unit-numbers.cpp" + - type: cpp_test + name: "accept;exponents;U+0436" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - numbers + type: check_test_results + configuration: + tests: + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.6.md b/TSF/trustable/no-json-faults/NJF-08.6.md index 0252ac3641..ff283353c0 100644 --- a/TSF/trustable/no-json-faults/NJF-08.6.md +++ b/TSF/trustable/no-json-faults/NJF-08.6.md @@ -3,79 +3,79 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "parser class - core;accept;number;invalid numbers" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_++.json" - - "/nst_json_testsuite2/test_parsing/n_number_+1.json" - - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_-01.json" - - "/nst_json_testsuite2/test_parsing/n_number_-1.0..json" - - "/nst_json_testsuite2/test_parsing/n_number_-2..json" - - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_.-1.json" - - "/nst_json_testsuite2/test_parsing/n_number_.2e-3.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.1.2.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.3e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.3e.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.e1.json" - - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E+.json" - - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E.json" - - "/nst_json_testsuite2/test_parsing/n_number_0e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_0e.json" - - "/nst_json_testsuite2/test_parsing/n_number_1.0e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_1.0e-.json" - - "/nst_json_testsuite2/test_parsing/n_number_1.0e.json" - - "/nst_json_testsuite2/test_parsing/n_number_1_000.json" - - "/nst_json_testsuite2/test_parsing/n_number_1eE2.json" - - "/nst_json_testsuite2/test_parsing/n_number_2.e+3.json" - - "/nst_json_testsuite2/test_parsing/n_number_2.e-3.json" - - "/nst_json_testsuite2/test_parsing/n_number_2.e3.json" - - "/nst_json_testsuite2/test_parsing/n_number_9.e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_U+FF11_fullwidth_digit_one.json" - - "/nst_json_testsuite2/test_parsing/n_number_expression.json" - - "/nst_json_testsuite2/test_parsing/n_number_hex_1_digit.json" - - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" - - "/nst_json_testsuite2/test_parsing/n_number_infinity.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid+-.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-negative-real.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-bigger-int.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-exponent.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-int.json" - - "/nst_json_testsuite2/test_parsing/n_number_minus_infinity.json" - - "/nst_json_testsuite2/test_parsing/n_number_minus_sign_with_trailing_garbage.json" - - "/nst_json_testsuite2/test_parsing/n_number_minus_space_1.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_real_without_int_part.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_with_garbage_at_end.json" - - "/nst_json_testsuite2/test_parsing/n_number_real_garbage_after_e.json" - - "/nst_json_testsuite2/test_parsing/n_number_real_with_invalid_utf8_after_e.json" - - "/nst_json_testsuite2/test_parsing/n_number_real_without_fractional_part.json" - - "/nst_json_testsuite2/test_parsing/n_number_starting_with_dot.json" - - "/nst_json_testsuite2/test_parsing/n_number_with_alpha.json" - - "/nst_json_testsuite2/test_parsing/n_number_with_alpha_char.json" - - "/nst_json_testsuite2/test_parsing/n_number_with_leading_zero.json" - description: "Tests whether various numbers with invalid syntax according to RFC8259 are rejected." - - type: cpp_test - name: "accept;operators" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "parser class - core;accept;number;invalid numbers" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_++.json" + - "/nst_json_testsuite2/test_parsing/n_number_+1.json" + - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_-01.json" + - "/nst_json_testsuite2/test_parsing/n_number_-1.0..json" + - "/nst_json_testsuite2/test_parsing/n_number_-2..json" + - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_.-1.json" + - "/nst_json_testsuite2/test_parsing/n_number_.2e-3.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.1.2.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.3e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.3e.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.e1.json" + - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E+.json" + - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E.json" + - "/nst_json_testsuite2/test_parsing/n_number_0e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_0e.json" + - "/nst_json_testsuite2/test_parsing/n_number_1.0e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_1.0e-.json" + - "/nst_json_testsuite2/test_parsing/n_number_1.0e.json" + - "/nst_json_testsuite2/test_parsing/n_number_1_000.json" + - "/nst_json_testsuite2/test_parsing/n_number_1eE2.json" + - "/nst_json_testsuite2/test_parsing/n_number_2.e+3.json" + - "/nst_json_testsuite2/test_parsing/n_number_2.e-3.json" + - "/nst_json_testsuite2/test_parsing/n_number_2.e3.json" + - "/nst_json_testsuite2/test_parsing/n_number_9.e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_U+FF11_fullwidth_digit_one.json" + - "/nst_json_testsuite2/test_parsing/n_number_expression.json" + - "/nst_json_testsuite2/test_parsing/n_number_hex_1_digit.json" + - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" + - "/nst_json_testsuite2/test_parsing/n_number_infinity.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid+-.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-negative-real.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-bigger-int.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-exponent.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-int.json" + - "/nst_json_testsuite2/test_parsing/n_number_minus_infinity.json" + - "/nst_json_testsuite2/test_parsing/n_number_minus_sign_with_trailing_garbage.json" + - "/nst_json_testsuite2/test_parsing/n_number_minus_space_1.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_real_without_int_part.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_with_garbage_at_end.json" + - "/nst_json_testsuite2/test_parsing/n_number_real_garbage_after_e.json" + - "/nst_json_testsuite2/test_parsing/n_number_real_with_invalid_utf8_after_e.json" + - "/nst_json_testsuite2/test_parsing/n_number_real_without_fractional_part.json" + - "/nst_json_testsuite2/test_parsing/n_number_starting_with_dot.json" + - "/nst_json_testsuite2/test_parsing/n_number_with_alpha.json" + - "/nst_json_testsuite2/test_parsing/n_number_with_alpha_char.json" + - "/nst_json_testsuite2/test_parsing/n_number_with_leading_zero.json" + description: "Tests whether various numbers with invalid syntax according to RFC8259 are rejected." + - type: cpp_test + name: "accept;operators" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - numbers + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.7.md b/TSF/trustable/no-json-faults/NJF-08.7.md index b541b3cc33..caf1b47126 100644 --- a/TSF/trustable/no-json-faults/NJF-08.7.md +++ b/TSF/trustable/no-json-faults/NJF-08.7.md @@ -3,18 +3,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "parser class - core;accept;number;floating-point" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "parser class - core;accept;number;floating-point" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.8.md b/TSF/trustable/no-json-faults/NJF-08.8.md index ee1bbd47e2..40557a74b2 100644 --- a/TSF/trustable/no-json-faults/NJF-08.8.md +++ b/TSF/trustable/no-json-faults/NJF-08.8.md @@ -3,30 +3,30 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_-01.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" - description: "Checks that -01 is rejected." - - type: cpp_test - name: "parser class - core;accept;number;invalid numbers" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "accept;Leading zeroes" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_-01.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" + description: "Checks that -01 is rejected." + - type: cpp_test + name: "parser class - core;accept;number;invalid numbers" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "accept;Leading zeroes" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - numbers + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.9.md b/TSF/trustable/no-json-faults/NJF-08.9.md index 4048c7a850..f949d7a1c6 100644 --- a/TSF/trustable/no-json-faults/NJF-08.9.md +++ b/TSF/trustable/no-json-faults/NJF-08.9.md @@ -3,31 +3,31 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - NJF-08 - - type: cpp_test - name: "parser class - core;accept;number;integers" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_hex_1_digit.json" - - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" - - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" - description: "Rejects Hexadecimals" - - type: cpp_test - name: "accept;bases" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-01 + - NJF-08 + - type: cpp_test + name: "parser class - core;accept;number;integers" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_hex_1_digit.json" + - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" + - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" + description: "Rejects Hexadecimals." + - type: cpp_test + name: "accept;bases" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - numbers + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-08.md b/TSF/trustable/no-json-faults/NJF-08.md index cb110cfe3d..5c22f846f9 100644 --- a/TSF/trustable/no-json-faults/NJF-08.md +++ b/TSF/trustable/no-json-faults/NJF-08.md @@ -2,10 +2,10 @@ level: 1.1 normative: true references: - - type: function_reference - name: "lexer::scan_number" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which scans numbers and verifies *en passant* that these number is in accordance with RFC8259" + - type: function_reference + name: "lexer::scan_number" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that scans numbers and verifies *en passant* that these numbers are in accordance with RFC8259." --- The service provided by the nlohmann/json library accepts numbers according to RFC8259 §6. \ No newline at end of file diff --git a/TSF/trustable/no-json-faults/NJF-09.md b/TSF/trustable/no-json-faults/NJF-09.md index 88976537d2..5076849f96 100644 --- a/TSF/trustable/no-json-faults/NJF-09.md +++ b/TSF/trustable/no-json-faults/NJF-09.md @@ -2,31 +2,31 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: function_reference - name: "parser::accept" - path: "include/nlohmann/detail/input/parser.hpp" - description: "function, which implements the service to check for well-formed json" - - type: function_reference - name: "parser::sax_parse" - path: "include/nlohmann/detail/input/parser.hpp" - description: "function, which is called by parser::accept" - - type: function_reference - name: "parser::sax_parse_internal" - path: "include/nlohmann/detail/input/parser.hpp" - decscription: "function, which is called by parser::sax_parse" - - type: function_reference - name: "lexer::scan" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which is called by parser::sax_parse_internal to read input data" - - type: JSON_testsuite - name: "json.org examples;1.json" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/json.org/1.json" - description: "Checks that a valid json object containing all six structural characters is accepted." + - type: item + items: + - JLEX-01 + - type: function_reference + name: "parser::accept" + path: "include/nlohmann/detail/input/parser.hpp" + description: "Function that implements the service to check for well-formed json." + - type: function_reference + name: "parser::sax_parse" + path: "include/nlohmann/detail/input/parser.hpp" + description: "Function that is called by parser::accept." + - type: function_reference + name: "parser::sax_parse_internal" + path: "include/nlohmann/detail/input/parser.hpp" + decscription: "Function that is called by parser::sax_parse." + - type: function_reference + name: "lexer::scan" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that is called by parser::sax_parse_internal to read input data." + - type: JSON_testsuite + name: "json.org examples;1.json" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/json.org/1.json" + description: "Checks that a valid json object containing all six structural characters is accepted." score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-10.md b/TSF/trustable/no-json-faults/NJF-10.md index 5da127e3e1..73625de812 100644 --- a/TSF/trustable/no-json-faults/NJF-10.md +++ b/TSF/trustable/no-json-faults/NJF-10.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-11.md b/TSF/trustable/no-json-faults/NJF-11.md index ed918cf65b..63bedc2215 100644 --- a/TSF/trustable/no-json-faults/NJF-11.md +++ b/TSF/trustable/no-json-faults/NJF-11.md @@ -2,28 +2,28 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" - - type: cpp_test - name: "accept;whitespace" - path: "TSF/tests/unit-literals.cpp" - - type: cpp_test - name: "accept;whitespace;Leading and tailing" - path: "TSF/tests/unit-numbers.cpp" - - type: cpp_test - name: "accept;whitespace" - path: "TSF/tests/unit-strings.cpp" - - type: cpp_test - name: "accept;whitespace" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "accept;whitespace" - path: "TSF/tests/unit-arrays.cpp" + - type: item + items: + - JLEX-01 + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." + - type: cpp_test + name: "accept;whitespace" + path: "TSF/tests/unit-literals.cpp" + - type: cpp_test + name: "accept;whitespace;Leading and tailing" + path: "TSF/tests/unit-numbers.cpp" + - type: cpp_test + name: "accept;whitespace" + path: "TSF/tests/unit-strings.cpp" + - type: cpp_test + name: "accept;whitespace" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "accept;whitespace" + path: "TSF/tests/unit-arrays.cpp" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-12.1.md b/TSF/trustable/no-json-faults/NJF-12.1.md index 9e97a2d98a..d98de3b895 100644 --- a/TSF/trustable/no-json-faults/NJF-12.1.md +++ b/TSF/trustable/no-json-faults/NJF-12.1.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;malformed sequences" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;malformed sequences" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 0.9 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-12.2.md b/TSF/trustable/no-json-faults/NJF-12.2.md index 82724e5ad3..e3b85503c7 100644 --- a/TSF/trustable/no-json-faults/NJF-12.2.md +++ b/TSF/trustable/no-json-faults/NJF-12.2.md @@ -3,17 +3,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;overlong sequences" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;overlong sequences" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 0.6 Erikhu1: 0.9 diff --git a/TSF/trustable/no-json-faults/NJF-12.3.md b/TSF/trustable/no-json-faults/NJF-12.3.md index eb9e45f453..0f305b532d 100644 --- a/TSF/trustable/no-json-faults/NJF-12.3.md +++ b/TSF/trustable/no-json-faults/NJF-12.3.md @@ -3,24 +3,24 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_lone-invalid-utf-8.json" - description: "" - - type: cpp_test - name: "Unicode;unescaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_lone-invalid-utf-8.json" + description: "" + - type: cpp_test + name: "Unicode;unescaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings - - testsuites + type: check_test_results + configuration: + tests: + - strings + - testsuites score: Jonas-Kirchhoff: 0.9 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-12.5.md b/TSF/trustable/no-json-faults/NJF-12.5.md index 0cb63a7b3e..81d6fbf46f 100644 --- a/TSF/trustable/no-json-faults/NJF-12.5.md +++ b/TSF/trustable/no-json-faults/NJF-12.5.md @@ -3,20 +3,20 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;noncharacter code positions" - path: "TSF/tests/unit-strings.cpp" - - type: cpp_test - name: "Unicode;unescaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;noncharacter code positions" + path: "TSF/tests/unit-strings.cpp" + - type: cpp_test + name: "Unicode;unescaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 0.75 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-12.6.md b/TSF/trustable/no-json-faults/NJF-12.6.md index 45ee5e6397..832204ea3a 100644 --- a/TSF/trustable/no-json-faults/NJF-12.6.md +++ b/TSF/trustable/no-json-faults/NJF-12.6.md @@ -3,17 +3,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "Unicode;escaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "Unicode;escaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 0.9 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-13.md b/TSF/trustable/no-json-faults/NJF-13.md index 64f314c6dc..ac0fb75f66 100644 --- a/TSF/trustable/no-json-faults/NJF-13.md +++ b/TSF/trustable/no-json-faults/NJF-13.md @@ -3,17 +3,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "compliance tests from json.org;expected passes" - path: "tests/src/unit-testsuites.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "compliance tests from json.org;expected passes" + path: "tests/src/unit-testsuites.cpp" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 0.95 diff --git a/TSF/trustable/no-json-faults/NJF-14.1.md b/TSF/trustable/no-json-faults/NJF-14.1.md index 171fb4249b..ea3af9b7e8 100644 --- a/TSF/trustable/no-json-faults/NJF-14.1.md +++ b/TSF/trustable/no-json-faults/NJF-14.1.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;UTF-8;single BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;UTF-8;single BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-14.2.md b/TSF/trustable/no-json-faults/NJF-14.2.md index 0811bf0dd5..c1c53987bf 100644 --- a/TSF/trustable/no-json-faults/NJF-14.2.md +++ b/TSF/trustable/no-json-faults/NJF-14.2.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;UTF-8;multiple BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;UTF-8;multiple BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-14.3.md b/TSF/trustable/no-json-faults/NJF-14.3.md index 1fc432995e..06abbf2f56 100644 --- a/TSF/trustable/no-json-faults/NJF-14.3.md +++ b/TSF/trustable/no-json-faults/NJF-14.3.md @@ -2,25 +2,25 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: function_reference - name: "parser::accept" - path: "include/nlohmann/detail/input/parser.hpp" - description: "function, which implements the service to check for well-formed json" - - type: function_reference - name: "parser::sax_parse" - path: "include/nlohmann/detail/input/parser.hpp" - description: "function, which is called by parser::accept" - - type: function_reference - name: "parser::sax_parse_internal" - path: "include/nlohmann/detail/input/parser.hpp" - description: "function, which is called by parser::sax_parse" - - type: function_reference - name: "lexer::scan" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which is called by parser::sax_parse_internal to read input data" + - type: item + items: + - JLEX-01 + - type: function_reference + name: "parser::accept" + path: "include/nlohmann/detail/input/parser.hpp" + description: "Function that implements the service to check for well-formed json." + - type: function_reference + name: "parser::sax_parse" + path: "include/nlohmann/detail/input/parser.hpp" + description: "Function that is called by parser::accept." + - type: function_reference + name: "parser::sax_parse_internal" + path: "include/nlohmann/detail/input/parser.hpp" + description: "Function that is called by parser::sax_parse." + - type: function_reference + name: "lexer::scan" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that is called by parser::sax_parse_internal to read input data." score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-14.4.md b/TSF/trustable/no-json-faults/NJF-14.4.md index d1e81a0798..f5fcfa6cea 100644 --- a/TSF/trustable/no-json-faults/NJF-14.4.md +++ b/TSF/trustable/no-json-faults/NJF-14.4.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;UTF-8;Other byte-order marks;UTF-32" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;UTF-8;Other byte-order marks;UTF-32" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-json-faults/NJF-14.5.md b/TSF/trustable/no-json-faults/NJF-14.5.md index b950a39eb4..664a5ed155 100644 --- a/TSF/trustable/no-json-faults/NJF-14.5.md +++ b/TSF/trustable/no-json-faults/NJF-14.5.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-01 - - type: cpp_test - name: "accept;UTF-8;unexpected BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-01 + - type: cpp_test + name: "accept;UTF-8;unexpected BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-01.1.md b/TSF/trustable/no-parsing-faults/NPF-01.1.md index 9c69dbefb2..eedcec1720 100644 --- a/TSF/trustable/no-parsing-faults/NPF-01.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-01.1.md @@ -2,21 +2,21 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "Unicode (1/5);ignore byte-order-mark" - path: "tests/src/unit-unicode1.cpp" - - type: cpp_test - name: "deserialization;ignoring byte-order marks;BOM and content" - path: "tests/src/unit-deserialization.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "Unicode (1/5);ignore byte-order-mark" + path: "tests/src/unit-unicode1.cpp" + - type: cpp_test + name: "deserialization;ignoring byte-order marks;BOM and content" + path: "tests/src/unit-deserialization.cpp" evidence: - type: check_test_results - configuration: - tests: - - unicode1 - - deserialization + type: check_test_results + configuration: + tests: + - unicode1 + - deserialization score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-01.2.md b/TSF/trustable/no-parsing-faults/NPF-01.2.md index dc114b91c5..7cff0e640a 100644 --- a/TSF/trustable/no-parsing-faults/NPF-01.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-01.2.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parse;UTF-8;multiple BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parse;UTF-8;multiple BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-01.3.md b/TSF/trustable/no-parsing-faults/NPF-01.3.md index cd69bb8c96..ac6948ef2c 100644 --- a/TSF/trustable/no-parsing-faults/NPF-01.3.md +++ b/TSF/trustable/no-parsing-faults/NPF-01.3.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parse;UTF-8;unexpected BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parse;UTF-8;unexpected BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-01.4.md b/TSF/trustable/no-parsing-faults/NPF-01.4.md index e5da74cb01..1f5e1d7d10 100644 --- a/TSF/trustable/no-parsing-faults/NPF-01.4.md +++ b/TSF/trustable/no-parsing-faults/NPF-01.4.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parse;other BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parse;other BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" evidence: - type: check_test_results - configuration: - tests: - - byte_order_mark + type: check_test_results + configuration: + tests: + - byte_order_mark score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-01.5.md b/TSF/trustable/no-parsing-faults/NPF-01.5.md index e04f1f4afd..34ae11422b 100644 --- a/TSF/trustable/no-parsing-faults/NPF-01.5.md +++ b/TSF/trustable/no-parsing-faults/NPF-01.5.md @@ -2,27 +2,27 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "deserialization;ignoring byte-order marks;2 byte of BOM" - path: "tests/src/unit-deserialization.cpp" - - type: cpp_test - name: "deserialization;ignoring byte-order marks;1 byte of BOM" - path: "tests/src/unit-deserialization.cpp" - - type: cpp_test - name: "deserialization;ignoring byte-order marks;variations" - path: "tests/src/unit-deserialization.cpp" - - type: cpp_test - name: "Unicode (1/5);error for incomplete/wrong BOM" - path: "tests/src/unit-unicode1.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "deserialization;ignoring byte-order marks;2 byte of BOM" + path: "tests/src/unit-deserialization.cpp" + - type: cpp_test + name: "deserialization;ignoring byte-order marks;1 byte of BOM" + path: "tests/src/unit-deserialization.cpp" + - type: cpp_test + name: "deserialization;ignoring byte-order marks;variations" + path: "tests/src/unit-deserialization.cpp" + - type: cpp_test + name: "Unicode (1/5);error for incomplete/wrong BOM" + path: "tests/src/unit-unicode1.cpp" evidence: - type: check_test_results - configuration: - tests: - - deserialization - - unicode1 + type: check_test_results + configuration: + tests: + - deserialization + - unicode1 score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.1.md b/TSF/trustable/no-parsing-faults/NPF-02.1.md index 1179df581d..b982b9bef2 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.1.md @@ -2,32 +2,32 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parser class - core;parse;number;floating-point;without exponent" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "parser class - core;parse;number;integers;without exponent" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_number_simple_int.json" - - "/nst_json_testsuite2/test_parsing/y_number_simple_real.json" - - "/nst_json_testsuite2/test_parsing/y_number_negative_int.json" - - "/nst_json_testsuite2/test_parsing/y_number_negative_one.json" - - "/nst_json_testsuite2/test_parsing/y_number_negative_zero.json" - description: "Tests whether several numbers without exponent are parsed without throwing an exception." + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parser class - core;parse;number;floating-point;without exponent" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parser class - core;parse;number;integers;without exponent" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_number_simple_int.json" + - "/nst_json_testsuite2/test_parsing/y_number_simple_real.json" + - "/nst_json_testsuite2/test_parsing/y_number_negative_int.json" + - "/nst_json_testsuite2/test_parsing/y_number_negative_one.json" + - "/nst_json_testsuite2/test_parsing/y_number_negative_zero.json" + description: "Tests whether several numbers without exponent are parsed without throwing an exception." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.10.md b/TSF/trustable/no-parsing-faults/NPF-02.10.md index 1a4c0985c7..b947261ffe 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.10.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.10.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "regression tests 1;issue #379 - locale-independent str-to-num" - path: "tests/src/unit-regression1.cpp" - - type: cpp_test - name: "parse;trailing zeroes" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "regression tests 1;issue #379 - locale-independent str-to-num" + path: "tests/src/unit-regression1.cpp" + - type: cpp_test + name: "parse;trailing zeroes" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - regression1 - - numbers + type: check_test_results + configuration: + tests: + - regression1 + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.11.md b/TSF/trustable/no-parsing-faults/NPF-02.11.md index fda51845c7..a7331f3b22 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.11.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.11.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "regression tests 1;issue #186 miloyip/nativejson-benchmark: floating-point parsing" - path: "tests/src/unit-regression1.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "regression tests 1;issue #186 miloyip/nativejson-benchmark: floating-point parsing" + path: "tests/src/unit-regression1.cpp" evidence: - type: check_test_results - configuration: - tests: - - regression1 + type: check_test_results + configuration: + tests: + - regression1 score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.12.md b/TSF/trustable/no-parsing-faults/NPF-02.12.md index fd497326d4..7521cdb66d 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.12.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.12.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parse;exponents;Capitalisation" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parse;exponents;Capitalisation" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - numbers + type: check_test_results + configuration: + tests: + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.2.md b/TSF/trustable/no-parsing-faults/NPF-02.2.md index dde94d497a..2f3f35003d 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.2.md @@ -2,38 +2,38 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parser class - core;parse;number;floating-point;with exponent" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "parser class - core;parse;number;integers;with exponent" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_neg_exp.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_pos_exp.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_exponent.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_fraction_exponent.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_neg_exp.json" - - "/nst_json_testsuite2/test_parsing/y_number_real_pos_exponent.json" - description: "Tests whether several numbers with exponent are parsed without throwing an exception." - - type: cpp_test - name: "parse;Precision" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parser class - core;parse;number;floating-point;with exponent" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parser class - core;parse;number;integers;with exponent" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_neg_exp.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_capital_e_pos_exp.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_exponent.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_fraction_exponent.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_neg_exp.json" + - "/nst_json_testsuite2/test_parsing/y_number_real_pos_exponent.json" + description: "Tests whether several numbers with exponent are parsed without throwing an exception." + - type: cpp_test + name: "parse;Precision" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - numbers + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.3.md b/TSF/trustable/no-parsing-faults/NPF-02.3.md index 6d48afffca..f3da05586e 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.3.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.3.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parser class - core;parse;number;integers" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parser class - core;parse;number;integers" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.4.md b/TSF/trustable/no-parsing-faults/NPF-02.4.md index cc163e46f0..5a1df1eca7 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.4.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.4.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parser class - core;parse;number;floating-point" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "regression tests 1;issue #360 - Loss of precision when serializing " - path: "tests/src/unit-regression1.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parser class - core;parse;number;floating-point" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "regression tests 1;issue #360 - Loss of precision when serializing " + path: "tests/src/unit-regression1.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - regression1 + type: check_test_results + configuration: + tests: + - class_parser_core + - regression1 score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.5.md b/TSF/trustable/no-parsing-faults/NPF-02.5.md index 8dc456d82e..01527cbee2 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.5.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.5.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parse;exponents;leading zeroes" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parse;exponents;leading zeroes" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - numbers + type: check_test_results + configuration: + tests: + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.6.md b/TSF/trustable/no-parsing-faults/NPF-02.6.md index b0bf6331f9..1487e5b41e 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.6.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.6.md @@ -2,21 +2,21 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parser class - core;parse;number;integers;edge cases" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "parser class - core;parse;number;integers;over the edge cases" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parser class - core;parse;number;integers;edge cases" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parser class - core;parse;number;integers;over the edge cases" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.7.md b/TSF/trustable/no-parsing-faults/NPF-02.7.md index 66965a5e8f..9428694638 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.7.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.7.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parse;whitespace" - path: "TSF/tests/unit-numbers.cpp" - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parse;whitespace" + path: "TSF/tests/unit-numbers.cpp" + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - numbers + type: check_test_results + configuration: + tests: + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.8.md b/TSF/trustable/no-parsing-faults/NPF-02.8.md index cd91aaff3d..7af21f81c8 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.8.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.8.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "parse;exponents;leading plus" - path: "TSF/tests/unit-numbers.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "parse;exponents;leading plus" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - numbers + type: check_test_results + configuration: + tests: + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.9.md b/TSF/trustable/no-parsing-faults/NPF-02.9.md index 44b76fab66..eb67ae1916 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.9.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.9.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-02 - - type: cpp_test - name: "compliance tests from nativejson-benchmark;doubles" - path: "tests/src/unit-testsuites.cpp" - - type: cpp_test - name: "regression tests 1;issue #360 - Loss of precision when serializing " - path: "tests/src/unit-regression1.cpp" + - type: item + items: + - JLEX-02 + - NPF-02 + - type: cpp_test + name: "compliance tests from nativejson-benchmark;doubles" + path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "regression tests 1;issue #360 - Loss of precision when serializing " + path: "tests/src/unit-regression1.cpp" evidence: - type: check_test_results - configuration: - tests: - - regression1 - - testsuites + type: check_test_results + configuration: + tests: + - regression1 + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-02.md b/TSF/trustable/no-parsing-faults/NPF-02.md index 2f42710b13..c802245e02 100644 --- a/TSF/trustable/no-parsing-faults/NPF-02.md +++ b/TSF/trustable/no-parsing-faults/NPF-02.md @@ -2,10 +2,10 @@ level: 1.1 normative: true references: - - type: function_reference - name: "lexer::scan_number" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which parses numbers into C++ number-types and verifies *en passant* that these numbers are in accordance with RFC8259" + - type: function_reference + name: "lexer::scan_number" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that parses numbers into C++ number-types and verifies *en passant* that these numbers are in accordance with RFC8259." --- The service provided by the nlohmann/json library parses numbers according to RFC8259. \ No newline at end of file diff --git a/TSF/trustable/no-parsing-faults/NPF-03.1.md b/TSF/trustable/no-parsing-faults/NPF-03.1.md index 3aa9d190a5..6eeb9150fb 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.1.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "parse;whitespace" - path: "TSF/tests/unit-strings.cpp" - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "parse;whitespace" + path: "TSF/tests/unit-strings.cpp" + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.2.md b/TSF/trustable/no-parsing-faults/NPF-03.2.md index 01e3f63096..4e1eb124f7 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.2.md @@ -2,26 +2,26 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "parser class - core;parse;string;escaped" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "compliance tests from nativejson-benchmark;strings" - path: "tests/src/unit-testsuites.cpp" - - type: cpp_test - name: "Unicode (1/5);\\\\uxxxx sequences;correct sequences" - path: "tests/src/unit-unicode1.cpp" + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "parser class - core;parse;string;escaped" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "compliance tests from nativejson-benchmark;strings" + path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "Unicode (1/5);\\\\uxxxx sequences;correct sequences" + path: "tests/src/unit-unicode1.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - unicode1 + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - unicode1 score: Jonas-Kirchhoff: 0.95 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.3.md b/TSF/trustable/no-parsing-faults/NPF-03.3.md index 059ed1cb07..b48911767b 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.3.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.3.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "Unicode;escaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "Unicode;escaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 0.95 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.4.md b/TSF/trustable/no-parsing-faults/NPF-03.4.md index ad44c62301..ec7ffb431c 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.4.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.4.md @@ -2,29 +2,29 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "RFC 8259 examples;7. Strings" - path: "tests/src/unit-testsuites.cpp" - - type: JSON_testsuite - name: "Unicode (1/5);read all unicode characters" - path: "tests/src/unit-unicode1.cpp" - test_suite_paths: - - "/json_nlohmann_tests/all_unicode.json" - description: "" - - type: cpp_test - name: "Unicode;unescaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "RFC 8259 examples;7. Strings" + path: "tests/src/unit-testsuites.cpp" + - type: JSON_testsuite + name: "Unicode (1/5);read all unicode characters" + path: "tests/src/unit-unicode1.cpp" + test_suite_paths: + - "/json_nlohmann_tests/all_unicode.json" + description: "" + - type: cpp_test + name: "Unicode;unescaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - unicode1 - - testsuites - - strings + type: check_test_results + configuration: + tests: + - unicode1 + - testsuites + - strings score: Jonas-Kirchhoff: 0.95 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.5.md b/TSF/trustable/no-parsing-faults/NPF-03.5.md index 93bf004a55..bd0c8511f2 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.5.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.5.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "compliance tests from nativejson-benchmark;strings" - path: "tests/src/unit-testsuites.cpp" - - type: cpp_test - name: "parser class - core;parse;string;escaped" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "compliance tests from nativejson-benchmark;strings" + path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "parser class - core;parse;string;escaped" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.6.md b/TSF/trustable/no-parsing-faults/NPF-03.6.md index cb2cd1d81b..d263cee773 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.6.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.6.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "parser class - core;parse;string" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "parser class - core;parse;string" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.7.md b/TSF/trustable/no-parsing-faults/NPF-03.7.md index 6a694ab632..9089724ff0 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.7.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.7.md @@ -2,73 +2,73 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-03 - - type: cpp_test - name: "parser class - core;parse;string;escaped" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "compliance tests from nativejson-benchmark;strings" - path: "tests/src/unit-testsuites.cpp" - - type: cpp_test - name: "RFC 8259 examples;7. Strings" - path: "tests/src/unit-testsuites.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_string_1_2_3_bytes_UTF-8_sequences.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" - - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" - - "/nst_json_testsuite2/test_parsing/y_string_allowed_escapes.json" - - "/nst_json_testsuite2/test_parsing/y_string_backslash_and_u_escaped_zero.json" - - "/nst_json_testsuite2/test_parsing/y_string_backslash_doublequotes.json" - - "/nst_json_testsuite2/test_parsing/y_string_comments.json" - - "/nst_json_testsuite2/test_parsing/y_string_double_escape_a.json" - - "/nst_json_testsuite2/test_parsing/y_string_double_escape_n.json" - - "/nst_json_testsuite2/test_parsing/y_string_escaped_control_character.json" - - "/nst_json_testsuite2/test_parsing/y_string_escaped_noncharacter.json" - - "/nst_json_testsuite2/test_parsing/y_string_in_array.json" - - "/nst_json_testsuite2/test_parsing/y_string_in_array_with_leading_space.json" - - "/nst_json_testsuite2/test_parsing/y_string_last_surrogates_1_and_2.json" - - "/nst_json_testsuite2/test_parsing/y_string_nbsp_uescaped.json" - - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+10FFFF.json" - - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+FFFF.json" - - "/nst_json_testsuite2/test_parsing/y_string_null_escape.json" - - "/nst_json_testsuite2/test_parsing/y_string_one-byte-utf-8.json" - - "/nst_json_testsuite2/test_parsing/y_string_pi.json" - - "/nst_json_testsuite2/test_parsing/y_string_reservedCharacterInUTF-8_U+1BFFF.json" - - "/nst_json_testsuite2/test_parsing/y_string_simple_ascii.json" - - "/nst_json_testsuite2/test_parsing/y_string_space.json" - - "/nst_json_testsuite2/test_parsing/y_string_surrogates_U+1D11E_MUSICAL_SYMBOL_G_CLEF.json" - - "/nst_json_testsuite2/test_parsing/y_string_three-byte-utf-8.json" - - "/nst_json_testsuite2/test_parsing/y_string_two-byte-utf-8.json" - - "/nst_json_testsuite2/test_parsing/y_string_u+2028_line_sep.json" - - "/nst_json_testsuite2/test_parsing/y_string_u+2029_par_sep.json" - - "/nst_json_testsuite2/test_parsing/y_string_uEscape.json" - - "/nst_json_testsuite2/test_parsing/y_string_uescaped_newline.json" - - "/nst_json_testsuite2/test_parsing/y_string_unescaped_char_delete.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicodeEscapedBackslash.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_2.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+10FFFE_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+1FFFE_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+200B_ZERO_WIDTH_SPACE.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+2064_invisible_plus.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FDD0_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FFFE_nonchar.json" - - "/nst_json_testsuite2/test_parsing/y_string_unicode_escaped_double_quote.json" - - "/nst_json_testsuite2/test_parsing/y_string_utf8.json" - - "/nst_json_testsuite2/test_parsing/y_string_with_del_character.json" - description: "Tests whether several non-empty strings are parsed without throwing an exception." + - type: item + items: + - JLEX-02 + - NPF-03 + - type: cpp_test + name: "parser class - core;parse;string;escaped" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "compliance tests from nativejson-benchmark;strings" + path: "tests/src/unit-testsuites.cpp" + - type: cpp_test + name: "RFC 8259 examples;7. Strings" + path: "tests/src/unit-testsuites.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_string_1_2_3_bytes_UTF-8_sequences.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pair.json" + - "/nst_json_testsuite2/test_parsing/y_string_accepted_surrogate_pairs.json" + - "/nst_json_testsuite2/test_parsing/y_string_allowed_escapes.json" + - "/nst_json_testsuite2/test_parsing/y_string_backslash_and_u_escaped_zero.json" + - "/nst_json_testsuite2/test_parsing/y_string_backslash_doublequotes.json" + - "/nst_json_testsuite2/test_parsing/y_string_comments.json" + - "/nst_json_testsuite2/test_parsing/y_string_double_escape_a.json" + - "/nst_json_testsuite2/test_parsing/y_string_double_escape_n.json" + - "/nst_json_testsuite2/test_parsing/y_string_escaped_control_character.json" + - "/nst_json_testsuite2/test_parsing/y_string_escaped_noncharacter.json" + - "/nst_json_testsuite2/test_parsing/y_string_in_array.json" + - "/nst_json_testsuite2/test_parsing/y_string_in_array_with_leading_space.json" + - "/nst_json_testsuite2/test_parsing/y_string_last_surrogates_1_and_2.json" + - "/nst_json_testsuite2/test_parsing/y_string_nbsp_uescaped.json" + - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+10FFFF.json" + - "/nst_json_testsuite2/test_parsing/y_string_nonCharacterInUTF-8_U+FFFF.json" + - "/nst_json_testsuite2/test_parsing/y_string_null_escape.json" + - "/nst_json_testsuite2/test_parsing/y_string_one-byte-utf-8.json" + - "/nst_json_testsuite2/test_parsing/y_string_pi.json" + - "/nst_json_testsuite2/test_parsing/y_string_reservedCharacterInUTF-8_U+1BFFF.json" + - "/nst_json_testsuite2/test_parsing/y_string_simple_ascii.json" + - "/nst_json_testsuite2/test_parsing/y_string_space.json" + - "/nst_json_testsuite2/test_parsing/y_string_surrogates_U+1D11E_MUSICAL_SYMBOL_G_CLEF.json" + - "/nst_json_testsuite2/test_parsing/y_string_three-byte-utf-8.json" + - "/nst_json_testsuite2/test_parsing/y_string_two-byte-utf-8.json" + - "/nst_json_testsuite2/test_parsing/y_string_u+2028_line_sep.json" + - "/nst_json_testsuite2/test_parsing/y_string_u+2029_par_sep.json" + - "/nst_json_testsuite2/test_parsing/y_string_uEscape.json" + - "/nst_json_testsuite2/test_parsing/y_string_uescaped_newline.json" + - "/nst_json_testsuite2/test_parsing/y_string_unescaped_char_delete.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicodeEscapedBackslash.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_2.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+10FFFE_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+1FFFE_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+200B_ZERO_WIDTH_SPACE.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+2064_invisible_plus.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FDD0_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_U+FFFE_nonchar.json" + - "/nst_json_testsuite2/test_parsing/y_string_unicode_escaped_double_quote.json" + - "/nst_json_testsuite2/test_parsing/y_string_utf8.json" + - "/nst_json_testsuite2/test_parsing/y_string_with_del_character.json" + description: "Tests whether several non-empty strings are parsed without throwing an exception." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-03.md b/TSF/trustable/no-parsing-faults/NPF-03.md index aed32371e1..c9a8c4d746 100644 --- a/TSF/trustable/no-parsing-faults/NPF-03.md +++ b/TSF/trustable/no-parsing-faults/NPF-03.md @@ -2,10 +2,10 @@ level: 1.1 normative: true references: - - type: function_reference - name: "lexer::scan_string" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which parses strings into C++ std::string and verifies *en passant* that these strings are in accordance with RFC8259" + - type: function_reference + name: "lexer::scan_string" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that parses strings into C++ std::string and verifies *en passant* that these strings are in accordance with RFC8259." --- The service provided by the nlohmann/json library parses strings according to RFC8259. \ No newline at end of file diff --git a/TSF/trustable/no-parsing-faults/NPF-04.1.md b/TSF/trustable/no-parsing-faults/NPF-04.1.md index 95d01d1464..fb60257119 100644 --- a/TSF/trustable/no-parsing-faults/NPF-04.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-04.1.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-04 - - type: cpp_test - name: "parse;whitespace" - path: "TSF/tests/unit-literals.cpp" - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-02 + - NPF-04 + - type: cpp_test + name: "parse;whitespace" + path: "TSF/tests/unit-literals.cpp" + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - literals + type: check_test_results + configuration: + tests: + - literals score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-04.2.md b/TSF/trustable/no-parsing-faults/NPF-04.2.md index c17f849ff1..8b76424211 100644 --- a/TSF/trustable/no-parsing-faults/NPF-04.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-04.2.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-04 - - type: cpp_test - name: "parser class - core;parse;true" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-04 + - type: cpp_test + name: "parser class - core;parse;true" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-04.3.md b/TSF/trustable/no-parsing-faults/NPF-04.3.md index 7e6c58b51a..d35c567de6 100644 --- a/TSF/trustable/no-parsing-faults/NPF-04.3.md +++ b/TSF/trustable/no-parsing-faults/NPF-04.3.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-04 - - type: cpp_test - name: "parser class - core;parse;false" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-04 + - type: cpp_test + name: "parser class - core;parse;false" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-04.4.md b/TSF/trustable/no-parsing-faults/NPF-04.4.md index 195832d165..80dde11b60 100644 --- a/TSF/trustable/no-parsing-faults/NPF-04.4.md +++ b/TSF/trustable/no-parsing-faults/NPF-04.4.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - NPF-04 - - type: cpp_test - name: "parser class - core;parse;null" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - NPF-04 + - type: cpp_test + name: "parser class - core;parse;null" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-04.md b/TSF/trustable/no-parsing-faults/NPF-04.md index 6415539283..30c92e28f9 100644 --- a/TSF/trustable/no-parsing-faults/NPF-04.md +++ b/TSF/trustable/no-parsing-faults/NPF-04.md @@ -2,10 +2,10 @@ level: 1.1 normative: true references: - - type: function_reference - name: lexer::scan_literal - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function to scan a literal candidate, compare it to its expected value and return the corresponding C++ literal" + - type: function_reference + name: lexer::scan_literal + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function to scan a literal candidate, compare it to its expected value and return the corresponding C++ literal." --- The service provided by the nlohmann/json library parses literal names "true", "false" and "null" according to RFC8259. \ No newline at end of file diff --git a/TSF/trustable/no-parsing-faults/NPF-05.1.md b/TSF/trustable/no-parsing-faults/NPF-05.1.md index 0ccf928aab..38dd6a65cf 100644 --- a/TSF/trustable/no-parsing-faults/NPF-05.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-05.1.md @@ -2,25 +2,25 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parser class - core;parse;array;empty array" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "parse;whitespace" - path: "TSF/tests/unit-arrays.cpp" - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parser class - core;parse;array;empty array" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parse;whitespace" + path: "TSF/tests/unit-arrays.cpp" + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - arrays + type: check_test_results + configuration: + tests: + - class_parser_core + - arrays score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-05.2.md b/TSF/trustable/no-parsing-faults/NPF-05.2.md index b5de34aeeb..21c019a274 100644 --- a/TSF/trustable/no-parsing-faults/NPF-05.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-05.2.md @@ -2,24 +2,24 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_array_empty.json" - description: "Tests whether the empty array is parsed without exception." - - type: cpp_test - name: "parser class - core;parse;array;empty array" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_array_empty.json" + description: "Tests whether the empty array is parsed without exception." + - type: cpp_test + name: "parser class - core;parse;array;empty array" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-05.3.md b/TSF/trustable/no-parsing-faults/NPF-05.3.md index c24f0a50e7..3f724db55c 100644 --- a/TSF/trustable/no-parsing-faults/NPF-05.3.md +++ b/TSF/trustable/no-parsing-faults/NPF-05.3.md @@ -2,33 +2,33 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parser class - core;parse;array;nonempty array" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_array_arraysWithSpaces.json" - - "/nst_json_testsuite2/test_parsing/y_array_empty-string.json" - - "/nst_json_testsuite2/test_parsing/y_array_ending_with_newline.json" - - "/nst_json_testsuite2/test_parsing/y_array_false.json" - - "/nst_json_testsuite2/test_parsing/y_array_heterogeneous.json" - - "/nst_json_testsuite2/test_parsing/y_array_null.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_1_and_newline.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_leading_space.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_several_null.json" - - "/nst_json_testsuite2/test_parsing/y_array_with_trailing_space.json" - description: "Tests whether several non-empty arrays are parsed without exception" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parser class - core;parse;array;nonempty array" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_array_arraysWithSpaces.json" + - "/nst_json_testsuite2/test_parsing/y_array_empty-string.json" + - "/nst_json_testsuite2/test_parsing/y_array_ending_with_newline.json" + - "/nst_json_testsuite2/test_parsing/y_array_false.json" + - "/nst_json_testsuite2/test_parsing/y_array_heterogeneous.json" + - "/nst_json_testsuite2/test_parsing/y_array_null.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_1_and_newline.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_leading_space.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_several_null.json" + - "/nst_json_testsuite2/test_parsing/y_array_with_trailing_space.json" + description: "Tests whether several non-empty arrays are parsed without exception." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites score: Jonas-Kirchhoff: 0.95 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-06.1.md b/TSF/trustable/no-parsing-faults/NPF-06.1.md index 885fec0fde..a36ad052ea 100644 --- a/TSF/trustable/no-parsing-faults/NPF-06.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-06.1.md @@ -2,25 +2,25 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parser class - core;parse;object;empty object" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "regression tests 1;example from #529" - path: "tests/src/unit-regression1.cpp" - - type: function_reference - name: "lexer::skip_whitespace" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "function, which skips admissible whitespace during reading" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parser class - core;parse;object;empty object" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "regression tests 1;example from #529" + path: "tests/src/unit-regression1.cpp" + - type: function_reference + name: "lexer::skip_whitespace" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "Function that skips admissible whitespace during reading." evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - regression1 + type: check_test_results + configuration: + tests: + - class_parser_core + - regression1 score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-06.2.md b/TSF/trustable/no-parsing-faults/NPF-06.2.md index bf516d2d99..3e322a2c75 100644 --- a/TSF/trustable/no-parsing-faults/NPF-06.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-06.2.md @@ -2,21 +2,21 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;y" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key.json" - - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key_and_value.json" - description: "" + - type: item + items: + - JLEX-02 + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;y" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key.json" + - "/nst_json_testsuite2/test_parsing/y_object_duplicated_key_and_value.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 0.9 Erikhu1: 0.95 diff --git a/TSF/trustable/no-parsing-faults/NPF-06.3.md b/TSF/trustable/no-parsing-faults/NPF-06.3.md index 1ae3fe9285..c996ca0839 100644 --- a/TSF/trustable/no-parsing-faults/NPF-06.3.md +++ b/TSF/trustable/no-parsing-faults/NPF-06.3.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parser class - core;parse;object;empty object" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parser class - core;parse;object;empty object" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-06.4.md b/TSF/trustable/no-parsing-faults/NPF-06.4.md index bb77de77f6..ff633b4a0d 100644 --- a/TSF/trustable/no-parsing-faults/NPF-06.4.md +++ b/TSF/trustable/no-parsing-faults/NPF-06.4.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "parser class - core;parse;object;nonempty object" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "parser class - core;parse;object;nonempty object" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 0.95 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-07.1.md b/TSF/trustable/no-parsing-faults/NPF-07.1.md index e6364f33b5..acb3d55fea 100644 --- a/TSF/trustable/no-parsing-faults/NPF-07.1.md +++ b/TSF/trustable/no-parsing-faults/NPF-07.1.md @@ -2,44 +2,44 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-1 (x00-x7F);well-formed" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-2 (xC2-xDF UTF8-tail);well-formed" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);well-formed" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);well-formed" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);well-formed" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);well-formed" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);well-formed" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);well-formed" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);well-formed" - path: "tests/src/unit-unicode5.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-1 (x00-x7F);well-formed" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-2 (xC2-xDF UTF8-tail);well-formed" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);well-formed" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);well-formed" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);well-formed" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);well-formed" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);well-formed" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);well-formed" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);well-formed" + path: "tests/src/unit-unicode5.cpp" evidence: - type: check_test_results - configuration: - tests: - - unicode2 - - unicode3 - - unicode4 - - unicode5 + type: check_test_results + configuration: + tests: + - unicode2 + - unicode3 + - unicode4 + - unicode5 score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/no-parsing-faults/NPF-07.2.md b/TSF/trustable/no-parsing-faults/NPF-07.2.md index 737508fbc5..dfb8088d27 100644 --- a/TSF/trustable/no-parsing-faults/NPF-07.2.md +++ b/TSF/trustable/no-parsing-faults/NPF-07.2.md @@ -2,128 +2,128 @@ level: 1.1 normative: true references: - - type: item - items: - - JLEX-02 - - type: cpp_test - name: "Unicode (2/5);RFC 3629;ill-formed first byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-2 (xC2-xDF UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-2 (xC2-xDF UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode2.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: missing fourth byte" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: wrong fourth byte" - path: "tests/src/unit-unicode3.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: missing fourth byte" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: wrong fourth byte" - path: "tests/src/unit-unicode4.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: missing second byte" - path: "tests/src/unit-unicode5.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: missing third byte" - path: "tests/src/unit-unicode5.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: missing fourth byte" - path: "tests/src/unit-unicode5.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: wrong second byte" - path: "tests/src/unit-unicode5.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: wrong third byte" - path: "tests/src/unit-unicode5.cpp" - - type: cpp_test - name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: wrong fourth byte" - path: "tests/src/unit-unicode5.cpp" + - type: item + items: + - JLEX-02 + - type: cpp_test + name: "Unicode (2/5);RFC 3629;ill-formed first byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-2 (xC2-xDF UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-2 (xC2-xDF UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE0 xA0-BF UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xE1-xEC UTF8-tail UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xED x80-9F UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (2/5);RFC 3629;UTF8-3 (xEE-xEF UTF8-tail UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode2.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: missing fourth byte" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (3/5);RFC 3629;UTF8-4 (xF0 x90-BF UTF8-tail UTF8-tail);ill-formed: wrong fourth byte" + path: "tests/src/unit-unicode3.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: missing fourth byte" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (4/5);RFC 3629;UTF8-4 (xF1-F3 UTF8-tail UTF8-tail UTF8-tail);ill-formed: wrong fourth byte" + path: "tests/src/unit-unicode4.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: missing second byte" + path: "tests/src/unit-unicode5.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: missing third byte" + path: "tests/src/unit-unicode5.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: missing fourth byte" + path: "tests/src/unit-unicode5.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: wrong second byte" + path: "tests/src/unit-unicode5.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: wrong third byte" + path: "tests/src/unit-unicode5.cpp" + - type: cpp_test + name: "Unicode (5/5);RFC 3629;UTF8-4 (xF4 x80-8F UTF8-tail UTF8-tail);ill-formed: wrong fourth byte" + path: "tests/src/unit-unicode5.cpp" evidence: - type: check_test_results - configuration: - tests: - - unicode2 - - unicode3 - - unicode4 - - unicode5 + type: check_test_results + configuration: + tests: + - unicode2 + - unicode3 + - unicode4 + - unicode5 score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/parse-json-data/PJD-04.md b/TSF/trustable/parse-json-data/PJD-04.md index 217fccaa39..9972174109 100644 --- a/TSF/trustable/parse-json-data/PJD-04.md +++ b/TSF/trustable/parse-json-data/PJD-04.md @@ -2,14 +2,14 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "parser class - core;parse;number;integers" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parser class - core;parse;number;integers" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/statements/JLS-01.md b/TSF/trustable/statements/JLS-01.md index 1f2694563d..f3541cd247 100644 --- a/TSF/trustable/statements/JLS-01.md +++ b/TSF/trustable/statements/JLS-01.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/workflows/ubuntu.yml#L9" - description: "The trigger condition for the CI workflow that executes the test suites." + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/workflows/ubuntu.yml#L9" + description: "The trigger condition for the CI workflow that executes the test suites." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/develop/.github/workflows/ubuntu.yml#L9" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/develop/.github/workflows/ubuntu.yml#L9" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/statements/JLS-02.md b/TSF/trustable/statements/JLS-02.md index bf499eba60..ada615df57 100644 --- a/TSF/trustable/statements/JLS-02.md +++ b/TSF/trustable/statements/JLS-02.md @@ -2,26 +2,26 @@ level: 1.1 normative: true references: - - type: website - url: "https://introspector.oss-fuzz.com/project-profile?project=json" - description: "most recent report for fuzzing introspection of nlohmann/json with historical plots" - - type: website - url: "https://storage.googleapis.com/oss-fuzz-introspector/json/inspector-report/20250824/fuzz_report.html" - description: "persistent storage of fuzz-testing-report for nlohmann/json version 3.12.0 on 24.08.2025" - - type: web_content - url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/.github/workflows/cifuzz.yml" - description: "Configuration file for Fuzz-Testing pipeline in the original nlohmann/json repository" - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for nlohmann/json, where score for 'Fuzzing' supports this statement." + - type: website + url: "https://introspector.oss-fuzz.com/project-profile?project=json" + description: "Most recent report for fuzzing introspection of nlohmann/json with historical plots." + - type: website + url: "https://storage.googleapis.com/oss-fuzz-introspector/json/inspector-report/20250824/fuzz_report.html" + description: "Persistent storage of fuzz-testing report for the nlohmann/json library version 3.12.0 on 24.08.2025." + - type: web_content + url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/.github/workflows/cifuzz.yml" + description: "Configuration file for fuzz-testing pipeline in the original nlohmann/json repository." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard report for the nlohmann/json library, where the score for 'Fuzzing' supports this statement." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://introspector.oss-fuzz.com/project-profile?project=json" - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - - "https://storage.googleapis.com/oss-fuzz-introspector/json/inspector-report/20250824/fuzz_report.html" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://introspector.oss-fuzz.com/project-profile?project=json" + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + - "https://storage.googleapis.com/oss-fuzz-introspector/json/inspector-report/20250824/fuzz_report.html" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/statements/JLS-04.md b/TSF/trustable/statements/JLS-04.md index 3210582fbe..76262251b8 100644 --- a/TSF/trustable/statements/JLS-04.md +++ b/TSF/trustable/statements/JLS-04.md @@ -2,12 +2,12 @@ level: 1.1 normative: true references: - - type: verbose_file - path: ".github/workflows/dependency-review.yml" - description: "The workflow scans PRs for dependency changes and vulnerabilities." + - type: verbose_file + path: ".github/workflows/dependency-review.yml" + description: "The workflow scans PRs for dependency changes and vulnerabilities." evidence: - type: "check_artifact_exists" - configuration: + type: "check_artifact_exists" + configuration: ubuntu: exclude coverage_gate: exclude codeql: exclude diff --git a/TSF/trustable/statements/JLS-05.md b/TSF/trustable/statements/JLS-05.md index 830c3dac17..a601746ba3 100644 --- a/TSF/trustable/statements/JLS-05.md +++ b/TSF/trustable/statements/JLS-05.md @@ -2,43 +2,43 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/issues" - description: "contains the collected github-issues for nlohmann/json" - - type: project_website - url: "https://github.com/nlohmann/json/graphs/commit-activity" - description: "presents the commit activity of the past year" - - type: project_website - url: "https://github.com/nlohmann/json/graphs/contributors" - description: "presents commits over time and per contributor" - - type: project_website - url: "https://github.com/nlohmann/json/forks?include=active&page=1&period=&sort_by=last_updated" - description: "lists all forks of nlohmann/json by last updated" - - type: project_website - url: "https://github.com/nlohmann/json/pulse" - description: "presents activity over the past week" - - type: project_website - url: "https://github.com/orgs/score-json/discussions/27#discussion-8594385" - description: "comparison between JSON libraries demonstrating the popularity of nlohmann/json" - - type: project_website - url: "https://json.nlohmann.me/home/customers/" - description: "presents a list of a subset of all customers who are using the nlohmann/json library" - - type: project_website - url: "https://github.com/nlohmann/json/releases/tag/v3.12.0" - description: "release notes for v3.12.0, listing bugs, CVEs and warnings which were either fixed or mitigated since last release" + - type: project_website + url: "https://github.com/nlohmann/json/issues" + description: "Contains the collected GitHub issues for the nlohmann/json library." + - type: project_website + url: "https://github.com/nlohmann/json/graphs/commit-activity" + description: "Presents the commit activity of the past year." + - type: project_website + url: "https://github.com/nlohmann/json/graphs/contributors" + description: "Presents commits over time and per contributor." + - type: project_website + url: "https://github.com/nlohmann/json/forks?include=active&page=1&period=&sort_by=last_updated" + description: "Lists all forks of the nlohmann/json library by last updated." + - type: project_website + url: "https://github.com/nlohmann/json/pulse" + description: "Presents the activity on the nlohmann/json library over the past week." + - type: project_website + url: "https://github.com/orgs/score-json/discussions/27#discussion-8594385" + description: "Comparison between JSON libraries demonstrating the popularity of the nlohmann/json library." + - type: project_website + url: "https://json.nlohmann.me/home/customers/" + description: "Presents a subset of all customers who are using the nlohmann/json library." + - type: project_website + url: "https://github.com/nlohmann/json/releases/tag/v3.12.0" + description: "Release notes for v3.12.0, listing bugs, CVEs and warnings which were either fixed or mitigated since last release." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/issues" - - "https://github.com/nlohmann/json/graphs/commit-activity" - - "https://github.com/nlohmann/json/graphs/contributors" - - "https://github.com/nlohmann/json/forks?include=active&page=1&period=&sort_by=last_updated" - - "https://github.com/nlohmann/json/pulse" - - "https://github.com/orgs/score-json/discussions/27#discussion-8594385" - - "https://json.nlohmann.me/home/customers/" - - "https://github.com/nlohmann/json/releases/tag/v3.12.0" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/issues" + - "https://github.com/nlohmann/json/graphs/commit-activity" + - "https://github.com/nlohmann/json/graphs/contributors" + - "https://github.com/nlohmann/json/forks?include=active&page=1&period=&sort_by=last_updated" + - "https://github.com/nlohmann/json/pulse" + - "https://github.com/orgs/score-json/discussions/27#discussion-8594385" + - "https://json.nlohmann.me/home/customers/" + - "https://github.com/nlohmann/json/releases/tag/v3.12.0" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/statements/JLS-06.md b/TSF/trustable/statements/JLS-06.md index 9bbdd49205..28a9975b6e 100644 --- a/TSF/trustable/statements/JLS-06.md +++ b/TSF/trustable/statements/JLS-06.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for nlohmann/json, where score for 'Code-Review' reflects this statement." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard report for the nlohmann/json library, where the score for 'Code-Review' reflects this statement." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" score: Erikhu1: 0.3 aschemmel-tech: 0.4 diff --git a/TSF/trustable/statements/JLS-07.md b/TSF/trustable/statements/JLS-07.md index 5bb8c34044..3f9bf00d78 100644 --- a/TSF/trustable/statements/JLS-07.md +++ b/TSF/trustable/statements/JLS-07.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/actions?query=event%3Apush+branch%3Adevelop" - description: "List of all pushes to the develop branch in nlohmann/json, showing that all commits are done by nlohmann and indicating that direct commits are not possible." + - type: project_website + url: "https://github.com/nlohmann/json/actions?query=event%3Apush+branch%3Adevelop" + description: "List of all pushes to the develop branch of the nlohmann/json library, showing that all commits are done by @nlohmann and indicating that direct commits are not possible." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/actions?query=event%3Apush+branch%3Adevelop" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/actions?query=event%3Apush+branch%3Adevelop" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/statements/JLS-08.md b/TSF/trustable/statements/JLS-08.md index 322721db04..04187bda2b 100644 --- a/TSF/trustable/statements/JLS-08.md +++ b/TSF/trustable/statements/JLS-08.md @@ -10,12 +10,12 @@ references: description: "Trustable Compliance Report showing scores for statements." - type: web_content url: "https://codethinklabs.gitlab.io/trustable/trustable/methodology.html#documenting-assumptions" - description: "Definition of Assumptions as part of the methodology" + description: "Definition of Assumptions as part of the TSF methodology docomentation." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: + target_seconds: 2 + urls: - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_report_for_Software.html" --- diff --git a/TSF/trustable/statements/JLS-09.md b/TSF/trustable/statements/JLS-09.md index 154ecc48af..9c872e50d0 100644 --- a/TSF/trustable/statements/JLS-09.md +++ b/TSF/trustable/statements/JLS-09.md @@ -4,7 +4,7 @@ normative: true references: - type: web_content url: "https://eclipse-score.github.io/inc_nlohmann_json/main/concept.html" - description: "Description of the algorithm on how scores are accumulated." + description: "Description of the algorithm for how scores are accumulated." --- Scores within the TSF documentation are reasonably, systematically and repeatably accumulated. diff --git a/TSF/trustable/statements/JLS-10.md b/TSF/trustable/statements/JLS-10.md index 402bbedcd3..21972a2440 100644 --- a/TSF/trustable/statements/JLS-10.md +++ b/TSF/trustable/statements/JLS-10.md @@ -2,14 +2,14 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/releases" - description: "List of nlohmann/json releases consisting of source code, build instructions, test code and test result summaries." + - type: project_website + url: "https://github.com/nlohmann/json/releases" + description: "List of nlohmann/json releases consisting of source code, build instructions, test code and test result summaries." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: + target_seconds: 2 + urls: - "https://github.com/nlohmann/json/releases" --- diff --git a/TSF/trustable/statements/JLS-11.md b/TSF/trustable/statements/JLS-11.md index 7211cd83a3..f16fd6845e 100644 --- a/TSF/trustable/statements/JLS-11.md +++ b/TSF/trustable/statements/JLS-11.md @@ -4,13 +4,13 @@ normative: true evidence: type: check_issues configuration: - release_date: "2025-04-11T08:43:39Z" - list_of_known_misbehaviours: "./TSF/docs/nlohmann_misbehaviours_comments.md" + release_date: "2025-04-11T08:43:39Z" + list_of_known_misbehaviours: "./TSF/docs/nlohmann_misbehaviours_comments.md" score: Erikhu1: 1.0 aschemmel-tech: 0.8 --- -Outstanding bugs or misbehaviours are analyzed within eclipse-score/inc_nlohmann_json to determine whether they are relevant for S-CORE's use cases of the nlohmann/json library. +Outstanding bugs or misbehaviours are analysed within eclipse-score/inc_nlohmann_json to determine whether they are relevant for S-CORE's use cases of the nlohmann/json library. -aschemmel-tech: most but not all issues are analyzed for impact on S-CORE. +aschemmel-tech: most but not all issues are analysed for impact on S-CORE. diff --git a/TSF/trustable/statements/JLS-12.md b/TSF/trustable/statements/JLS-12.md index 134b2ea6ee..2288fabf6e 100644 --- a/TSF/trustable/statements/JLS-12.md +++ b/TSF/trustable/statements/JLS-12.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/community" - description: "List of defined community standards in nlohmann/json" + - type: project_website + url: "https://github.com/nlohmann/json/community" + description: "List of defined community standards for the nlohmann/json repository." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/community" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/community" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/statements/JLS-13.md b/TSF/trustable/statements/JLS-13.md index bd83e9c389..81cdd54a9c 100644 --- a/TSF/trustable/statements/JLS-13.md +++ b/TSF/trustable/statements/JLS-13.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/community/contribution_guidelines/#update-the-documentation" - description: "Contribution guidelines describing how to update and locally build the mkdocs-based documentation" - - type: project_website - url: "https://github.com/nlohmann/json/releases" - description: "Release notes summarising behavioural changes and documentation updates for each version" - - type: web_content - url: "https://json.nlohmann.me" - description: "Published documentation site for the nlohmann/json library" + - type: project_website + url: "https://json.nlohmann.me/community/contribution_guidelines/#update-the-documentation" + description: "Contribution guidelines describing how to update and locally build the MkDocs-based documentation." + - type: project_website + url: "https://github.com/nlohmann/json/releases" + description: "Release notes summarising behavioural changes and documentation updates for each version." + - type: web_content + url: "https://json.nlohmann.me" + description: "Published documentation site for the nlohmann/json library." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/community/contribution_guidelines/#update-the-documentation" - - "https://github.com/nlohmann/json/releases" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://json.nlohmann.me/community/contribution_guidelines/#update-the-documentation" + - "https://github.com/nlohmann/json/releases" --- For changes that affect the behaviour or public API of the nlohmann/json library, contributors manually update the library documentation and locally rebuild it for verification. diff --git a/TSF/trustable/statements/JLS-14.md b/TSF/trustable/statements/JLS-14.md index def7be79c9..cb02c05084 100644 --- a/TSF/trustable/statements/JLS-14.md +++ b/TSF/trustable/statements/JLS-14.md @@ -4,15 +4,15 @@ normative: true references: - type: website url: "https://github.com/nlohmann/json/tree/v3.12.0" - description: "release site of nlohmann/json containing the sha values" + description: "Release site of the nlohmann/json library containing the SHA values." - type: verbose_file path: ".github/workflows/check_amalgamation.yml" description: "Lines 68-77 checks that the amalgamate.py script always produces the same output with the same inputs, by comparing the single-include header file in the PR with a re-generated one inside the workflow run." evidence: type: sha_checker configuration: - binary: "./single_include/nlohmann/json.hpp" - sha: "aaf127c04cb31c406e5b04a63f1ae89369fccde6d8fa7cdda1ed4f32dfc5de63" + binary: "./single_include/nlohmann/json.hpp" + sha: "aaf127c04cb31c406e5b04a63f1ae89369fccde6d8fa7cdda1ed4f32dfc5de63" --- The SHA value of the nlohmann/json library in use within eclipse-score/inc_nlohmann_json coincides with the SHA value provided by Niels Lohmann for that version. diff --git a/TSF/trustable/statements/JLS-16.md b/TSF/trustable/statements/JLS-16.md index f0a9bae16b..db4aab0cd8 100644 --- a/TSF/trustable/statements/JLS-16.md +++ b/TSF/trustable/statements/JLS-16.md @@ -4,16 +4,16 @@ normative: true references: - type: verbose_file path: "./TSF/docs/list_of_test_environments.md" - comment: "The list of all test-cases together with their execution environments" + comment: "The list of all test cases together with their execution environments." - type: website url: "https://github.com/eclipse-score/inc_nlohmann_json/actions" - description: "Github actions page showing that eclipse-score/inc_nlohmann_json is using Github host environment." + description: "GitHub Actions page showing that eclipse-score/inc_nlohmann_json is using a GitHub-hosted environment." evidence: type: check_list_of_tests - configuration: - sources: - - "./tests/src" - - "./TSF/tests" + configuration: + sources: + - "./tests/src" + - "./TSF/tests" --- A list of tests, which is extracted from the test execution, is provided, along with a list of test environments. diff --git a/TSF/trustable/statements/JLS-17.md b/TSF/trustable/statements/JLS-17.md index 5c88329572..6f81dbb92b 100644 --- a/TSF/trustable/statements/JLS-17.md +++ b/TSF/trustable/statements/JLS-17.md @@ -2,9 +2,9 @@ level: 1.1 normative: true references: - - type: verbose_file - path: "./TSF/docs/ci_failure_rate_analysis.md" - description: "Summary of the CI test failure rates analysis for the upstream nlohmann/json and the eclipse-score/inc_nlohmann_json repositories, including scope, selected time windows, methodology, and interpretation of the results." + - type: verbose_file + path: "./TSF/docs/ci_failure_rate_analysis.md" + description: "Summary of the CI test failure rates analysis for the upstream nlohmann/json and the eclipse-score/inc_nlohmann_json repositories, including scope, selected time windows, methodology, and interpretation of the results." --- Failure rates of CI tests are analysed for both the upstream nlohmann/json and the eclipse-score/inc_nlohmann_json repositories, and any high failure rates are reasonably justified. diff --git a/TSF/trustable/statements/JLS-18.md b/TSF/trustable/statements/JLS-18.md index dfe3b1d364..4b6c40fe79 100644 --- a/TSF/trustable/statements/JLS-18.md +++ b/TSF/trustable/statements/JLS-18.md @@ -4,15 +4,15 @@ normative: true references: - type: file path: ./TSF/scripts/capture_test_data_memory_sensitive.py - description: "This script extracts the test results from the junit-files generated by ctest and writes these into a data-base." - - type: file - path: "./.github/workflows/ubuntu.yml" - description: "Ubuntu CI workflow that runs the tests, generates JUnit reports, and invokes the test-data capture script." + description: "This script extracts the test-results from the JUnit-files generated by CTest and writes these into a database." + - type: verbose_file + path: ./.github/workflows/ubuntu.yml + description: "This workflow runs the tests and generates test reports as JUnit-files, which are given to the script capture_test_data.py." evidence: type: file_exists configuration: - files: - - "./artifacts/MemoryEfficientTestResults.db" + files: + - "./artifacts/MemoryEfficientTestResults.db" score: Jonas-Kirchhoff: 0.75 --- diff --git a/TSF/trustable/statements/JLS-19.md b/TSF/trustable/statements/JLS-19.md index 35e35b6974..8d9603462d 100644 --- a/TSF/trustable/statements/JLS-19.md +++ b/TSF/trustable/statements/JLS-19.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: web_content - url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/CMakeLists.txt" - description: "CMake build manifest file" - - type: web_content - url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/BUILD.bazel" - description: "Bazel build manifest file" - - type: web_content - url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/meson.build" - description: "Meson build manifest file" - - type: web_content - url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/Package.swift" - description: "Swift Package Manager manifest file" + - type: web_content + url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/CMakeLists.txt" + description: "CMake build manifest file of the nlohmann/json library." + - type: web_content + url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/BUILD.bazel" + description: "Bazel build manifest file of the nlohmann/json library." + - type: web_content + url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/meson.build" + description: "Meson build manifest file of the nlohmann/json library." + - type: web_content + url: "https://raw.githubusercontent.com/nlohmann/json/refs/heads/develop/Package.swift" + description: "Swift Package Manager manifest file of the nlohmann/json library." score: Erikhu1: 1.0 --- diff --git a/TSF/trustable/statements/JLS-20.md b/TSF/trustable/statements/JLS-20.md index 4d8fd1d65a..852195c6d5 100644 --- a/TSF/trustable/statements/JLS-20.md +++ b/TSF/trustable/statements/JLS-20.md @@ -1,24 +1,24 @@ --- level: 1.1 normative: true -references: +references: - type: verbose_file path: ./.github/workflows/parent-workflow.yml - description: "github workflow running on push to main and triggering the workflow publish_documentation" + description: "GitHub workflow running on push to main and triggering the workflow publish_documentation." - type: verbose_file path: ./.github/workflows/publish_documentation.yml - description: "github workflow executing calculation and storage of trustable scores" + description: "GitHub workflow executing calculation and storage of trustable scores." - type: website - url: "https://github.com/eclipse-score/inc_nlohmann_json/blob/save_historical_data/TSF/data_storage" - description: "the folder that contains databases containing the trustable scores" + url: "https://github.com/eclipse-score/inc_nlohmann_json/blob/save_historical_data/TSF/TrustableScoring.db" + description: "The database containing the trustable scores." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/eclipse-score/inc_nlohmann_json/blob/save_historical_data/TSF/data_storage" + target_seconds: 2 + urls: + - "https://github.com/eclipse-score/inc_nlohmann_json/blob/save_historical_data/TSF/data_storage" score: Jonas-Kirchhoff: 1.0 --- -A github workflow of eclipse-score/inc_nlohmann_json saves the history of scores in the trustable graph to derive trends. \ No newline at end of file +A GitHub workflow of eclipse-score/inc_nlohmann_json saves the history of scores in the trustable graph to derive trends. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-22.md b/TSF/trustable/statements/JLS-22.md index 9e1cd49d7b..ad2cce18de 100644 --- a/TSF/trustable/statements/JLS-22.md +++ b/TSF/trustable/statements/JLS-22.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: verbose_file - path: "./.github/workflows/parent-workflow.yml" - description: "Parent GitHub workflow that is scheduled to run daily and triggers the ubuntu workflow." - - type: verbose_file - path: "./.github/workflows/ubuntu.yml" - description: "Ubuntu CI workflow that executes the nlohmann/json unit and integration tests in a controlled CI environment." - - type: file - path: "./TSF/scripts/capture_test_data_memory_sensitive.py" - description: "Captures results from each workflow run and appends them to the persistent test results database." + - type: verbose_file + path: "./.github/workflows/parent-workflow.yml" + description: "Parent GitHub workflow that is scheduled to run daily and triggers the Ubuntu workflow." + - type: verbose_file + path: "./.github/workflows/ubuntu.yml" + description: "Ubuntu CI workflow that executes the nlohmann/json unit and integration tests in a controlled CI environment." + - type: file + path: "./TSF/scripts/capture_test_data_memory_sensitive.py" + description: "Captures results from each workflow run and appends them to the persistent test results database." score: Jonas-Kirchhoff: 1.0 --- diff --git a/TSF/trustable/statements/JLS-23.md b/TSF/trustable/statements/JLS-23.md index 06388da9b0..27ec486dd1 100644 --- a/TSF/trustable/statements/JLS-23.md +++ b/TSF/trustable/statements/JLS-23.md @@ -2,21 +2,21 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json" - description: "Start-page of the original nlohmann/json project" - - type: project_website - url: "https://github.com/eclipse-score/inc_nlohmann_json" - description: "Start-page of the mirror of nlohmann/json within Eclipse S-CORE" + - type: project_website + url: "https://github.com/nlohmann/json" + description: "Start page of the original nlohmann/json project." + - type: project_website + url: "https://github.com/eclipse-score/inc_nlohmann_json" + description: "Start page of the mirror of nlohmann/json within Eclipse S-CORE." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json" - - "https://github.com/eclipse-score/inc_nlohmann_json" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json" + - "https://github.com/eclipse-score/inc_nlohmann_json" score: mishu-dev: 1.0 --- -The Eclipse S-CORE organization mirrors the nlohmann/json project in a github fork. \ No newline at end of file +The Eclipse S-CORE organisation mirrors the nlohmann/json project in a GitHub fork. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-24.md b/TSF/trustable/statements/JLS-24.md index ee2b922e8d..f0fb008760 100644 --- a/TSF/trustable/statements/JLS-24.md +++ b/TSF/trustable/statements/JLS-24.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/features/parsing/parse_exceptions/" - description: "Documents that invalid JSON input triggers a parse_error exception (with examples and recommended try/catch)." - - type: project_website - url: "https://json.nlohmann.me/home/exceptions/" - description: "Overview of exception types including parse errors thrown during deserialization." + - type: project_website + url: "https://json.nlohmann.me/features/parsing/parse_exceptions/" + description: "Documents that invalid JSON input triggers a parse_error exception (with examples and recommended try/catch)." + - type: project_website + url: "https://json.nlohmann.me/home/exceptions/" + description: "Overview of exception types including parse errors thrown during deserialization." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/features/parsing/parse_exceptions/" - - "https://json.nlohmann.me/home/exceptions/" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://json.nlohmann.me/features/parsing/parse_exceptions/" + - "https://json.nlohmann.me/home/exceptions/" --- The nlohmann/json library recognizes malformed JSON and returns an exception or a discarded value. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-25.md b/TSF/trustable/statements/JLS-25.md index f6ac5a465f..c0079a7f85 100644 --- a/TSF/trustable/statements/JLS-25.md +++ b/TSF/trustable/statements/JLS-25.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for nlohmann/json, where scores for 'Security-Policy' and 'Code-Review' reflect this statement." - - type: project_website - url: "https://github.com/nlohmann/json?tab=contributing-ov-file#readme" - description: "Contribution Guidelines for nlohmann/json, where it is indirectly indicated that all changes are reviewed." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard report for the nlohmann/json library, where the scores for 'Security-Policy' and 'Code-Review' reflect this statement." + - type: project_website + url: "https://github.com/nlohmann/json?tab=contributing-ov-file#readme" + description: "Contribution Guidelines for the nlohmann/json library, which indicate that all changes are reviewed." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json?tab=contributing-ov-file#readme" - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json?tab=contributing-ov-file#readme" + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" score: Erikhu1: 0.8 --- diff --git a/TSF/trustable/statements/JLS-26.md b/TSF/trustable/statements/JLS-26.md index 30c00a253f..2bb468a4ef 100644 --- a/TSF/trustable/statements/JLS-26.md +++ b/TSF/trustable/statements/JLS-26.md @@ -12,12 +12,12 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/actions?query=branch%3Amaster" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/actions?query=branch%3Amaster" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 --- -Any failed CI pipeline executions in the master branch of the nlohmann/json repository are analyzed and fixed. \ No newline at end of file +Any failed CI pipeline executions in the master branch of the nlohmann/json repository are analysed and fixed. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-27.md b/TSF/trustable/statements/JLS-27.md index 286a97e95b..76a41e392b 100644 --- a/TSF/trustable/statements/JLS-27.md +++ b/TSF/trustable/statements/JLS-27.md @@ -4,12 +4,12 @@ normative: true evidence: type: coveralls_reporter configuration: - owner: "eclipse-score" - repo: "inc_nlohmann_json" - branch: "main" - line_coverage: 99.186 - branch_coverage: 93.865 - digits: 3 + owner: "eclipse-score" + repo: "inc_nlohmann_json" + branch: "main" + line_coverage: 99.186 + branch_coverage: 93.865 + digits: 3 --- The test coverage for this version of nlohmann/json is monitored using Coveralls and is not decreasing over time, unless reasonably justified. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-28.md b/TSF/trustable/statements/JLS-28.md index ed2a81bb9f..f4d8d2648f 100644 --- a/TSF/trustable/statements/JLS-28.md +++ b/TSF/trustable/statements/JLS-28.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/discussions/4967" - description: "Discussion in nlohmann/json showing that no triage processes for bugs are currently in place" + - type: project_website + url: "https://github.com/nlohmann/json/discussions/4967" + description: "Discussion in the nlohmann/json repository showing that no triage processes for bugs are currently in place." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/discussions/4967" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/discussions/4967" score: Erikhu1: 0.0 aschemmel-tech: 0.0 diff --git a/TSF/trustable/statements/JLS-29.md b/TSF/trustable/statements/JLS-29.md index 1398f00e65..804f7263eb 100644 --- a/TSF/trustable/statements/JLS-29.md +++ b/TSF/trustable/statements/JLS-29.md @@ -2,24 +2,24 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/releases/tag/v3.12.0" - description: "release notes for v3.12.0, listing bugs, CVEs and warnings which were either fixed or mitigated since last release" - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for nlohmann/json, where scores for 'Vulnerabilities', 'Pinned-Dependencies' and 'Dangerous-Workflow' support this statement." + - type: project_website + url: "https://github.com/nlohmann/json/releases/tag/v3.12.0" + description: "Release notes for v3.12.0, listing bugs, CVEs and warnings which were either fixed or mitigated since last release." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard report for the nlohmann/json library, where the scores for 'Vulnerabilities', 'Pinned-Dependencies' and 'Dangerous-Workflow' support this statement." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/releases/tag/v3.12.0" - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/releases/tag/v3.12.0" + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" score: Erikhu1: 0.7 aschemmel-tech: 0.8 --- -Known bugs, misbehaviours and CVEs are analyzed and either fixed or mitigated in the nlohmann/json repository. +Known bugs, misbehaviours and CVEs are analysed and either fixed or mitigated in the nlohmann/json repository. -aschemmel-tech: evidences support bugs and CVE fixing, no mitigation actions are offered. \ No newline at end of file +aschemmel-tech: evidence supports bugs and CVE fixing, no mitigation actions are offered. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-30.md b/TSF/trustable/statements/JLS-30.md index 8434966116..638ee2c737 100644 --- a/TSF/trustable/statements/JLS-30.md +++ b/TSF/trustable/statements/JLS-30.md @@ -2,24 +2,24 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for nlohmann/json, where score for 'Vulnerabilities' shows that there are no outstanding CVEs." - - type: project_website - url: "https://github.com/nlohmann/json/discussions/4975" - description: "Screenshot of dismissed code scanning alerts, which can also be dismissed in S-CORE." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard report for the nlohmann/json library, where the score for 'Vulnerabilities' shows that there are no outstanding CVEs." + - type: project_website + url: "https://github.com/nlohmann/json/discussions/4975" + description: "Screenshot of dismissed code-scanning alerts, which can also be dismissed in S-CORE." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/discussions/4975" - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/discussions/4975" + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" score: Erikhu1: 0.5 aschemmel-tech: 1.0 --- -Outstanding CVEs are analyzed within eclipse-score/inc_nlohmann_json to determine whether they can be dismissed, and/or are relevant for S-CORE's use cases of the nlohmann/json library. +Outstanding CVEs are analysed within eclipse-score/inc_nlohmann_json to determine whether they can be dismissed, and/or are relevant for S-CORE's use cases of the nlohmann/json library. aschemmel-tech: In my understanding bot evidences support the statement completely. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-31.md b/TSF/trustable/statements/JLS-31.md index 4d2c690730..5e36025d5a 100644 --- a/TSF/trustable/statements/JLS-31.md +++ b/TSF/trustable/statements/JLS-31.md @@ -2,27 +2,27 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/community/quality_assurance/" - description: "Quality-assurance overview that lists the static analysis tools (e.g., clang-tidy / Clang Static Analyzer) and dynamic analysis tools (e.g., Valgrind / Clang Sanitizers) and states that violations fail the build." - - type: project_website - url: "https://github.com/nlohmann/json/actions" - description: "Public GitHub Actions run history showing the outcomes of CI jobs over time including the logs for the static code analysis tools." - - type: website - url: "https://app.codacy.com/gh/nlohmann/json/dashboard" - description: "Codacy dashboard for nlohmann/json" - - type: website - url: "https://coveralls.io/github/nlohmann/json" - description: "Coveralls dashboard for nlohmann/json, including coverage history/statistics (trend view)." + - type: project_website + url: "https://json.nlohmann.me/community/quality_assurance/" + description: "Quality-assurance overview that lists the static analysis tools (e.g., clang-tidy / Clang Static Analyzer) and dynamic analysis tools (e.g., Valgrind / Clang Sanitizers) and states that violations fail the build." + - type: project_website + url: "https://github.com/nlohmann/json/actions" + description: "Public GitHub Actions run history showing the outcomes of CI jobs over time including the logs for the static code analysis tools." + - type: website + url: "https://app.codacy.com/gh/nlohmann/json/dashboard" + description: "Codacy dashboard for nlohmann/json" + - type: website + url: "https://coveralls.io/github/nlohmann/json" + description: "Coveralls dashboard for nlohmann/json, including coverage history/statistics (trend view)." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/community/quality_assurance/" - - "https://github.com/nlohmann/json/actions" - - "https://app.codacy.com/gh/nlohmann/json/dashboard" - - "https://coveralls.io/github/nlohmann/json" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://json.nlohmann.me/community/quality_assurance/" + - "https://github.com/nlohmann/json/actions" + - "https://app.codacy.com/gh/nlohmann/json/dashboard" + - "https://coveralls.io/github/nlohmann/json" score: Erikhu1: 0.9 --- diff --git a/TSF/trustable/statements/JLS-32.md b/TSF/trustable/statements/JLS-32.md index 2e0f6be033..9cbf80ce13 100644 --- a/TSF/trustable/statements/JLS-32.md +++ b/TSF/trustable/statements/JLS-32.md @@ -2,9 +2,9 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/CODEOWNERS" - description: "CODEOWNERS file specifying that changes to any file requests @nlohmann for code review in case of a pull request" + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/CODEOWNERS" + description: "CODEOWNERS file specifying that changes to any file request @nlohmann for code review in case of a pull request." score: Erikhu1: 1.0 aschemmel-tech: 1.0 diff --git a/TSF/trustable/statements/JLS-33.md b/TSF/trustable/statements/JLS-33.md index e2aedd77ba..2bf825ffe8 100644 --- a/TSF/trustable/statements/JLS-33.md +++ b/TSF/trustable/statements/JLS-33.md @@ -2,9 +2,9 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/security/advisories/new" - description: "the vulnerability reporting template used in nlohmann/json, which includes a severity section and CVSS scoring" + - type: project_website + url: "https://github.com/nlohmann/json/security/advisories/new" + description: "The vulnerability reporting template used in the nlohmann/json library, which includes a severity section and CVSS scoring." score: Erikhu1: 1.0 aschemmel-tech: 0.5 diff --git a/TSF/trustable/statements/JLS-34.md b/TSF/trustable/statements/JLS-34.md index 5d59b42655..dc6c5effe3 100644 --- a/TSF/trustable/statements/JLS-34.md +++ b/TSF/trustable/statements/JLS-34.md @@ -4,7 +4,7 @@ normative: true references: - type: include_list path: single_include/nlohmann/json.hpp - description: "file containing all include occurrences of the score-project." + description: "File containing all include occurrences of the SCORE-project." score: Erikhu1: 1.0 aschemmel-tech: 0.8 diff --git a/TSF/trustable/statements/JLS-35.md b/TSF/trustable/statements/JLS-35.md index 8b3b348580..2c513e15e9 100644 --- a/TSF/trustable/statements/JLS-35.md +++ b/TSF/trustable/statements/JLS-35.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for nlohmann/json, where score for 'CI-Tests' supports this statement" - - type: project_website - url: "https://github.com/nlohmann/json/pulls?q=is%3Apr+is%3Aclosed+review%3Aapproved" - description: "All approved pull requests in the nlohmann/json repository, with the results of the CI pipeline executions." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard Report for the nlohmann/json library, where the score for 'CI-Tests' supports this statement." + - type: project_website + url: "https://github.com/nlohmann/json/pulls?q=is%3Apr+is%3Aclosed+review%3Aapproved" + description: "All approved pull requests in the nlohmann/json repository, along with the results of the CI pipeline executions." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/pulls?q=is%3Apr+is%3Aclosed+review%3Aapproved" - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/pulls?q=is%3Apr+is%3Aclosed+review%3Aapproved" + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" score: Erikhu1: 0.9 aschemmel-tech: 1.0 diff --git a/TSF/trustable/statements/JLS-36.md b/TSF/trustable/statements/JLS-36.md index 82ff77e28c..13e6f84051 100644 --- a/TSF/trustable/statements/JLS-36.md +++ b/TSF/trustable/statements/JLS-36.md @@ -4,7 +4,7 @@ normative: true references: - type: verbose_file path: "./TSF/README.md" - description: "release management and update process description" + description: "Release management and update process description." --- Updates of the eclipse-score/inc_nlohmann_json repository are carried out in accordance with the defined and documented update process in TSF/README.md. diff --git a/TSF/trustable/statements/JLS-37.md b/TSF/trustable/statements/JLS-37.md index 759c14ad92..0ee6ab9d17 100644 --- a/TSF/trustable/statements/JLS-37.md +++ b/TSF/trustable/statements/JLS-37.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_report_for_Software.html#compliance-for-ta" - description: "Trustable Compliance Report showing scores for different TA items." - - type: project_website - url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_graph.html" - description: "presentation of the full trustable graph in which high-level statements are broken down" + - type: project_website + url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_report_for_Software.html#compliance-for-ta" + description: "Trustable Compliance Report showing scores for different TA items." + - type: project_website + url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_graph.html" + description: "Presentation of the full trustable graph in which high-level statements are broken down." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_report_for_Software.html#compliance-for-ta" - - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_graph.html" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_report_for_Software.html#compliance-for-ta" + - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/trustable_graph.html" --- High-level statements are decomposed into smaller, recursive statements. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-38.md b/TSF/trustable/statements/JLS-38.md index d4a8b1046a..34d69c9352 100644 --- a/TSF/trustable/statements/JLS-38.md +++ b/TSF/trustable/statements/JLS-38.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: website - url: "https://json.nlohmann.me/integration/cmake/" - description: "cmake build management documentation for nlohmann/json" - - type: website - url: "https://json.nlohmann.me/integration/package_managers/" - description: "package manager documentation for nlohmann/json" + - type: website + url: "https://json.nlohmann.me/integration/cmake/" + description: "cmake build management documentation for nlohmann/json" + - type: website + url: "https://json.nlohmann.me/integration/package_managers/" + description: "package manager documentation for nlohmann/json" evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/integration/cmake/" - - "https://json.nlohmann.me/integration/package_managers/" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://json.nlohmann.me/integration/cmake/" + - "https://json.nlohmann.me/integration/package_managers/" --- Every release of the nlohmann/json library shall provide configuration management for build instructions and infrastructure. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-40.md b/TSF/trustable/statements/JLS-40.md index 212469f1c7..46fa59fd8a 100644 --- a/TSF/trustable/statements/JLS-40.md +++ b/TSF/trustable/statements/JLS-40.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/security/policy" - description: "Security policy describing how to report vulnerabilities for the nlohmann/json library" - - type: project_website - url: "https://github.com/nlohmann/json/security/advisories/new" - description: "Well-defined process for issuing a vulnerability or bug report for the nlohmann/json library" + - type: project_website + url: "https://github.com/nlohmann/json/security/policy" + description: "Security policy describing how to report vulnerabilities for the nlohmann/json library." + - type: project_website + url: "https://github.com/nlohmann/json/security/advisories/new" + description: "Well-defined process for issuing a vulnerability or bug report for the nlohmann/json library." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/security/advisories/new" - - "https://github.com/nlohmann/json/security/policy" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/security/advisories/new" + - "https://github.com/nlohmann/json/security/policy" --- The manual process for reporting vulnerabilities in the nlohmann/json library is well defined and documented in the project's security policy and vulnerability reporting template. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-41.md b/TSF/trustable/statements/JLS-41.md index 5d7c5f58c6..1bb810e89b 100644 --- a/TSF/trustable/statements/JLS-41.md +++ b/TSF/trustable/statements/JLS-41.md @@ -2,9 +2,9 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/community/contribution_guidelines/#write-tests" - description: "Contribution guidelines describing the test policy and requirement to maintain 100% coverage" + - type: project_website + url: "https://json.nlohmann.me/community/contribution_guidelines/#write-tests" + description: "Contribution guidelines describing the test policy and requirements to maintain 100% coverage." --- The manual process for extending the nlohmann/json library's test suite is well-defined and documented, such that code coverage remains at (or close to) 100% when fixes or other non-trivial changes are proposed. diff --git a/TSF/trustable/statements/JLS-42.md b/TSF/trustable/statements/JLS-42.md index 2422524622..7a64a7173c 100644 --- a/TSF/trustable/statements/JLS-42.md +++ b/TSF/trustable/statements/JLS-42.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#describe-your-changes" - description: "Contribution guidelines requiring manual pull requests to describe the rationale behind non-trivial changes" - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#reference-an-existing-issue" - description: "Contribution guidelines requiring manual pull requests to link to an existing issue" - - type: project_website - url: "https://github.com/nlohmann/json/pulls" - description: "GitHub pull requests showing review discussions, approvals, and merge/close status" + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#describe-your-changes" + description: "Contribution guidelines requiring manual pull requests to describe the rationale behind non-trivial changes." + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#reference-an-existing-issue" + description: "Contribution guidelines requiring manual pull requests to link to an existing issue." + - type: project_website + url: "https://github.com/nlohmann/json/pulls" + description: "GitHub pull requests showing review discussions, approvals, and merge/close statuses." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md" - - "https://github.com/nlohmann/json/pulls" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md" + - "https://github.com/nlohmann/json/pulls" --- All manual pull requests to the nlohmann/json repository that introduce non-trivial changes are expected to explain the rationale for the proposed change and to link to an existing issue, in accordance with the project's contribution guidelines. diff --git a/TSF/trustable/statements/JLS-43.md b/TSF/trustable/statements/JLS-43.md index 326f5f51aa..b54cceab3c 100644 --- a/TSF/trustable/statements/JLS-43.md +++ b/TSF/trustable/statements/JLS-43.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/discussions/categories/ideas" - description: "Feature request discussions showing that feature requests are actively investigated and answered" - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/CODEOWNERS" - description: "Definition of responsible owners and reviewers for the nlohmann/json repository" + - type: project_website + url: "https://github.com/nlohmann/json/discussions/categories/ideas" + description: "Feature request discussions showing that feature requests are actively investigated and answered." + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/CODEOWNERS" + description: "Definition of responsible owners and reviewers for the nlohmann/json repository." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/discussions/categories/ideas" - - "https://github.com/nlohmann/json/blob/develop/.github/CODEOWNERS" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/discussions/categories/ideas" + - "https://github.com/nlohmann/json/blob/develop/.github/CODEOWNERS" --- Feature requests for the nlohmann/json repository are raised in the project's GitHub discussions and are actively reviewed and answered by the maintainer. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-44.md b/TSF/trustable/statements/JLS-44.md index c93d23dd3a..f66e4fcab8 100644 --- a/TSF/trustable/statements/JLS-44.md +++ b/TSF/trustable/statements/JLS-44.md @@ -1,20 +1,20 @@ --- level: 1.1 normative: true -references: - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/ISSUE_TEMPLATE/bug.yaml" - description: "Bug report issue template for the nlohmann/json library" - - type: project_website - url: "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#reporting-issues" - description: "Contribution guidelines describing how to report bugs and issues for the nlohmann/json library" +references: + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/ISSUE_TEMPLATE/bug.yaml" + description: "Bug report issue template for the nlohmann/json library." + - type: project_website + url: "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#reporting-issues" + description: "Contribution guidelines describing how to report bugs and issues for the nlohmann/json library." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/develop/.github/ISSUE_TEMPLATE/bug.yaml" - - "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#reporting-issues" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/develop/.github/ISSUE_TEMPLATE/bug.yaml" + - "https://github.com/nlohmann/json/blob/develop/.github/CONTRIBUTING.md#reporting-issues" --- The manual process for reporting bugs in the nlohmann/json library is well defined and documented in the project's contribution guidelines and bug report template. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-45.md b/TSF/trustable/statements/JLS-45.md index e1a8ea98d2..e2e473a491 100644 --- a/TSF/trustable/statements/JLS-45.md +++ b/TSF/trustable/statements/JLS-45.md @@ -1,7 +1,7 @@ --- level: 1.1 normative: true -references: +references: - type: verbose_file path: "./TSF/scripts/README.md" description: "Explanation of how test-result data is stored, how long it is retained, which size limits apply, and which maintenance actions are required for the persistent storage." diff --git a/TSF/trustable/statements/JLS-47.md b/TSF/trustable/statements/JLS-47.md index 0cc06e7b2a..2e4487ebf6 100644 --- a/TSF/trustable/statements/JLS-47.md +++ b/TSF/trustable/statements/JLS-47.md @@ -8,9 +8,9 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/develop/single_include/nlohmann/json.hpp" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/develop/single_include/nlohmann/json.hpp" score: Erikhu1: 1.0 --- diff --git a/TSF/trustable/statements/JLS-48.md b/TSF/trustable/statements/JLS-48.md index d5f37d4504..6a94777f0d 100644 --- a/TSF/trustable/statements/JLS-48.md +++ b/TSF/trustable/statements/JLS-48.md @@ -8,9 +8,9 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md#used-third-party-tools" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md#used-third-party-tools" score: Erikhu1: 1.0 --- diff --git a/TSF/trustable/statements/JLS-49.md b/TSF/trustable/statements/JLS-49.md index 27a456bb27..1aca6478e8 100644 --- a/TSF/trustable/statements/JLS-49.md +++ b/TSF/trustable/statements/JLS-49.md @@ -17,11 +17,11 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md?plain=1#L1842" - - "https://github.com/nlohmann/json_test_data" - - "https://github.com/eclipse-score/inc_nlohmann_json/tree/json_test_data_version_3_1_0_mirror" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md?plain=1#L1842" + - "https://github.com/nlohmann/json_test_data" + - "https://github.com/eclipse-score/inc_nlohmann_json/tree/json_test_data_version_3_1_0_mirror" score: Erikhu1: 1.0 --- diff --git a/TSF/trustable/statements/JLS-50.md b/TSF/trustable/statements/JLS-50.md index c4f657b2d4..ee117f3e33 100644 --- a/TSF/trustable/statements/JLS-50.md +++ b/TSF/trustable/statements/JLS-50.md @@ -11,9 +11,9 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md#used-third-party-tools" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md#used-third-party-tools" --- All third party tools used in nlohmann/json for building, testing and documenting the project are assessed within eclipse-score/inc_nlohmann_json. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-51.md b/TSF/trustable/statements/JLS-51.md index cc8961bc45..3776de6707 100644 --- a/TSF/trustable/statements/JLS-51.md +++ b/TSF/trustable/statements/JLS-51.md @@ -2,27 +2,27 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json" - description: "Start-page of the original nlohmann/json project" - - type: project_website - url: "https://github.com/eclipse-score/inc_nlohmann_json" - description: "Start-page of the mirror of nlohmann/json within Eclipse S-CORE" - - type: project_website - url: "https://github.com/eclipse-score/inc_nlohmann_json/blob/main/single_include/nlohmann/json.hpp" - description: "The single header file that contains all the source code downstream users need." - - type: project_website - url: "https://github.com/eclipse-score/inc_nlohmann_json/tree/main/include/nlohmann" - description: "The modular header files, containing all the source code which is amalgamated into the single header file." + - type: project_website + url: "https://github.com/nlohmann/json" + description: "Start-page of the original nlohmann/json project" + - type: project_website + url: "https://github.com/eclipse-score/inc_nlohmann_json" + description: "Start-page of the mirror of nlohmann/json within Eclipse S-CORE" + - type: project_website + url: "https://github.com/eclipse-score/inc_nlohmann_json/blob/main/single_include/nlohmann/json.hpp" + description: "The single header file that contains all the source code downstream users need." + - type: project_website + url: "https://github.com/eclipse-score/inc_nlohmann_json/tree/main/include/nlohmann" + description: "The modular header files, containing all the source code which is amalgamated into the single header file." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json" - - "https://github.com/eclipse-score/inc_nlohmann_json" - - "https://github.com/eclipse-score/inc_nlohmann_json/blob/main/single_include/nlohmann/json.hpp" - - "https://github.com/eclipse-score/inc_nlohmann_json/tree/main/include/nlohmann" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json" + - "https://github.com/eclipse-score/inc_nlohmann_json" + - "https://github.com/eclipse-score/inc_nlohmann_json/blob/main/single_include/nlohmann/json.hpp" + - "https://github.com/eclipse-score/inc_nlohmann_json/tree/main/include/nlohmann" --- All source code of the nlohmann/json library is mirrored within eclipse-score/inc_nlohmann_json. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-54.md b/TSF/trustable/statements/JLS-54.md index 8d7f1f968a..ce6a50a05f 100644 --- a/TSF/trustable/statements/JLS-54.md +++ b/TSF/trustable/statements/JLS-54.md @@ -1,13 +1,13 @@ --- level: 1.1 normative: true -references: +references: - type: verbose_file path: "./.github/workflows/coverage_gate.yml" description: "GitHub Actions workflow enforcing a minimum coverage threshold." evidence: - type: "check_artifact_exists" - configuration: + type: "check_artifact_exists" + configuration: ubuntu: exclude coverage_gate: include codeql: exclude diff --git a/TSF/trustable/statements/JLS-55.md b/TSF/trustable/statements/JLS-55.md index a0eb631849..15f632f5aa 100644 --- a/TSF/trustable/statements/JLS-55.md +++ b/TSF/trustable/statements/JLS-55.md @@ -1,13 +1,13 @@ --- level: 1.1 normative: true -references: +references: - type: verbose_file path: "./.github/workflows/pr_count_gate.yml" description: "GitHub Actions workflow enforcing a limit on open PRs." evidence: - type: "check_artifact_exists" - configuration: + type: "check_artifact_exists" + configuration: ubuntu: exclude coverage_gate: exclude codeql: exclude diff --git a/TSF/trustable/statements/JLS-56.md b/TSF/trustable/statements/JLS-56.md index 6fbd228a59..4e010397cd 100644 --- a/TSF/trustable/statements/JLS-56.md +++ b/TSF/trustable/statements/JLS-56.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: website - url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" - description: "Generated item page for JLEX-01, including its supporting subtree and references." - - type: website - url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" - description: "Generated item page for JLEX-02, including its supporting subtree and references." + - type: website + url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" + description: "Generated item page for JLEX-01, including its supporting subtree and references." + - type: website + url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" + description: "Generated item page for JLEX-02, including its supporting subtree and references." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" - - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" + - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" --- The expected behaviour of the expectations JLEX-01 and JLEX-02 is sufficiently broken-down. diff --git a/TSF/trustable/statements/JLS-57.md b/TSF/trustable/statements/JLS-57.md index ef367392ae..b625728453 100644 --- a/TSF/trustable/statements/JLS-57.md +++ b/TSF/trustable/statements/JLS-57.md @@ -8,9 +8,9 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/eclipse-score/inc_nlohmann_json/blob/save_historical_data/TSF/misbehaviours.md" + target_seconds: 2 + urls: + - "https://github.com/eclipse-score/inc_nlohmann_json/blob/save_historical_data/TSF/misbehaviours.md" --- Outstanding bugs or misbehaviours of nlohmann/json are fetched and saved within eclipse-score/inc_nlohmann_json. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-58.md b/TSF/trustable/statements/JLS-58.md index f688149457..da6d293f1a 100644 --- a/TSF/trustable/statements/JLS-58.md +++ b/TSF/trustable/statements/JLS-58.md @@ -4,13 +4,13 @@ normative: true references: - type: website url: "https://github.com/eclipse-score/inc_nlohmann_json/actions" - description: "Github actions page showing that eclipse-score/inc_nlohmann_json is using Github host environment." + description: "GitHub Actions page showing that eclipse-score/inc_nlohmann_json is using a GitHub-hosted environment." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/eclipse-score/inc_nlohmann_json/actions" + target_seconds: 2 + urls: + - "https://github.com/eclipse-score/inc_nlohmann_json/actions" --- -Github hosted runners are used as the test environment for eclipse-score/inc_nlohmann_json. +GitHub-hosted runners are used as the test environment for eclipse-score/inc_nlohmann_json. diff --git a/TSF/trustable/statements/JLS-61.md b/TSF/trustable/statements/JLS-61.md index 7d64ac8ef5..16517086c9 100644 --- a/TSF/trustable/statements/JLS-61.md +++ b/TSF/trustable/statements/JLS-61.md @@ -2,15 +2,15 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/.github/workflows/ubuntu.yml" - description: "Ubuntu workflow of nlohmann/json release v3.12.0, containing specific commit SHAs for all Github Actions, in e.g., lines 24, 36, 118, etc." + - type: project_website + url: "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/.github/workflows/ubuntu.yml" + description: "Ubuntu workflow of nlohmann/json release v3.12.0, containing specific commit SHAs for all GitHub Actions, in e.g., lines 24, 36, 118, etc." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/.github/workflows/ubuntu.yml" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/.github/workflows/ubuntu.yml" --- -Any Github Actions used in the testing process are pinned to specific commit SHAs to ensure consistent action behavior across runs. +Any GitHub Actions used in the testing process are pinned to specific commit SHAs to ensure consistent action behaviour across runs. diff --git a/TSF/trustable/statements/JLS-62.md b/TSF/trustable/statements/JLS-62.md index ff732c6f60..6253e77c2d 100644 --- a/TSF/trustable/statements/JLS-62.md +++ b/TSF/trustable/statements/JLS-62.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: website - url: "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md?plain=1#L1862" - description: "README file of the nlohmann/json repository stating that 'ctest -LE not_reproducible' excludes non-reproducible tests." - - type: website - url: "https://github.com/nlohmann/json/issues/2324" - description: "Issue in the nlohmann/json repository addressing tests that were non-reproducible." - - type: verbose_file - path: "./TSF/docs/non_reproducible_tests.md" - description: "Overview and description of 8 non-reproducible CMake integration tests." + - type: website + url: "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md?plain=1#L1862" + description: "README file of the nlohmann/json repository stating that 'ctest -LE not_reproducible' excludes non-reproducible tests." + - type: website + url: "https://github.com/nlohmann/json/issues/2324" + description: "Issue in the nlohmann/json repository addressing tests that were non-reproducible." + - type: verbose_file + path: "./TSF/docs/non_reproducible_tests.md" + description: "Overview and description of 8 non-reproducible CMake integration tests." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md?plain=1#L1862" - - "https://github.com/nlohmann/json/issues/2324" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/blob/55f93686c01528224f448c19128836e7df245f72/README.md?plain=1#L1862" + - "https://github.com/nlohmann/json/issues/2324" --- All tests except the ones which are excluded when using the flag "ctest -LE not_reproducible" are reproducible. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-63.md b/TSF/trustable/statements/JLS-63.md index 8f77b6decb..7d9019aa0d 100644 --- a/TSF/trustable/statements/JLS-63.md +++ b/TSF/trustable/statements/JLS-63.md @@ -2,22 +2,22 @@ level: 1.1 normative: true references: - - type: website - url: "https://www.bestpractices.dev/en/projects/289?criteria_level=1#section_project_oversight" - description: "OpenSSF Best Practices Report for nlohmann/json, where within 'Project Oversight' it states that the Developer Certificate of Origin (DCO) is enforced via the DCO GitHub app (https://github.com/settings/installations/58991705) as of December 30, 2024." - - type: web_content - url: "https://developercertificate.org/" - description: "The Developer Certificate of Origin in its original formulation." - - type: project_website - url: "https://github.com/nlohmann/json/discussions/4578" - description: "Announcement by Niels Lohmann that as of January 1, 2025, the project will require DCO (https://developercertificate.org) for all merge requests." + - type: website + url: "https://www.bestpractices.dev/en/projects/289?criteria_level=1#section_project_oversight" + description: "OpenSSF Best Practices Report for nlohmann/json, where within 'Project Oversight' it states that the Developer Certificate of Origin (DCO) is enforced via the DCO GitHub app (https://github.com/settings/installations/58991705) as of December 30, 2024." + - type: web_content + url: "https://developercertificate.org/" + description: "The Developer Certificate of Origin in its original formulation." + - type: project_website + url: "https://github.com/nlohmann/json/discussions/4578" + description: "Announcement by Niels Lohmann that as of January 1, 2025, the project will require DCO (https://developercertificate.org) for all merge requests." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/discussions/4578" - - "https://www.bestpractices.dev/en/projects/289?criteria_level=1#section_project_oversight" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/discussions/4578" + - "https://www.bestpractices.dev/en/projects/289?criteria_level=1#section_project_oversight" --- Releases of the nlohmann/json library contain commit sign-offs. diff --git a/TSF/trustable/statements/JLS-64.md b/TSF/trustable/statements/JLS-64.md index c4909b0d68..46077b072f 100644 --- a/TSF/trustable/statements/JLS-64.md +++ b/TSF/trustable/statements/JLS-64.md @@ -11,10 +11,10 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json/discussions/5022" - - "https://github.com/nlohmann/json/pulls?q=is%3Apr+is%3Aclosed+is%3Amerged" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json/discussions/5022" + - "https://github.com/nlohmann/json/pulls?q=is%3Apr+is%3Aclosed+is%3Amerged" --- -Releases of the nlohmann/json library contain Github pull request approvals. \ No newline at end of file +Releases of the nlohmann/json library contain GitHub pull request approvals. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-65.md b/TSF/trustable/statements/JLS-65.md index 64894ddaa3..cbb3884123 100644 --- a/TSF/trustable/statements/JLS-65.md +++ b/TSF/trustable/statements/JLS-65.md @@ -2,23 +2,23 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - description: "OpenSSF Scorecard Report for the nlohmann/json library." - - type: website - url: "https://coveralls.io/github/nlohmann/json" - description: "Coverage Report for the nlohmann/json library." - - type: website - url: "https://introspector.oss-fuzz.com/project-profile?project=json" - description: "Most recent report for fuzzing introspection of the nlohmann/json library with historical plots." + - type: project_website + url: "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + description: "OpenSSF Scorecard Report for the nlohmann/json library." + - type: website + url: "https://coveralls.io/github/nlohmann/json" + description: "Coverage Report for the nlohmann/json library." + - type: website + url: "https://introspector.oss-fuzz.com/project-profile?project=json" + description: "Most recent report for fuzzing introspection of the nlohmann/json library with historical plots." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" - - "https://coveralls.io/github/nlohmann/json" - - "https://introspector.oss-fuzz.com/project-profile?project=json" + target_seconds: 2 + urls: + - "https://scorecard.dev/viewer/?uri=github.com%2Fnlohmann%2Fjson" + - "https://coveralls.io/github/nlohmann/json" + - "https://introspector.oss-fuzz.com/project-profile?project=json" --- Releases of the nlohmann/json library contain continuous-integration test reports such as coverage reports, fuzzing reports & OpenSSF scorecard reports. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-66.md b/TSF/trustable/statements/JLS-66.md index 178d473cef..ccd7e2773d 100644 --- a/TSF/trustable/statements/JLS-66.md +++ b/TSF/trustable/statements/JLS-66.md @@ -8,9 +8,9 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://otterdog.eclipse.org/projects/automotive.score/repos/inc_nlohmann_json#rulesets" + target_seconds: 2 + urls: + - "https://otterdog.eclipse.org/projects/automotive.score/repos/inc_nlohmann_json#rulesets" --- The mirror of nlohmann/json is configured via infrastructure under direct control, and rejects history rewrites. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-70.md b/TSF/trustable/statements/JLS-70.md index 73f47b9f48..6a372df6b4 100644 --- a/TSF/trustable/statements/JLS-70.md +++ b/TSF/trustable/statements/JLS-70.md @@ -8,9 +8,9 @@ references: evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://github.com/nlohmann/json?tab=readme-ov-file#integration" + target_seconds: 2 + urls: + - "https://github.com/nlohmann/json?tab=readme-ov-file#integration" --- The nlohmann/json library provides installation manuals with worked examples. diff --git a/TSF/trustable/statements/JLS-71.md b/TSF/trustable/statements/JLS-71.md index 54e555d200..63e5664076 100644 --- a/TSF/trustable/statements/JLS-71.md +++ b/TSF/trustable/statements/JLS-71.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/features/macros/" - description: "Configuration documentation via supported preprocessor macros." - - type: project_website - url: "https://json.nlohmann.me/integration/cmake/" - description: "CMake integration documentation, including build options that map to configuration macros." + - type: project_website + url: "https://json.nlohmann.me/features/macros/" + description: "Configuration documentation via supported preprocessor macros." + - type: project_website + url: "https://json.nlohmann.me/integration/cmake/" + description: "CMake integration documentation, including build options that map to configuration macros." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/features/macros/" - - "https://json.nlohmann.me/integration/cmake/" + target_seconds: 2 + urls: + - "https://json.nlohmann.me/features/macros/" + - "https://json.nlohmann.me/integration/cmake/" --- The nlohmann/json library provides configuration manuals with worked examples. diff --git a/TSF/trustable/statements/JLS-72.md b/TSF/trustable/statements/JLS-72.md index ed481e18a9..4c0e6f26c6 100644 --- a/TSF/trustable/statements/JLS-72.md +++ b/TSF/trustable/statements/JLS-72.md @@ -2,19 +2,19 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/home/design_goals/" - description: "Design goals describing the intended scope and trade-offs of the library." - - type: project_website - url: "https://json.nlohmann.me/api/basic_json/" - description: "API reference describing the behavior and requirements of the core JSON type." + - type: project_website + url: "https://json.nlohmann.me/home/design_goals/" + description: "Design goals describing the intended scope and trade-offs of the library." + - type: project_website + url: "https://json.nlohmann.me/api/basic_json/" + description: "API reference describing the behaviour and requirements of the core JSON type." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/home/design_goals/" - - "https://json.nlohmann.me/api/basic_json/" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://json.nlohmann.me/home/design_goals/" + - "https://json.nlohmann.me/api/basic_json/" --- -The nlohmann/json project documents the intended scope and design trade-offs of the library and specifies the documented interface and behavior of its core JSON type via its API reference. +The nlohmann/json project documents the intended scope and design trade-offs of the library and specifies the documented interface and behaviour of its core JSON type via its API reference. diff --git a/TSF/trustable/statements/JLS-73.md b/TSF/trustable/statements/JLS-73.md index ce1ac0195e..265b4e73b7 100644 --- a/TSF/trustable/statements/JLS-73.md +++ b/TSF/trustable/statements/JLS-73.md @@ -2,23 +2,23 @@ level: 1.1 normative: true references: - - type: project_website - url: "https://json.nlohmann.me/features/arbitrary_types/" - description: "User guide for extending the library via serializers, including guidance for third-party types." - - type: project_website - url: "https://json.nlohmann.me/features/namespace/" - description: "Documentation of the inline-namespace mechanism for modular use of multiple versions/configurations, including its limitations." - - type: project_website - url: "https://json.nlohmann.me/integration/migration_guide/" - description: "Migration guidance on namespace/version/configuration handling to avoid integration pitfalls." + - type: project_website + url: "https://json.nlohmann.me/features/arbitrary_types/" + description: "User guide for extending the library via serializers, including guidance for third-party types." + - type: project_website + url: "https://json.nlohmann.me/features/namespace/" + description: "Documentation of the inline-namespace mechanism for modular use of multiple versions/configurations, including its limitations." + - type: project_website + url: "https://json.nlohmann.me/integration/migration_guide/" + description: "Migration guidance on namespace/version/configuration handling to avoid integration pitfalls." evidence: type: https_response_time configuration: - target_seconds: 2 - urls: - - "https://json.nlohmann.me/features/arbitrary_types/" - - "https://json.nlohmann.me/features/namespace/" - - "https://json.nlohmann.me/integration/migration_guide/" + target_seconds: 2 + urls: + - "https://json.nlohmann.me/features/arbitrary_types/" + - "https://json.nlohmann.me/features/namespace/" + - "https://json.nlohmann.me/integration/migration_guide/" --- The nlohmann/json documentation provides user-facing guidance for extensibility and modular integration, explicitly documenting limitations and constraints of extension interfaces. diff --git a/TSF/trustable/statements/JLS-74.md b/TSF/trustable/statements/JLS-74.md index 8b3fb53457..5dce9dc112 100644 --- a/TSF/trustable/statements/JLS-74.md +++ b/TSF/trustable/statements/JLS-74.md @@ -2,19 +2,19 @@ level: '1.1' normative: true references: - - type: website - url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" - description: "Generated item page for JLEX-01, including its supporting subtree and references." - - type: website - url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" - description: "Generated item page for JLEX-02, including its supporting subtree and references." + - type: website + url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" + description: "Generated item page for JLEX-01, including its supporting subtree and references." + - type: website + url: "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" + description: "Generated item page for JLEX-02, including its supporting subtree and references." evidence: - type: https_response_time - configuration: - target_seconds: 2 - urls: - - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" - - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" + type: https_response_time + configuration: + target_seconds: 2 + urls: + - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-01" + - "https://eclipse-score.github.io/inc_nlohmann_json/main/generated/JLEX.html#jlex-02" --- Each supporting statement for the Expectations includes references to the CI test evidence that exercises it. The suitability of the referenced tests as evidence for each statement is validated by SME reviewers as part of the scoring process. \ No newline at end of file diff --git a/TSF/trustable/statements/JLS-76.md b/TSF/trustable/statements/JLS-76.md index 3b0c63e435..dec68c90da 100644 --- a/TSF/trustable/statements/JLS-76.md +++ b/TSF/trustable/statements/JLS-76.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "parse;UTF-8;unexpected BOM" - path: "TSF/tests/unit-byte_order_mark.cpp" - description: "This test case is included purely as an example to illustrate the fault‑induction style tests used in nlohmann/json." - - type: cpp_test - name: "deserialization;contiguous containers;error cases;case 15" - path: "tests/src/unit-deserialization.cpp" - description: "This test case is included purely as an example to illustrate the fault‑induction style tests used in nlohmann/json." - - type: cpp_test - name: "parser class - core;parse;string;errors" - path: "TSF/tests/unit-class_parser_core.cpp" - description: "This test case is included purely as an example to illustrate the fault‑induction style tests used in nlohmann/json." + - type: cpp_test + name: "parse;UTF-8;unexpected BOM" + path: "TSF/tests/unit-byte_order_mark.cpp" + description: "This test case is included purely as an example to illustrate the fault‑induction style tests used in nlohmann/json." + - type: cpp_test + name: "deserialization;contiguous containers;error cases;case 15" + path: "tests/src/unit-deserialization.cpp" + description: "This test case is included purely as an example to illustrate the fault‑induction style tests used in nlohmann/json." + - type: cpp_test + name: "parser class - core;parse;string;errors" + path: "TSF/tests/unit-class_parser_core.cpp" + description: "This test case is included purely as an example to illustrate the fault‑induction style tests used in nlohmann/json." --- nlohmann/json does use fault‑induction–style techniques (invalid inputs, resource failures, fuzzing) to demonstrate that code paths which usually succeed in normal usage can and do fail in a controlled, specified way. \ No newline at end of file diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-01.1.md b/TSF/trustable/throw-ill-formed-json/TIJ-01.1.md index 900ad9c693..6a5f1fd076 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-01.1.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-01.1.md @@ -2,14 +2,14 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "parse;capitalisation" - path: "TSF/tests/unit-literals.cpp" + - type: cpp_test + name: "parse;capitalisation" + path: "TSF/tests/unit-literals.cpp" evidence: - type: check_test_results - configuration: - tests: - - literals + type: check_test_results + configuration: + tests: + - literals score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-01.2.md b/TSF/trustable/throw-ill-formed-json/TIJ-01.2.md index 889921c82d..bd2e77b4c8 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-01.2.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-01.2.md @@ -2,33 +2,33 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite;test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite/test_parsing/n_incomplete_false.json" - - "/nst_json_testsuite/test_parsing/n_incomplete_null.json" - - "/nst_json_testsuite/test_parsing/n_incomplete_true.json" - - "/nst_json_testsuite/test_parsing/n_structure_number_with_trailing_garbage.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_incomplete_false.json" - - "/nst_json_testsuite2/test_parsing/n_incomplete_null.json" - - "/nst_json_testsuite2/test_parsing/n_incomplete_true.json" - - "/nst_json_testsuite2/test_parsing/n_structure_capitalized_True.json" - description: "" - - type: cpp_test - name: "parse;illegal literals" - path: "TSF/tests/unit-literals.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite;test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite/test_parsing/n_incomplete_false.json" + - "/nst_json_testsuite/test_parsing/n_incomplete_null.json" + - "/nst_json_testsuite/test_parsing/n_incomplete_true.json" + - "/nst_json_testsuite/test_parsing/n_structure_number_with_trailing_garbage.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_incomplete_false.json" + - "/nst_json_testsuite2/test_parsing/n_incomplete_null.json" + - "/nst_json_testsuite2/test_parsing/n_incomplete_true.json" + - "/nst_json_testsuite2/test_parsing/n_structure_capitalized_True.json" + description: "" + - type: cpp_test + name: "parse;illegal literals" + path: "TSF/tests/unit-literals.cpp" evidence: - type: check_test_results - configuration: - tests: - - literals - - testsuites + type: check_test_results + configuration: + tests: + - literals + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-02.1.md b/TSF/trustable/throw-ill-formed-json/TIJ-02.1.md index 9c7dc9275b..efa22f2dc9 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-02.1.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-02.1.md @@ -2,14 +2,14 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "parser class - core;parse;number;invalid numbers" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parser class - core;parse;number;invalid numbers" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-02.2.md b/TSF/trustable/throw-ill-formed-json/TIJ-02.2.md index 28ca5afa15..d1d69ce357 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-02.2.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-02.2.md @@ -2,26 +2,26 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_-01.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" - description: "Checks that -01 is rejected." - - type: cpp_test - name: "parser class - core;parse;number;invalid numbers" - path: "TSF/tests/unit-class_parser_core.cpp" - - type: cpp_test - name: "parse;leading zeroes" - path: "TSF/tests/unit-numbers.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_-01.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" + description: "Checks that -01 is rejected." + - type: cpp_test + name: "parser class - core;parse;number;invalid numbers" + path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parse;leading zeroes" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core - - testsuites - - numbers + type: check_test_results + configuration: + tests: + - class_parser_core + - testsuites + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-02.3.md b/TSF/trustable/throw-ill-formed-json/TIJ-02.3.md index 2fab94820b..a42864cfba 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-02.3.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-02.3.md @@ -2,25 +2,25 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" - description: "Checks that NaN and Inf are rejected." - - type: cpp_test - name: "parse;illegal literal numbers" - path: "TSF/tests/unit-literals.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" + description: "Checks that NaN and Inf are rejected." + - type: cpp_test + name: "parse;illegal literal numbers" + path: "TSF/tests/unit-literals.cpp" evidence: - type: check_test_results - configuration: - tests: - - literals - - testsuites + type: check_test_results + configuration: + tests: + - literals + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-02.4.md b/TSF/trustable/throw-ill-formed-json/TIJ-02.4.md index 0b547a0670..5f46972e6f 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-02.4.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-02.4.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "parse;exponents;U+0425" - path: "TSF/tests/unit-numbers.cpp" - - type: cpp_test - name: "parse;exponents;U+0436" - path: "TSF/tests/unit-numbers.cpp" + - type: cpp_test + name: "parse;exponents;U+0425" + path: "TSF/tests/unit-numbers.cpp" + - type: cpp_test + name: "parse;exponents;U+0436" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - numbers + type: check_test_results + configuration: + tests: + - numbers score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-02.5.md b/TSF/trustable/throw-ill-formed-json/TIJ-02.5.md index 1b2f95e991..35c3d1c97f 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-02.5.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-02.5.md @@ -2,74 +2,74 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_number_++.json" - - "/nst_json_testsuite2/test_parsing/n_number_+1.json" - - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_-01.json" - - "/nst_json_testsuite2/test_parsing/n_number_-1.0..json" - - "/nst_json_testsuite2/test_parsing/n_number_-2..json" - - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_.-1.json" - - "/nst_json_testsuite2/test_parsing/n_number_.2e-3.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.1.2.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.3e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.3e.json" - - "/nst_json_testsuite2/test_parsing/n_number_0.e1.json" - - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E+.json" - - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E.json" - - "/nst_json_testsuite2/test_parsing/n_number_0e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_0e.json" - - "/nst_json_testsuite2/test_parsing/n_number_1.0e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_1.0e-.json" - - "/nst_json_testsuite2/test_parsing/n_number_1.0e.json" - - "/nst_json_testsuite2/test_parsing/n_number_1_000.json" - - "/nst_json_testsuite2/test_parsing/n_number_1eE2.json" - - "/nst_json_testsuite2/test_parsing/n_number_2.e+3.json" - - "/nst_json_testsuite2/test_parsing/n_number_2.e-3.json" - - "/nst_json_testsuite2/test_parsing/n_number_2.e3.json" - - "/nst_json_testsuite2/test_parsing/n_number_9.e+.json" - - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" - - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" - - "/nst_json_testsuite2/test_parsing/n_number_U+FF11_fullwidth_digit_one.json" - - "/nst_json_testsuite2/test_parsing/n_number_expression.json" - - "/nst_json_testsuite2/test_parsing/n_number_hex_1_digit.json" - - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" - - "/nst_json_testsuite2/test_parsing/n_number_infinity.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid+-.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-negative-real.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-bigger-int.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-exponent.json" - - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-int.json" - - "/nst_json_testsuite2/test_parsing/n_number_minus_infinity.json" - - "/nst_json_testsuite2/test_parsing/n_number_minus_sign_with_trailing_garbage.json" - - "/nst_json_testsuite2/test_parsing/n_number_minus_space_1.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_real_without_int_part.json" - - "/nst_json_testsuite2/test_parsing/n_number_neg_with_garbage_at_end.json" - - "/nst_json_testsuite2/test_parsing/n_number_real_garbage_after_e.json" - - "/nst_json_testsuite2/test_parsing/n_number_real_with_invalid_utf8_after_e.json" - - "/nst_json_testsuite2/test_parsing/n_number_real_without_fractional_part.json" - - "/nst_json_testsuite2/test_parsing/n_number_starting_with_dot.json" - - "/nst_json_testsuite2/test_parsing/n_number_with_alpha.json" - - "/nst_json_testsuite2/test_parsing/n_number_with_alpha_char.json" - - "/nst_json_testsuite2/test_parsing/n_number_with_leading_zero.json" - description: "Tests whether various numbers with invalid syntax according to RFC8259 throw an exception." - - type: cpp_test - name: "parse;operators" - path: "TSF/tests/unit-numbers.cpp" - - type: cpp_test - name: "parse;invalid whitespace" - path: "TSF/tests/unit-numbers.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_number_++.json" + - "/nst_json_testsuite2/test_parsing/n_number_+1.json" + - "/nst_json_testsuite2/test_parsing/n_number_+Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_-01.json" + - "/nst_json_testsuite2/test_parsing/n_number_-1.0..json" + - "/nst_json_testsuite2/test_parsing/n_number_-2..json" + - "/nst_json_testsuite2/test_parsing/n_number_-NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_.-1.json" + - "/nst_json_testsuite2/test_parsing/n_number_.2e-3.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.1.2.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.3e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.3e.json" + - "/nst_json_testsuite2/test_parsing/n_number_0.e1.json" + - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E+.json" + - "/nst_json_testsuite2/test_parsing/n_number_0_capital_E.json" + - "/nst_json_testsuite2/test_parsing/n_number_0e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_0e.json" + - "/nst_json_testsuite2/test_parsing/n_number_1.0e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_1.0e-.json" + - "/nst_json_testsuite2/test_parsing/n_number_1.0e.json" + - "/nst_json_testsuite2/test_parsing/n_number_1_000.json" + - "/nst_json_testsuite2/test_parsing/n_number_1eE2.json" + - "/nst_json_testsuite2/test_parsing/n_number_2.e+3.json" + - "/nst_json_testsuite2/test_parsing/n_number_2.e-3.json" + - "/nst_json_testsuite2/test_parsing/n_number_2.e3.json" + - "/nst_json_testsuite2/test_parsing/n_number_9.e+.json" + - "/nst_json_testsuite2/test_parsing/n_number_Inf.json" + - "/nst_json_testsuite2/test_parsing/n_number_NaN.json" + - "/nst_json_testsuite2/test_parsing/n_number_U+FF11_fullwidth_digit_one.json" + - "/nst_json_testsuite2/test_parsing/n_number_expression.json" + - "/nst_json_testsuite2/test_parsing/n_number_hex_1_digit.json" + - "/nst_json_testsuite2/test_parsing/n_number_hex_2_digits.json" + - "/nst_json_testsuite2/test_parsing/n_number_infinity.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid+-.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-negative-real.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-bigger-int.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-exponent.json" + - "/nst_json_testsuite2/test_parsing/n_number_invalid-utf-8-in-int.json" + - "/nst_json_testsuite2/test_parsing/n_number_minus_infinity.json" + - "/nst_json_testsuite2/test_parsing/n_number_minus_sign_with_trailing_garbage.json" + - "/nst_json_testsuite2/test_parsing/n_number_minus_space_1.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_int_starting_with_zero.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_real_without_int_part.json" + - "/nst_json_testsuite2/test_parsing/n_number_neg_with_garbage_at_end.json" + - "/nst_json_testsuite2/test_parsing/n_number_real_garbage_after_e.json" + - "/nst_json_testsuite2/test_parsing/n_number_real_with_invalid_utf8_after_e.json" + - "/nst_json_testsuite2/test_parsing/n_number_real_without_fractional_part.json" + - "/nst_json_testsuite2/test_parsing/n_number_starting_with_dot.json" + - "/nst_json_testsuite2/test_parsing/n_number_with_alpha.json" + - "/nst_json_testsuite2/test_parsing/n_number_with_alpha_char.json" + - "/nst_json_testsuite2/test_parsing/n_number_with_leading_zero.json" + description: "Tests whether various numbers with invalid syntax according to RFC8259 throw an exception." + - type: cpp_test + name: "parse;operators" + path: "TSF/tests/unit-numbers.cpp" + - type: cpp_test + name: "parse;invalid whitespace" + path: "TSF/tests/unit-numbers.cpp" evidence: - type: check_test_results - configuration: - tests: - - numbers - - testsuites + type: check_test_results + configuration: + tests: + - numbers + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-03.1.md b/TSF/trustable/throw-ill-formed-json/TIJ-03.1.md index a95f8ce68c..457cd44931 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-03.1.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-03.1.md @@ -2,14 +2,14 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "parser class - core;parse;string;errors" - path: "TSF/tests/unit-class_parser_core.cpp" + - type: cpp_test + name: "parser class - core;parse;string;errors" + path: "TSF/tests/unit-class_parser_core.cpp" evidence: - type: check_test_results - configuration: - tests: - - class_parser_core + type: check_test_results + configuration: + tests: + - class_parser_core score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-03.2.md b/TSF/trustable/throw-ill-formed-json/TIJ-03.2.md index e6dd3a8ec0..6278a552ef 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-03.2.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-03.2.md @@ -2,14 +2,14 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "Unicode;unescaped unicode" - path: "TSF/tests/unit-strings.cpp" + - type: cpp_test + name: "Unicode;unescaped unicode" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - strings + type: check_test_results + configuration: + tests: + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-03.3.md b/TSF/trustable/throw-ill-formed-json/TIJ-03.3.md index a51f9a9abc..fba468b25f 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-03.3.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-03.3.md @@ -2,24 +2,24 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "deserialization;contiguous containers;error cases" - path: "tests/src/unit-deserialization.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_string_no_quotes_with_bad_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_single_doublequote.json" - - "/nst_json_testsuite2/test_parsing/n_string_single_quote.json" - - "/nst_json_testsuite2/test_parsing/n_string_single_string_no_double_quotes.json" - description: "Tests whether several improperly bounded strings throw an exception." + - type: cpp_test + name: "deserialization;contiguous containers;error cases" + path: "tests/src/unit-deserialization.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_string_no_quotes_with_bad_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_single_doublequote.json" + - "/nst_json_testsuite2/test_parsing/n_string_single_quote.json" + - "/nst_json_testsuite2/test_parsing/n_string_single_string_no_double_quotes.json" + description: "Tests whether several improperly bounded strings throw an exception." evidence: - type: check_test_results - configuration: - tests: - - deserialization - - testsuites + type: check_test_results + configuration: + tests: + - deserialization + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-03.4.md b/TSF/trustable/throw-ill-formed-json/TIJ-03.4.md index 5be74cacf8..becc6c9ec7 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-03.4.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-03.4.md @@ -2,34 +2,34 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u.json" - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1.json" - - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1x.json" - - "/nst_json_testsuite2/test_parsing/n_string_accentuated_char_no_quotes.json" - - "/nst_json_testsuite2/test_parsing/n_string_backslash_00.json" - - "/nst_json_testsuite2/test_parsing/n_string_escape_x.json" - - "/nst_json_testsuite2/test_parsing/n_string_escaped_backslash_bad.json" - - "/nst_json_testsuite2/test_parsing/n_string_escaped_ctrl_char_tab.json" - - "/nst_json_testsuite2/test_parsing/n_string_escaped_emoji.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escaped_character.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate.json" - - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate_escape_invalid.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid-utf-8-in-escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid_backslash_esc.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid_unicode_escape.json" - - "/nst_json_testsuite2/test_parsing/n_string_invalid_utf8_after_escape.json" - description: "Tests whether various illegal control characters and utf-8 characters throw an exception." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u.json" + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1.json" + - "/nst_json_testsuite2/test_parsing/n_string_1_surrogate_then_escape_u1x.json" + - "/nst_json_testsuite2/test_parsing/n_string_accentuated_char_no_quotes.json" + - "/nst_json_testsuite2/test_parsing/n_string_backslash_00.json" + - "/nst_json_testsuite2/test_parsing/n_string_escape_x.json" + - "/nst_json_testsuite2/test_parsing/n_string_escaped_backslash_bad.json" + - "/nst_json_testsuite2/test_parsing/n_string_escaped_ctrl_char_tab.json" + - "/nst_json_testsuite2/test_parsing/n_string_escaped_emoji.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_escaped_character.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate.json" + - "/nst_json_testsuite2/test_parsing/n_string_incomplete_surrogate_escape_invalid.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid-utf-8-in-escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid_backslash_esc.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid_unicode_escape.json" + - "/nst_json_testsuite2/test_parsing/n_string_invalid_utf8_after_escape.json" + description: "Tests whether various illegal control characters and utf-8 characters throw an exception." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-03.5.md b/TSF/trustable/throw-ill-formed-json/TIJ-03.5.md index 37c4210eb3..4857a4f1c6 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-03.5.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-03.5.md @@ -2,18 +2,18 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "Unicode (1/5);\\\\uxxxx sequences;incorrect sequences;incorrect surrogate values" - path: "tests/src/unit-unicode1.cpp" - - type: cpp_test - name: "Unicode;escaped utf-16 surrogates;ill-formed" - path: "TSF/tests/unit-strings.cpp" + - type: cpp_test + name: "Unicode (1/5);\\\\uxxxx sequences;incorrect sequences;incorrect surrogate values" + path: "tests/src/unit-unicode1.cpp" + - type: cpp_test + name: "Unicode;escaped utf-16 surrogates;ill-formed" + path: "TSF/tests/unit-strings.cpp" evidence: - type: check_test_results - configuration: - tests: - - unicode1 - - strings + type: check_test_results + configuration: + tests: + - unicode1 + - strings score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-04.1.md b/TSF/trustable/throw-ill-formed-json/TIJ-04.1.md index 132cb4dbe0..272d8b19a6 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-04.1.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-04.1.md @@ -2,39 +2,39 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n (previously overflowed)" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_100000_opening_arrays.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_close_unopened_array.json" - description: "" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_double_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_end_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_lone-invalid-utf-8.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_array_apostrophe.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_array_comma.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_array_open_object.json" - - "/nst_json_testsuite2/test_parsing/n_structure_open_object_close_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_partial_null.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_false.json" - - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_true.json" - description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n (previously overflowed)" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_100000_opening_arrays.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_close_unopened_array.json" + description: "" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_double_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_end_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_lone-invalid-utf-8.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_array_apostrophe.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_array_comma.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_array_open_object.json" + - "/nst_json_testsuite2/test_parsing/n_structure_open_object_close_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_partial_null.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_false.json" + - "/nst_json_testsuite2/test_parsing/n_structure_unclosed_array_unfinished_true.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-04.2.md b/TSF/trustable/throw-ill-formed-json/TIJ-04.2.md index 94037ce5b3..defaf753fa 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-04.2.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-04.2.md @@ -2,24 +2,24 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_array_double_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_double_extra_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_just_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_number_and_comma.json" - - "/nst_json_testsuite2/test_parsing/n_array_number_and_several_commas.json" - - "/nst_json_testsuite2/test_parsing/n_structure_array_with_unclosed_string.json" - - "/nst_json_testsuite2/test_parsing/n_array_invalid_utf8.json" - - "/nst_json_testsuite2/test_parsing/n_array_just_minus.json" - description: "Checks that various \"proper\" arrays with improper elements throw an exception." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_array_double_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_double_extra_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_just_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_number_and_comma.json" + - "/nst_json_testsuite2/test_parsing/n_array_number_and_several_commas.json" + - "/nst_json_testsuite2/test_parsing/n_structure_array_with_unclosed_string.json" + - "/nst_json_testsuite2/test_parsing/n_array_invalid_utf8.json" + - "/nst_json_testsuite2/test_parsing/n_array_just_minus.json" + description: "Checks that various \"proper\" arrays with improper elements throw an exception." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-04.3.md b/TSF/trustable/throw-ill-formed-json/TIJ-04.3.md index af8a91a9a7..1c00110600 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-04.3.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-04.3.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_array_colon_instead_of_comma.json" - description: "Tests whether colon as value separator throws an exception." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_array_colon_instead_of_comma.json" + description: "Tests whether colon as value separator throws an exception." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-05.1.md b/TSF/trustable/throw-ill-formed-json/TIJ-05.1.md index 3a157ad401..a56029bd25 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-05.1.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-05.1.md @@ -2,23 +2,23 @@ level: 1.1 normative: true references: - - type: cpp_test - name: "deserialization;contiguous containers;error cases;case 15" - path: "tests/src/unit-deserialization.cpp" - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_structure_comma_instead_of_closing_brace.json" - - "/nst_json_testsuite2/test_parsing/n_structure_object_followed_by_closing_object.json" - - "/nst_json_testsuite2/test_parsing/n_structure_object_unclosed_no_value.json" - description: "" + - type: cpp_test + name: "deserialization;contiguous containers;error cases;case 15" + path: "tests/src/unit-deserialization.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_structure_comma_instead_of_closing_brace.json" + - "/nst_json_testsuite2/test_parsing/n_structure_object_followed_by_closing_object.json" + - "/nst_json_testsuite2/test_parsing/n_structure_object_unclosed_no_value.json" + description: "" evidence: - type: check_test_results - configuration: - tests: - - deserialization - - testsuites + type: check_test_results + configuration: + tests: + - deserialization + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-05.2.md b/TSF/trustable/throw-ill-formed-json/TIJ-05.2.md index 0fabb048aa..6d525f63c3 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-05.2.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-05.2.md @@ -2,31 +2,31 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" - description: "Checks that numbers as keys are rejected." - - type: cpp_test - name: "parse;names;numbers" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "parse;names;arrays" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "parse;names;objects" - path: "TSF/tests/unit-objects.cpp" - - type: cpp_test - name: "parse;names;literals" - path: "TSF/tests/unit-objects.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" + description: "Checks that numbers as keys are rejected." + - type: cpp_test + name: "parse;names;numbers" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "parse;names;arrays" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "parse;names;objects" + path: "TSF/tests/unit-objects.cpp" + - type: cpp_test + name: "parse;names;literals" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-05.3.md b/TSF/trustable/throw-ill-formed-json/TIJ-05.3.md index e42d38abee..7076f48bc4 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-05.3.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-05.3.md @@ -2,29 +2,29 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_single_quote.json" - - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" - - "/nst_json_testsuite2/test_parsing/n_object_key_with_single_quotes.json" - - "/nst_json_testsuite2/test_parsing/n_object_bracket_key.json" - - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" - description: "Checks that invalid names throw an exception." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;i -> n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/i_object_key_lone_2nd_surrogate.json" - description: "Checks that string with invalid utf16 surrogate as name throws an exception." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_single_quote.json" + - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_non_string_key_but_huge_number_instead.json" + - "/nst_json_testsuite2/test_parsing/n_object_key_with_single_quotes.json" + - "/nst_json_testsuite2/test_parsing/n_object_bracket_key.json" + - "/nst_json_testsuite2/test_parsing/n_object_unquoted_key.json" + description: "Checks that invalid names throw an exception." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;i -> n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/i_object_key_lone_2nd_surrogate.json" + description: "Checks that string with invalid utf16 surrogate as name throws an exception." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-05.4.md b/TSF/trustable/throw-ill-formed-json/TIJ-05.4.md index 81928a112d..6b8f5f9593 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-05.4.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-05.4.md @@ -2,17 +2,17 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_bad_value.json" - description: "Checks that the invalid literal \"truth\" as value throws an exception." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_bad_value.json" + description: "Checks that the invalid literal \"truth\" as value throws an exception." evidence: - type: check_test_results - configuration: - tests: - - testsuites + type: check_test_results + configuration: + tests: + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/throw-ill-formed-json/TIJ-05.5.md b/TSF/trustable/throw-ill-formed-json/TIJ-05.5.md index 2ff5e34c15..38545bce6f 100644 --- a/TSF/trustable/throw-ill-formed-json/TIJ-05.5.md +++ b/TSF/trustable/throw-ill-formed-json/TIJ-05.5.md @@ -2,34 +2,34 @@ level: 1.1 normative: true references: - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_comma_instead_of_colon.json" - description: "Checks that comma instead of colon is rejected." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_double_colon.json" - description: "Checks that double colon is rejected." - - type: JSON_testsuite - name: "nst's JSONTestSuite (2);test_parsing;n" - path: "tests/src/unit-testsuites.cpp" - test_suite_paths: - - "/nst_json_testsuite2/test_parsing/n_object_missing_colon.json" - - "/nst_json_testsuite2/test_parsing/n_object_missing_semicolon.json" - description: "Checks that the empty member separator is rejected." - - type: cpp_test - name: "parse;member separator" - path: "TSF/tests/unit-objects.cpp" + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_comma_instead_of_colon.json" + description: "Checks that comma instead of colon is rejected." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_double_colon.json" + description: "Checks that double colon is rejected." + - type: JSON_testsuite + name: "nst's JSONTestSuite (2);test_parsing;n" + path: "tests/src/unit-testsuites.cpp" + test_suite_paths: + - "/nst_json_testsuite2/test_parsing/n_object_missing_colon.json" + - "/nst_json_testsuite2/test_parsing/n_object_missing_semicolon.json" + description: "Checks that the empty member separator is rejected." + - type: cpp_test + name: "parse;member separator" + path: "TSF/tests/unit-objects.cpp" evidence: - type: check_test_results - configuration: - tests: - - objects - - testsuites + type: check_test_results + configuration: + tests: + - objects + - testsuites score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0 diff --git a/TSF/trustable/well-formed-json/WFJ-06.md b/TSF/trustable/well-formed-json/WFJ-06.md index 4c782a467c..de4b3638a8 100644 --- a/TSF/trustable/well-formed-json/WFJ-06.md +++ b/TSF/trustable/well-formed-json/WFJ-06.md @@ -2,37 +2,37 @@ level: 1.1 normative: true references: - - type: function_reference - name: "basic_json::accept" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `accept`-functionality of nlohmann/json for single inputs" - overload: 1 - - type: function_reference - name: "basic_json::accept" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `accept`-functionality of nlohmann/json for iterator inputs" - overload: 2 - - type: function_reference - name: "basic_json::accept" - path: "include/nlohmann/json.hpp" - description: "the public interface of the `accept`-functionality of nlohmann/json for input buffer" - overload: 3 - - type: function_reference - name: "parser::accept" - path: "include/nlohmann/detail/input/parser.hpp" - description: "the internal `accept`-functionality called by basic_json::accept" - - type: function_reference - name: "parser::sax_parse" - path: "include/nlohmann/detail/input/parser.hpp" - description: "called by parser::accept" - - type: function_reference - name: "parser::sax_parse_internal" - path: "include/nlohmann/detail/input/parser.hpp" - description: "called by parser::sax_parse" - - type: function_reference - name: "lexer::scan" - path: "include/nlohmann/detail/input/lexer.hpp" - description: "scans input, called in parser::sax_parse_internal" + - type: function_reference + name: "basic_json::accept" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `accept`-functionality of nlohmann/json for single inputs" + overload: 1 + - type: function_reference + name: "basic_json::accept" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `accept`-functionality of nlohmann/json for iterator inputs" + overload: 2 + - type: function_reference + name: "basic_json::accept" + path: "include/nlohmann/json.hpp" + description: "the public interface of the `accept`-functionality of nlohmann/json for input buffer" + overload: 3 + - type: function_reference + name: "parser::accept" + path: "include/nlohmann/detail/input/parser.hpp" + description: "the internal `accept`-functionality called by basic_json::accept" + - type: function_reference + name: "parser::sax_parse" + path: "include/nlohmann/detail/input/parser.hpp" + description: "called by parser::accept" + - type: function_reference + name: "parser::sax_parse_internal" + path: "include/nlohmann/detail/input/parser.hpp" + description: "called by parser::sax_parse" + - type: function_reference + name: "lexer::scan" + path: "include/nlohmann/detail/input/lexer.hpp" + description: "scans input, called in parser::sax_parse_internal" score: Jonas-Kirchhoff: 1.0 Erikhu1: 1.0