Query test results from Sippy by version and test keywords
Queries OpenShift CI test results from Sippy by version and keywords, showing statistics and failed job run URLs.
/plugin marketplace add openshift-eng/ai-helpers/plugin install ci@ai-helpers<version> <keywords> [sippy-url]ci:query-test-result
/ci:query-test-result <version> <keywords> [sippy-url]
The ci:query-test-result command queries OpenShift CI test results from Sippy based on the OpenShift version and test name keywords. It retrieves test statistics including pass rate, number of runs, failures, and links to failed job runs.
By default, it queries the production Sippy instance at sippy.dptools.openshift.org. You can optionally specify a different Sippy instance URL to query alternative environments (e.g., QE component readiness).
This command is useful for:
$1 (version): OpenShift version to query (e.g., "4.21", "4.20", "4.19")$2 (keywords): Keywords to search in test names (e.g., "PolarionID:81664", "olmv1", "sig-storage")$3 (sippy-url) [optional]: Sippy instance base URL. Defaults to "sippy.dptools.openshift.org" if not provided. Examples: "qe-component-readiness.dptools.openshift.org"Parse Arguments
$1 (e.g., "4.21")$2 (e.g., "81664" or "olmv1")$3 if provided, otherwise use default "sippy.dptools.openshift.org"Build Sippy API Request
/api/tests endpoint:
filters = {
"items": [
{
"columnField": "name",
"not": False,
"operatorValue": "contains",
"value": keywords
}
],
"linkOperator": "and"
}
release: The OpenShift versionfilter: JSON-encoded filter objectsort: "asc"sortField: "net_improvement"Query Test Statistics
https://{base_url}/api/tests
https://sippy.dptools.openshift.org/api/testshttps://qe-component-readiness.dptools.openshift.org/api/testsQuery Failed Job Runs (for each matching test)
start_time = int((datetime.now() - timedelta(days=7)).timestamp() * 1000)filters = {
"items": [
{
"columnField": "failed_test_names",
"operatorValue": "contains",
"value": test_name
},
{
"columnField": "timestamp",
"operatorValue": ">",
"value": str(start_time)
}
],
"linkOperator": "and"
}
https://{base_url}/api/jobs/runs with parameters:
release: versionfilter: JSON-encoded filterlimit: "20"sortField: "timestamp"sort: "desc"{"rows": [...], "page": N, "page_size": N, "total_rows": N}response["rows"]timestamp: Unix timestamp in millisecondsbrief_name or job: Job nametest_grid_url: Link to Prow job detailsFormat and Display Results
Format: Formatted text output with:
Output Format Example:
Failed Job Runs (Last 7 Days):
1. 2025-11-03 12:12:31 - periodic-ci-openshift-operator-framework-...
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/...
2. 2025-11-02 12:12:29 - periodic-ci-openshift-operator-framework-...
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/...
If no tests match the keywords, inform the user that no results were found. If a test has no failed runs in the last 7 days, display a success message.
Query by Polarion ID (using default Sippy instance):
/ci:query-test-result 4.21 81664
Returns test results for tests containing "81664" in version 4.21 from the default production Sippy instance (sippy.dptools.openshift.org).
Query by test signature (using default Sippy instance):
/ci:query-test-result 4.20 olmv1
Returns all OLMv1-related test results for version 4.20 from the default Sippy instance.
Query from QE Sippy instance (custom URL):
/ci:query-test-result 4.20 olmv1 qe-component-readiness.dptools.openshift.org
Returns all OLMv1-related test results for version 4.20 from the QE component readiness Sippy instance.
Query by component with custom Sippy URL:
/ci:query-test-result 4.19 sig-storage sippy.dptools.openshift.org
Returns all storage-related test results for version 4.19 from the specified Sippy instance.
Custom URL variations (all valid formats):
/ci:query-test-result 4.21 olmv1 sippy.dptools.openshift.org
/ci:query-test-result 4.21 olmv1 https://sippy.dptools.openshift.org
Both URL formats are accepted and will query the same Sippy instance.
====================================================================================================
Test Results for PolarionID: 81664 (Version 4.21)
====================================================================================================
Test Name:
[sig-olmv1][Jira:OLM] clusterextension PolarionID:81664-[Skipped:Disconnected]preflight check
Statistics (Last 7 Days):
• Pass Rate: 0.00%
• Total Runs: 6
• Passes: 0
• Failures: 6
• Net Improvement: -100.00
Failed Job Runs (Last 7 Days):
----------------------------------------------------------------------------------------------------
1. 2025-11-03 12:12:31
Job: periodic-ci-openshift-operator-framework-operator-controller-release-4.21-periodics-e2e-aws-ovn-techpreview-extended-f1
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-operator-framework-operator-controller-release-4.21-periodics-e2e-aws-ovn-techpreview-extended-f1/1985198377557561344
2. 2025-11-02 12:12:29
Job: periodic-ci-openshift-operator-framework-operator-controller-release-4.21-periodics-e2e-aws-ovn-techpreview-extended-f1
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-operator-framework-operator-controller-release-4.21-periodics-e2e-aws-ovn-techpreview-extended-f1/1984835985292136448
[... additional failures ...]
----------------------------------------------------------------------------------------------------
Failed Prow URLs (for easy copying):
----------------------------------------------------------------------------------------------------
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-operator-framework-operator-controller-release-4.21-periodics-e2e-aws-ovn-techpreview-extended-f1/1985198377557561344
https://prow.ci.openshift.org/view/gs/test-platform-results/logs/periodic-ci-openshift-operator-framework-operator-controller-release-4.21-periodics-e2e-aws-ovn-techpreview-extended-f1/1984835985292136448
[... additional URLs ...]
====================================================================================================
sippy.dptools.openshift.org by default