...
Below API can be used to execute any AQL and obtain the desired results. AQL is custom query language built-in OpenSpecimen to allow power users perform complex queries on data without requiring to know anything about the OpenSpecimen data model.
...
Code Block |
---|
{
"cpId": <cpId>,
"aql": <AQL>,
"wideRowMode": <OFF|SHALLOW|DEEP>,
"outputColumnExprs": <true|false>,
"outputIsoDateTime": <true|false>
} |
...
Parameters
...
Specifies whether multi-valued attributes result in a single row or one row per value. Default value is OFF. Other permitted values are SHALLOW and DEEP. Try out to see what fits best for your use case.
...
Example
Given below is an example query request to obtain count of aliquots by visit dates:
Code Block | ||
---|---|---|
| ||
{
"cpId": 1,
"aql": "select Participant.ppid, SpecimenCollectionGroup.collectionDate, count(distinct Specimen.id) where Specimen.lineage = \"Aliquot\"",
"outputIsoDateTime": true
} |
Sample response:
...
collapse | true |
---|
...
Table of Contents |
---|
Executing Any AQL
Below API can be used to execute any AQL and obtain the desired results. AQL is custom query language built-in OpenSpecimen to allow power users perform complex queries on data without requiring to know anything about the OpenSpecimen data model.
Item | Value | ||
---|---|---|---|
HTTP Method | POST | ||
URI | /rest/ng/query | ||
Body |
| ||
Response | JSON containing desired results |
Parameters
Parameter | Description |
---|---|
cpId | Collection protocol ID. If specified, limits the results to specified CP records. Useful when AQL contains CP specific custom fields. |
aql | Valid AQL string that needs to be executed |
wideRowMode | Specifies whether multi-valued attributes result in a single row or one row per value. Default value is OFF. Other permitted values are SHALLOW and DEEP. Try out to see what fits best for your use case. |
outputColumnExprs | Specifies whether the column labels or AQL expression needs to be included in the query response. By default, user friendly column labels are included in query response. |
outputIsoDateTime | Specifies how the date column values needs to be serialised in the query response. If true, then date/time values are serialised using ISO format: yyyy-MM-dd'T'HH:mm:ss. Otherwise, date/time values are serialised using the format specified in OS locale settings |
timeoutInSeconds | Specifies how long to wait for the query to complete before aborting it. When not specified, this field defaults to 55 seconds. This is a guard against the run away query that hog the system resources, eventually resulting in service disruption. To wait forever for the query to complete, use -1. This should be avoided unless you are aware about the consequences of allowing a runaway query. |
Example
Given below is an example query request to obtain count of aliquots by visit dates:
Code Block | ||
---|---|---|
| ||
{
"cpId": 1,
"aql": "select Participant.ppid, SpecimenCollectionGroup.collectionDate, count(distinct Specimen.id) where Specimen.lineage = \"Aliquot\"",
"outputIsoDateTime": true
} |
Sample response
Code Block | ||
---|---|---|
| ||
{
"columnMetadata": [
{
"expr": "Participant.ppid",
"aggregate": false
},
{
"expr": "SpecimenCollectionGroup.collectionDate",
"aggregate": false
},
{
"expr": "count ( distinct Specimen.id )",
"aggregate": true
}
],
"columnLabels": [
"Participant# PPID",
"Visit# Visit Date",
"Column"
],
"columnTypes": [
"STRING",
"DATE",
"INTEGER"
],
"columnUrls": [
"#/object-state-params-resolver?stateName=participant-detail.overview&objectName=collection_protocol_registration&key=id&value={{$cprId}}",
null,
null
],
"rows": [
[
"OPSMN-0001-TCP",
"2015-06-04T00:00:00",
"184"
],
[
"OPSMN-0001-TCP",
"2016-06-30T11:30:00",
"25"
],
[
"OPSMN-0003-TCP",
"2015-05-05T00:00:00",
"107"
],
[
"OPSMN-0003-TCP",
"2015-05-19T00:00:00",
"17"
],
[
"OPSMN-0003-TCP",
"2015-07-24T00:00:00",
"4"
],
[
"OPSMN-0003-TCP",
"2015-08-17T00:00:00",
"5"
],
...
]
} |
Getting List of all saved-queries
Request Details
Item | Value |
---|---|
HTTP Method | GET |
URI | /rest/ng/saved-queries |
Response | JSON containing detailed list of saved queries |
Parameters
Parameter | Description |
---|---|
cpId | The cpId is used to filter the saved queries based on the CP. This is helpful in running the queries in background using scheduled jobs for initialisation of CP specific custom fields/forms. Note: This is the CP that you select in the top-left dropdown of the add/edit query wizard. |
searchString | Matches a substring in the title of the saved query. |
start | Used for paginating the results. If start=5, the output result will start from row number 5. |
max | Used for paginating the results. If max=10, the output result will be maximum 10 rows |
countReq | Boolean type parameter, if specified as 'true' output will show the total number of saved-queries. Otherwise it won't. |
Sample response
Get URL: 'rest/ng/saved-queries?countReq=true&start=0&max=10'
Code Block | ||||
---|---|---|---|---|
| ||||
{ "count": 23, "queries": [ { "exprid": "count ( distinct Specimen.id )"23, "aggregatetitle": true "Show details of tissue specimen having frozen event", } ], "columnLabelscreatedBy": [{ "Participant# PPID", "id"Visit# Visit Date": 1, "Column" ], "columnTypestype": [null, "STRING", "firstName": "DATESystem", "INTEGER" ], "columnUrlslastName": [null, "#/object-state-params-resolver?stateName=participant-detail.overview&objectName=collection_protocol_registration&key=id&value={{$cprId}}", "loginName": null, null "domain": ]null, "rows": [ "emailAddress": null, [ "OPSMN-0001-TCP"instituteName": null, "2015-06-04T00:00:00", "primarySite": null, "184" ]"admin": null, [ "instituteAdmin": null, "OPSMN-0001-TCP", "manageForms"2016-06-30T11:30:00", : null, "25" ]"cpCount": 0, [ "creationDate": null, "OPSMN-0003-TCP", "2015-05-05T00:00:00",activityStatus": null "107"}, ], "lastModifiedBy": { [ "OPSMN-0003-TCP",id": 1, "2015-05-19T00:00:00", "type": null, "17" ]"firstName": "System", [ "lastName": null, "OPSMN-0003-TCP", "loginName"2015-07-24T00:00:00": null, "4" "domain": null, ], [ "emailAddress": null, "OPSMN-0003-TCP", "instituteName": null, "2015-08-17T00:00:00", "5primarySite": null, ], "admin": null, ... ] } |
Getting List of all saved-queries
Request Details
...
Parameters
...
searchString
...
start
...
Used for paginating the results. If start=5, the output result will start from row number 5.
...
max
...
countReq
...
Sample response
Get URL: 'rest/ng/saved-queries?countReq=true&start=0&max=10'
Code Block | ||||
---|---|---|---|---|
| ||||
{ "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "countactivityStatus": 23null }, "queries": [ "lastModifiedOn": 1575273075000 }, { "id": 2322, "title": "Show detailslist of tissue specimen having frozen event specimens frozen within 15 mins of received time", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273075000 }, { "id": 2221, "title": "Show list of tissue specimens frozenstored withinin 15 mins of received timea Container", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273075000 }, { "id": 2120, "title": "Show list of specimensSpecimens storedbased inon aSCG ContainerLabel", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273075000 }, { "id": 2019, "title": "Show list of Specimensspecimens based on SCGparticipant Labeldemographics", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 15752730750001575273074000 }, { "id": 1918, "title": "Show list of specimensSpecimens based on participant demographics info (PPID or MRN)", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273074000 }, { "id": 1817, "title": "Show listspecimen of Specimensinformation based on participant info (PPID or MRN)Specimen Label", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273074000 }, { "id": 1716, "title": "Show specimen information based on Specimen LabelSpecimen kit report query", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273074000 }, { "id": 1615, "title": "Specimen kit report queryCatalog", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 15752730740001575273073000 }, { "id": 1514, "title": "Specimen CatalogShow list of specimens based on specimen details", "createdBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedBy": { "id": 1, "type": null, "firstName": "System", "lastName": null, "loginName": null, "domain": null, "emailAddress": null, "instituteName": null, "primarySite": null, "admin": null, "instituteAdmin": null, "manageForms": null, "cpCount": 0, "creationDate": null, "activityStatus": null }, "lastModifiedOn": 1575273073000 } ] } |
Executing Saved Query
Request Details
Item | Value | |||||
---|---|---|---|---|---|---|
HTTP Method | POST | |||||
URI | /rest/ng/query/{savedQueryId} | |||||
Body |
|
...
|
...
| |
Response | JSON containing the output of the saved queries |
Parameters
Note: The savedQueryId placeholder should be replaced with the actual ID of the saved query.
Parameter | Description | Allowed Values |
---|---|---|
drivingForm | Driving form determines the search perspective. When left empty, it defaults to Participant. (For example when drivingForm is Participant, the root table is 'catissue_coll_prot_reg' which is then used to join with the other tables.Similarly when drivingForm is Specimen, the root table will be catissue_specimen, which will be joined with the other tables.) | Participant, Specimen |
startAt | Used for paginating the results. If startAt=5, the output result will startAt from row number 5. | Integer |
maxResults | Used for paginating the results. If maxResults=10, the output result will be maximum 10 rows | Integer |
wideRowMode | Specifies whether multi-valued attributes result in a single row or one row per value. Default value is OFF. Other permitted values are SHALLOW and DEEP. Try out to see what fits best for your use case. | DEEP, SHALLOW, OFF |
Sample response
Code Block | ||||
---|---|---|---|---|
| ||||
{ "columnMetadata": [ "emailAddress": null, { "instituteNameexpr": null"CollectionProtocol.Title", "primarySiteaggregate": null,false }, "admin": null, { "instituteAdminexpr": null, "Participant.ppid", "manageFormsaggregate": null,false }, "cpCount": 0, { "creationDateexpr": null"Participant.gender", "activityStatusaggregate": null false }, "lastModifiedBy": { "idexpr": 1, "Participant.medicalRecord.medicalRecordNumber", "typeaggregate": null,false }, "firstName": "System", { "lastNameexpr": null, "Participant.medicalRecord.mrnSiteName", "loginNameaggregate": null,false }, "domain": null, { "emailAddressexpr": null"Participant.race", "instituteNameaggregate": null,false }, "primarySite": null, { "adminexpr": null"SpecimenCollectionGroup.name", "instituteAdminaggregate": null,false }, "manageForms": null, { "cpCountexpr": 0"SpecimenCollectionGroup.clinicalDiagnosis", "creationDateaggregate": false null, }, "activityStatus":{ null }"expr": "SpecimenCollectionGroup.site", "lastModifiedOnaggregate": 1575273073000false }, ] } |
Execute a saved-query from API
Request Details
...
Code Block | ||
---|---|---|
| ||
{
"drivingForm":"Participant",
"runType":"Count",
"wideRowMode": "DEEP",
"startAt": 0,
"maxResults": 20
} |
...
Parameters
...
runType
...
drivingForm
...
startAt
...
Used for paginating the results. If startAt=5, the output result will startAt from row number 5.
...
maxResults
...
wideRowMode
...
Specifies whether multi-valued attributes result in a single row or one row per value. Default value is OFF. Other permitted values are SHALLOW and DEEP. Try out to see what fits best for your use case.
...
Sample response
Code Block | ||||
---|---|---|---|---|
| ||||
{ "columnMetadata": [ { "expr": "Specimen.label", "aggregate": false }, { "expr": "Specimen.extensions.SpecimenCollectionEvent.time", "aggregate": false }, { "expr": "CollectionProtocolSpecimen.Titleclass", "aggregate": false }, { "expr": "ParticipantSpecimen.ppidtype", "aggregate": false }, { "expr": "ParticipantSpecimen.specimenPosition.gendercontainerName", "aggregate": false }, { "expr": "ParticipantSpecimen.medicalRecordspecimenPosition.medicalRecordNumberpositionDimensionOneString", "aggregate": false }, { "expr": "ParticipantSpecimen.medicalRecordspecimenPosition.mrnSiteNamepositionDimensionTwoString", "aggregate": false }, { "expr": "ParticipantSpecimen.racepathologicalStatus", "aggregate": false }, { "expr": "SpecimenCollectionGroupSpecimen.nametissueSite", "aggregate": false }, { "expr": "SpecimenCollectionGroupSpecimen.clinicalDiagnosisavailableQty", "aggregate": false } ], "columnLabels": [ { "Collection Protocol# Title", "expr": "SpecimenCollectionGroup.site", "Participant# PPID", "aggregateParticipant# Gender":, false "Participant# }MRN", {"Participant# MRN Site", "expr":Participant# Race"Specimen.label", "Visit# Name", "aggregate": false "Visit# Clinical Diagnosis }(Deprecated)", {"Visit# Visit Site", "expr":Specimen# "Specimen.extensions.SpecimenCollectionEvent.timeSpecimen Label", "Specimen# Collection Event# Date and Time"aggregate":, false "Specimen# }Class", {"Specimen# Type", "Specimen# "expr": "Specimen.classContainer Name", "Specimen# Container "aggregate": falseColumn", "Specimen# Container }Row", {"Specimen# Pathological Status", "Specimen# Anatomic "expr": "Specimen.type"Site", "aggregate": false "Specimen# Available Quantity" }], "columnTypes": [ { "STRING", "expr": "Specimen.specimenPosition.containerNameSTRING", "STRING", "aggregate": false "STRING", }, "STRING", { "STRING", "expr": "Specimen.specimenPosition.positionDimensionOneStringSTRING", "STRING", "aggregate": false "STRING", }, "STRING", { "DATE", "expr": "Specimen.specimenPosition.positionDimensionTwoString", STRING", "aggregateSTRING":, false }"STRING", { "STRING", "expr": "Specimen.pathologicalStatusSTRING", "aggregateSTRING":, false }"STRING", {"FLOAT" ], "exprcolumnUrls": "Specimen.tissueSite",[ "#/object-state-params-resolver?stateName=cp-detail.overview&objectName=collection_protocol&key=title&value={{$value}}", "aggregate": false }"#/object-state-params-resolver?stateName=participant-detail.overview&objectName=collection_protocol_registration&key=id&value={{$cprId}}", {null, "expr": "Specimen.availableQty"null, "aggregate": false"#/object-state-params-resolver?stateName=site-detail.overview&objectName=site&key=name&value={{$value}}", } ], null, "columnLabels": [ "Collection Protocol# Title", "Participant# PPID"#/object-state-params-resolver?stateName=visit-detail.overview&objectName=visit&key=name&value={{$value}}", "Participant# Gender"null, "Participant# MRN#/object-state-params-resolver?stateName=site-detail.overview&objectName=site&key=name&value={{$value}}", "Participant# MRN Site#/object-state-params-resolver?stateName=specimen-detail.overview&objectName=specimen&key=id&value={{$specimenId}}", "Participant# Race"null, "Visit# Name"null, "Visit# Clinical Diagnosis (Deprecated)"null, "Visit# Visit Site",#/object-state-params-resolver?stateName=container-detail.locations&objectName=storage_container&key=name&value={{$value}}", null, "Specimen# Specimen Label", null, "Specimen# Collection Event# Date and Time"null, "Specimen# Class"null, "Specimen#null Type", ], "rows"Specimen#: [ Container Name", [ "Specimen# Container Column", "Specimen#TCP", Container Row", "Specimen# Pathological Status "$$cp_reg_1$$", "Specimen# Anatomic Site"null, "Specimen# Available Quantity" null, ], "columnTypes": [ null, "STRING", null, "STRING", "STRING$$cp_visit_1$$", "STRING", null, "STRING", "STRINGPune Site", "STRING0000004", "STRING", "02-12-2019 16:03", "STRING", "STRINGFluid", "DATE", "Buffy Coat", "STRING", "STRINGtest_box1", "STRING4", "STRING",1", "STRINGNot Specified", "STRING", "Not Specified", "STRING", "FLOAT6.00" ], ] "columnUrls": [ ], "#/object-state-params-resolver?stateName=cp-detail.overview&objectName=collection_protocol&key=title&value={{$value}}", columnIndices": null, "#/object-state-params-resolver?stateName=participant-detail.overview&objectName=collection_protocol_registration&key=id&value={{$cprId}}", null, null, "#/object-state-params-resolver?stateName=site-detail.overview&objectName=site&key=name&value={{$value}}", null, "#/object-state-params-resolver?stateName=visit-detail.overview&objectName=visit&key=name&value={{$value}}", null, "#/object-state-params-resolver?stateName=site-detail.overview&objectName=site&key=name&value={{$value}}", "#/object-state-params-resolver?stateName=specimen-detail.overview&objectName=specimen&key=id&value={{$specimenId}}", null, null, null, "#/object-state-params-resolver?stateName=container-detail.locations&objectName=storage_container&key=name&value={{$value}}", null, null, null, null, null ], "rows": [ [ "TCP", "$$cp_reg_1$$", null, null, null, null, "$$cp_visit_1$$", null, "Pune Site", "0000004", "02-12-2019 16:03", "Fluid", "Buffy Coat", "test_box1", "4", "1", "Not Specified", "Not Specified", "6.00" ] ], "columnIndices": null, "dbRowsCount": 1 }dbRowsCount": 1 } |
Exporting Query Data
Request
Method | POST | |||||
URL | rest/ng/query/export | |||||
Body |
| |||||
Response |
|
Parameters
aql | Valid AQL query whose output needs to be exported to a CSV file |
dataFile | Handle or file ID to use for downloading the exported CSV file |
completed | Boolean indicating whether the exported CSV file can be downloaded right away |
Download Exported Data File
Request
Method | GET | |||||
URL | rest/ng/query/export?fileId=<dataFile> | |||||
Response | Scenario 1: When the exported data file is not ready HTTP 400 with the following error message in the response body
Scenario 2: When the exported data file is ready HTTP 200 with the ZIP binary stream in the response body |
Parameters
fileId | The handle or file ID returned by the export API |
Query Export in Action
Initiate Export
Download Exported File - Attempt 1 of N
Download Exported File
FAQ
Let’s assume we've the following data:
A specimen record with label L
Specimen L has 2 biohazards - H1, H2
Specimen L has 2 frozen events F1, F2
Output includes specimen label (L), biohazards, and one or more fields of frozen event.
- What does OFF, SHALLOW and DEEP do? What are the differences between them?
Let's assume we've a specimen record L with biohazards H1 and H2. Also, let's assume the specimen L has 2 frozen events F1 and F2.Using above, it is easy to explain the various wide row modes:
- wideRowMode = OFF. There will be one row for each combination of biohazard and frozen event. That is -
(L, H1, F1), (L, H1, F2), (L, H2, F1), (L, H2, F2)
- wideRowMode = SHALLOW. There will be one row for each frozen event. That is -
(L, H1, H2, F1), (L, H1, H2, F2)
- wideRowMode = DEEP. There will be one row for each specimen irrespective of the number of biohazards and frozen events. That is -
(L, H1, H2, F1, F2)
- wideRowMode = OFF. There will be one row for each combination of biohazard and frozen event. That is -
Why is it so hard to get the same results from the same query in both the API and in OpenSpecimen?
The UI uses either SHALLOW or DEEP. It does not use OFF.
When the “Enable Wide Rows” checkbox is ticked, the wideRowMode=DEEP. When it is unticked, wideRowMode=SHALLOW.