Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataflow endpoint /jobs/executions not exhaustive #5499

Open
michoudu13820 opened this issue Oct 6, 2023 · 0 comments
Open

Dataflow endpoint /jobs/executions not exhaustive #5499

michoudu13820 opened this issue Oct 6, 2023 · 0 comments
Labels
status/need-investigation Oh need to look under a hood

Comments

@michoudu13820
Copy link

I upgrated to Dataflow 2.11.0 to use it with my springboot2 & 3 apps.

Problem :
When calling the endpoint /jobs/executions/17?schemaTarget=boot3 I am getting the same anwser as previous version but I do not get the field contextExecution in the object jobExecution populated, it is marked as empty (the filed empty is at true) but the context is present/insert in database..

Am I using the wrong endpoint or doing it the wrong way ?

Context :
Table boot3_batch_job_execution_context :
job_execution_id|short_context |serialized_context|
----------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+------------------
16|rO0ABXNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAADdAAEdGVzdHQAKWNlY2kgZXN0IHVuIHRlc3QgZCdham91dCBkZSBsJ2FmdGVyIGNodW5rdAALQUFBQUFBQUFBQUF0AA5ISVpIRlpJSEZJT1pGSnQADWJhdGNoLnZlcnNpb250AAU1LjAuMng= | |
17|rO0ABXNyABFqYXZhLnV0aWwuSGFzaE1hcAUH2sHDFmDRAwACRgAKbG9hZEZhY3RvckkACXRocmVzaG9sZHhwP0AAAAAAAAx3CAAAABAAAAAEdAAFdGVzdDJ0ACljZWNpIGVzdCB1biB0ZXN0IGQnYWpvdXQgZGUgbCdhZnRlciBjaHVua3QABHRlc3R0AChjZWNpIGVzdCB1biB0ZXN0IGR1IGJlZm9yZUNodW5jayBkJ2Fqb3V0dAALQUFBQUF| |

But the response of the endpoint /jobs/executions/17?schemaTarget=boot3

  "executionId": 17,
  "stepExecutionCount": 1,
  "jobId": 15,
  "taskExecutionId": 16,
  "name": "jobTemplateExemple",
  "startDate": "2023-10-06",
  "startTime": "07:53:04",
  "duration": "00:00:01",
  "jobExecution": {
    "id": 17,
    "version": 2,
    "jobParameters": {
      "parameters": {
        "run.id": {
          "identifying": true,
          "value": 13.0,
          "type": "DOUBLE"
        }
      }
    },
    "jobInstance": {
      "id": 15,
      "jobName": "jobTemplateExemple",
      "version": null
    },
    "stepExecutions": [
      {
        "stepName": "step1TemplateExemple",
        "id": 15,
        "version": 3,
        "status": "COMPLETED",
        "readCount": 3,
        "writeCount": 2,
        "commitCount": 1,
        "rollbackCount": 1,
        "readSkipCount": 0,
        "processSkipCount": 1,
        "writeSkipCount": 0,
        "startTime": "2023-10-06T09:53:05.302+0200",
        "endTime": "2023-10-06T09:53:06.004+0200",
        "lastUpdated": "2023-10-06T09:53:06.005+0200",
        "executionContext": {
          "dirty": false,
          "empty": true,
          "values": [
            
          ]
        },
        "exitStatus": {
          "exitCode": "COMPLETED",
          "exitDescription": ""
        },
        "terminateOnly": false,
        "filterCount": 0,
        "failureExceptions": [
          
        ],
        "jobExecutionId": 17,
        "jobParameters": {
          "parameters": {
            "run.id": {
              "identifying": true,
              "value": 13.0,
              "type": "DOUBLE"
            }
          }
        },
        "skipCount": 1,
        "summary": "StepExecution: id=15, version=3, name=step1TemplateExemple, status=COMPLETED, exitStatus=COMPLETED, readCount=3, filterCount=0, writeCount=2 readSkipCount=0, writeSkipCount=0, processSkipCount=1, commitCount=1, rollbackCount=1"
      }
    ],
    "status": "COMPLETED",
    "startTime": "2023-10-06T09:53:04.423+0200",
    "createTime": "2023-10-06T09:53:04.231+0200",
    "endTime": "2023-10-06T09:53:06.138+0200",
    "lastUpdated": "2023-10-06T09:53:06.191+0200",
    "exitStatus": {
      "exitCode": "COMPLETED",
      "exitDescription": ""
    },
    "executionContext": {
      "dirty": false,
      "empty": true,
      "values": [
        
      ]
    },
    "failureExceptions": [
      
    ],
    "jobConfigurationName": null,
    "allFailureExceptions": [
      
    ]
  },
  "jobParameters": {
    "run.id(double)": "13.0"
  },
  "jobParametersString": "run.id(double)=13.0",
  "restartable": false,
  "abandonable": false,
  "stoppable": false,
  "defined": true,
  "timeZone": "UTC",
  "schemaTarget": "boot3",
  "_links": {
    "self": {
      "href": "jobs/executions/16?schemaTarget=boot3"
    }
  }
}
@onobc onobc transferred this issue from spring-cloud/spring-cloud-dataflow-samples Oct 6, 2023
@github-actions github-actions bot added the status/need-triage Team needs to triage and take a first look label Oct 6, 2023
@cppwfs cppwfs added status/need-investigation Oh need to look under a hood and removed status/need-triage Team needs to triage and take a first look labels Oct 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status/need-investigation Oh need to look under a hood
Projects
None yet
Development

No branches or pull requests

3 participants