Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build backend failed - Error: Command failed with ENOMEM: yarn --version #13681

Closed
2 tasks done
kouz75 opened this issue Mar 30, 2024 · 22 comments
Closed
2 tasks done

Build backend failed - Error: Command failed with ENOMEM: yarn --version #13681

kouz75 opened this issue Mar 30, 2024 · 22 comments
Labels
bug Something isn't working p1 platform Issues tied to the general CLI platform platform-build Issues related to building resources with `amplify build`

Comments

@kouz75
Copy link

kouz75 commented Mar 30, 2024

How did you install the Amplify CLI?

yarn

If applicable, what version of Node.js are you using?

20.x

Amplify CLI Version

12.10.3

What operating system are you using?

Amazon linux 2023

Did you make any manual changes to the cloud resources managed by Amplify? Please describe the changes made.

No manual changes made

Describe the bug

build the backend on Amplify continous deployment failed

amplifyPush --simple return the error :

UPDATE_COMPLETE xxxx AWS::CloudFormation::Stack Sat Mar 30 2024 09:33:33 GMT+0000 (Coordinated Universal Time)
2024-03-30T09:33:56.664Z [INFO]: �[K
2024-03-30T09:33:57.460Z [WARNING]: ✖ There was an error initializing your environment.
2024-03-30T09:33:57.461Z [INFO]: 🛑 Received error [Error: Command failed with ENOMEM: yarn --version
spawn ENOMEM] running command [yarn --version]
2024-03-30T09:33:57.462Z [INFO]: Learn more at: https://docs.amplify.aws/cli/project/troubleshooting/

Cloudformation stack is update without any error.

I wasn't able to reproduce the error on other Amplify project but I don't understand why there is this error.

Expected behavior

project should deploy

Reproduction steps

deploy a branch via amplify console.
backend deployement crash.

Project Identifier

Project Identifier: ed57bb8a46476511162afa8497d78147

Log output

# Put your logs below this line


Additional information

No response

Before submitting, please confirm:

  • I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
  • I have removed any sensitive information from my code snippets and submission.
@kouz75 kouz75 added the pending-triage Issue is pending triage label Mar 30, 2024
@duckbytes
Copy link

I got this too, but managed to work around it by fixing the Amplify CLI version to 12.10.1 in Build settings.

@kouz75
Copy link
Author

kouz75 commented Mar 31, 2024

everything is building correctly today 🤷

@DuncanHouston
Copy link

I got this too, but managed to work around it by fixing the Amplify CLI version to 12.10.1 in Build settings.

Sadly encountered this too today. Rolling back to 12.10.1 worked, after rolling back to 12.10.2 didn't (current LATEST is 12.10.3). Funny thing is my build worked on 12.10.2 (I'm assuming) - 12 days ago, using LATEST, which was after 12.10.2 was released.

@ykethan
Copy link
Member

ykethan commented Apr 1, 2024

@DuncanHouston @kouz75 @duckbytes could you provide is the appId, region and failed build number to dive into the logs?

@ykethan ykethan added platform Issues tied to the general CLI platform pending-response Issue is pending response from the issue author labels Apr 1, 2024
@ggcespia
Copy link

ggcespia commented Apr 4, 2024

@ykethan (sorry for all the edits...)
I have the same issue. I tried backend: 12.10.3 w/ frontend: nvm use 18. Build 230 on qranswers (dxm5h4ts57z1x), us-east-1. backend failed.
2024-04-04T00:00:45.231Z [INFO]: 🛑 Received error [Error: Command failed with ENOMEM: yarn --version spawn ENOMEM] running command [yarn --version]

rolled back to backend: 12.10.1 and frontend: nvm use 18 Build 231 - backend failed with socket timeout
2024-04-04T00:18:10.709Z [INFO]: 🛑 Your socket connection to the server was not read from or written to within the timeout period. Idle connections will be closed.

rolled back to backend: 12.10.1 and frontend: nvm use 16, Build 232 - backend built fine, frontend built fine

231 seemed odd, so ... tried again - backend: 12.10.1 and frontend: nvm use 18, Build 233 - backend built fine, frontend built fine. So, the 'socket error' seems transient and not repeatable for Build 231 - since 233 and 231 were identical.

Build 230 has the issue with 12.10.3.

Let me know if you need further info to track this down

@duckbytes
Copy link

@ykethan

dlkp8fs0a5r7s
eu-west-1
Build 19

There are more than one backend. The name of the one that failed is jobye.

@DuncanHouston
Copy link

DuncanHouston commented Apr 4, 2024 via email

@kouz75
Copy link
Author

kouz75 commented Apr 4, 2024

hi,

sorry for the delay.
On my side, everything is working correctly now (I have switch back to default setting (use default nodejs version and default amplify version)).

@github-actions github-actions bot removed the pending-response Issue is pending response from the issue author label Apr 4, 2024
@Jay2113 Jay2113 added the platform-build Issues related to building resources with `amplify build` label Apr 4, 2024
@ykethan
Copy link
Member

ykethan commented Apr 4, 2024

Hey folks, could you add AMPLIFY_ENABLE_DEBUG_OUTPUT as true, retry with the latest Amplify CLI version and provide us the stack trace?
Could you provide us information the build image being used?
Do you observe any errors on CloudFormation or on a local push?

@ykethan ykethan added the pending-response Issue is pending response from the issue author label Apr 4, 2024
@djom202
Copy link

djom202 commented Apr 4, 2024

@ykethan, Sadly encountered this too from 3 days ago, also I'm running that you said.

Build image: Amazon Linux:2 image
Amplify CLI: latest
AMPLIFY_ENABLE_DEBUG_OUTPUT: true

I got this track trace:

2024-04-04T20:05:52.356Z [INFO]: �[K
2024-04-04T20:05:52.853Z [WARNING]: ✖ There was an error initializing your environment.
2024-04-04T20:05:52.855Z [INFO]: 🛑 Received error [Error: Command failed with ENOMEM: yarn --version
spawn ENOMEM] running command [yarn --version]
2024-04-04T20:05:52.855Z [INFO]: Learn more at: https://docs.amplify.aws/cli/project/troubleshooting/
ShellCommandExecutionError: Received error [Error: Command failed with ENOMEM: yarn --version
spawn ENOMEM] running command [yarn --version]
at execWithOutputAsString (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-cli-core/lib/utils/shell-utils.js:38:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async getYarnPackageManager (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-cli-core/lib/utils/packageManager.js:131:36)
at async getLayerGlobs (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-function/lib/provider-utils/awscloudformation/utils/layerHelpers.js:305:36)
at async hashLayerVersion (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-function/lib/provider-utils/awscloudformation/utils/layerHelpers.js:345:32)
at async hashLayerResource (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-function/lib/provider-utils/awscloudformation/utils/layerHelpers.js:275:12)
at async isBackendDirModifiedSinceLastPush (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:408:26)
at async /snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:266:45
at async asyncForEach (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:454:9)
at async /snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:255:9
at async asyncForEach (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:454:9)
at async getResourcesToBeUpdated (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:253:5)
at async AmplifyToolkit.getResourceStatus (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:122:32)
at async getAuthResourceName (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-auth/lib/utils/getAuthResourceName.js:5:30)
at async updateAppClientWithGeneratedSecret (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-auth/lib/provider-utils/awscloudformation/utils/generate-cognito-app-client-secret.js:13:38)
at async Object.run (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-provider-awscloudformation/lib/push-resources.js:274:5)

@ggcespia
Copy link

ggcespia commented Apr 4, 2024

Sorry, where do I put the AMPLIFY_ENABLE_DEBUG_OUTPUT true setting. My yaml file looks like this for the backend.
version: 1.4
backend:
phases:
preBuild:
commands:
- npm i -g @aws-amplify/[email protected]
build:
commands:
- '# Execute Amplify CLI with helper script'
- amplifyPush --simple

I have continuous deployment setup from GitHub.

@djom202
Copy link

djom202 commented Apr 4, 2024

Sorry, where do I put the AMPLIFY_ENABLE_DEBUG_OUTPUT true setting. My yaml file looks like this for the backend. version: 1.4 backend: phases: preBuild: commands: - npm i -g @aws-amplify/[email protected] build: commands: - '# Execute Amplify CLI with helper script' - amplifyPush --simple

I have continuous deployment setup from GitHub.

Into App settings > Environment variables > Manage Variables > Add Variable

@ggcespia
Copy link

ggcespia commented Apr 4, 2024

@ykethan
Build image: Amazon Linux:2 image
Amplify CLI: 12.10.3
AMPLIFY_ENABLE_DEBUG_OUTPUT: true
Build 234
dxm5h4ts57z1x
The local push works fine.

same issue as above:
2024-04-04T23:38:13.541Z [INFO]: �[K
2024-04-04T23:38:14.648Z [WARNING]: ✖ There was an error initializing your environment.
2024-04-04T23:38:14.649Z [INFO]: 🛑 Received error [Error: Command failed with ENOMEM: yarn --version
spawn ENOMEM] running command [yarn --version]
2024-04-04T23:38:14.650Z [INFO]: Learn more at: https://docs.amplify.aws/cli/project/troubleshooting/
ShellCommandExecutionError: Received error [Error: Command failed with ENOMEM: yarn --version
spawn ENOMEM] running command [yarn --version]
at execWithOutputAsString (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-cli-core/lib/utils/shell-utils.js:38:15)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async getYarnPackageManager (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-cli-core/lib/utils/packageManager.js:131:36)
at async getLayerGlobs (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-function/lib/provider-utils/awscloudformation/utils/layerHelpers.js:305:36)
at async hashLayerVersion (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-function/lib/provider-utils/awscloudformation/utils/layerHelpers.js:345:32)
at async hashLayerResource (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-function/lib/provider-utils/awscloudformation/utils/layerHelpers.js:275:12)
at async isBackendDirModifiedSinceLastPush (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:408:26)
at async /snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:266:45
at async asyncForEach (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:454:9)
at async /snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:255:9
at async asyncForEach (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:454:9)
at async getResourcesToBeUpdated (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:253:5)
at async AmplifyToolkit.getResourceStatus (/snapshot/amplify-cli/build/node_modules/@aws-amplify/cli-internal/lib/extensions/amplify-helpers/resource-status-data.js:122:32)
at async getAuthResourceName (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-auth/lib/utils/getAuthResourceName.js:5:30)
at async updateAppClientWithGeneratedSecret (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-category-auth/lib/provider-utils/awscloudformation/utils/generate-cognito-app-client-secret.js:13:38)
at async Object.run (/snapshot/amplify-cli/build/node_modules/@aws-amplify/amplify-provider-awscloudformation/lib/push-resources.js:274:5)
2024-04-04T23:38:14.665Z [INFO]:
2024-04-04T23:38:14.666Z [INFO]: Session Identifier: 09d4832f-0780-40ef-9b30-93aa075052b9

@ykethan
Copy link
Member

ykethan commented Apr 5, 2024

Hey folks, thank you for providing the information. The Amplify team is currently investigating this issue. We will provide an update here as soon as we get some additional information.
Marking as bug for further investigation.

@ykethan ykethan added bug Something isn't working and removed pending-response Issue is pending response from the issue author pending-triage Issue is pending triage labels Apr 5, 2024
@dpilch
Copy link
Member

dpilch commented Apr 5, 2024

We have what we believe to be the proper fix for the issue (aws-amplify/amplify-category-api#2426). We are having trouble reproducing the issue to properly test the fix. If anyone can provide the reproduction steps from a new project that would be very useful to us.

@dpilch
Copy link
Member

dpilch commented Apr 8, 2024

We have created a tagged release with the fix mentioned above. If anyone can use this to confirm this resolves the issue that would be greatly appreciated. However, please do not use this version in a production environment. This tagged release has not gone through the normal battery of tests. @aws-amplify/[email protected].

@ggcespia
Copy link

ggcespia commented Apr 8, 2024 via email

@dpilch
Copy link
Member

dpilch commented Apr 8, 2024

@ggcespia, thank you for testing the tagged release. We will continue to investigate the root cause of this issue.

@ykethan ykethan added the p1 label Apr 9, 2024
@djom202
Copy link

djom202 commented Apr 10, 2024

I got this too, but managed to work around it by fixing the Amplify CLI version to 12.10.1 in Build settings.

Sadly encountered this too today. Rolling back to 12.10.1 worked, after rolling back to 12.10.2 didn't (current LATEST is 12.10.3). Funny thing is my build worked on 12.10.2 (I'm assuming) - 12 days ago, using LATEST, which was after 12.10.2 was released.

Hi, Confirming successful build execution using Amplify CLI version 12.10.1 as previously mentioned.

@sobolk
Copy link
Member

sobolk commented Apr 18, 2024

The fix for this was shipped in version 12.11.1

@sobolk sobolk closed this as completed Apr 18, 2024
Copy link

This issue is now closed. Comments on closed issues are hard for our team to see.
If you need more assistance, please open a new issue that references this one.

@h4xmd
Copy link

h4xmd commented Jun 3, 2024

This issue is still happening.

Amplify 12.12.1
Node: v18.16.1

2024-05-31T00:15:14.747Z [WARNING]: ✖ There was an error initializing your environment.
2024-05-31T00:15:14.748Z [INFO]: 🛑 Received error [Error: Command failed with ENOMEM: yarn --version
spawn ENOMEM] running command [yarn --version]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working p1 platform Issues tied to the general CLI platform platform-build Issues related to building resources with `amplify build`
Projects
None yet
Development

No branches or pull requests

10 participants