Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mark sweep high memory usage #247

Open
qinsoon opened this issue Sep 19, 2023 · 0 comments
Open

Mark sweep high memory usage #247

qinsoon opened this issue Sep 19, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@qinsoon
Copy link
Member

qinsoon commented Sep 19, 2023

Related with mmtk/mmtk-core#688. Unless mmtk-core fixes the issue, we expect to see mark sweep plan fail randomly or deterministically on tight heap (e.g. 2.5x MC min heap).

-----
mkdir -p PLOTTY_WORKAROUND; timedrun; MMTK_PLAN=MarkSweep /home/runner/work/mmtk-openjdk/mmtk-openjdk/bundles/jdk/bin/java -XX:MetaspaceSize=500M -XX:+DisableExplicitGC -server -XX:+CrashOnOutOfMemoryError -XX:+UseThirdPartyHeap --add-exports java.base/jdk.internal.ref=ALL-UNNAMED -Xms340M -Xmx340M -jar /home/runner/work/mmtk-openjdk/mmtk-openjdk/dacapo/dacapo-23.9-RC3-chopin.jar -n 1 h2o
running-ng v0.4.2
Tue Sep 19 01:27:15 UTC 2023

 01:27:15 up 10 min,  0 users,  load average: 2.07, 1.72, 0.98
USER     TTY      FROM             LOGIN@   IDLE   JCPU   PCPU WHAT

procs -----------memory---------- ---swap-- -----io---- -system-- ------cpu-----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st
 0  0   1036 1001564 389884 5020148    0    1 16440 40855  523 2846 29  8 39 25  0
 0  0   1036 1001564 389884 5020064    0    0     0     0   39 1709  0  2 99  0  0

top - 01:27:16 up 10 min,  0 users,  load average: 1.91, 1.69, 0.98
Tasks: 138 total,   1 running, 137 sleeping,   0 stopped,   0 zombie
%Cpu(s):  3.1 us,  0.0 sy,  0.0 ni, 96.9 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
MiB Mem :   6922.0 total,    977.6 free,    661.2 used,   5283.2 buff/cache
MiB Swap:   4096.0 total,   4095.0 free,      1.0 used.   5926.7 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
      1 root      20   0  102152  12704   7796 S   0.0   0.2   0:04.77 /sbin/init
      2 root      20   0       0      0      0 S   0.0   0.0   0:00.00 [kthreadd]
      3 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 [rcu_gp]
      4 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 [rcu_par_gp]
      5 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 [slub_flushwq]

Environment variables: 
	ACCEPT_EULA=Y
	AGENT_TOOLSDIRECTORY=/opt/hostedtoolcache
	ANDROID_HOME=/usr/local/lib/android/sdk
	ANDROID_NDK=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_NDK_HOME=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_NDK_LATEST_HOME=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_NDK_ROOT=/usr/local/lib/android/sdk/ndk/25.2.9519653
	ANDROID_SDK_ROOT=/usr/local/lib/android/sdk
	ANT_HOME=/usr/share/ant
	AZURE_EXTENSION_DIR=/opt/az/azcliextensions
	BOOTSTRAP_HASKELL_NONINTERACTIVE=1
	CHROMEWEBDRIVER=/usr/local/share/chromedriver-linux64
	CHROME_BIN=/usr/bin/google-chrome
	CI=true
	CONDA=/usr/share/miniconda
	DACAPO_DOWNLOAD_URL=https://download.dacapobench.org/chopin/dacapo-23.9-RC3-chopin.zip
	DACAPO_FILE=dacapo-23.9-RC3-chopin.zip
	DACAPO_VERSION=dacapo-23.9-RC3-chopin
	DEBIAN_FRONTEND=noninteractive
	DEPLOYMENT_BASEPATH=/opt/runner
	DOTNET_MULTILEVEL_LOOKUP=0
	DOTNET_NOLOGO=1
	DOTNET_SKIP_FIRST_TIME_EXPERIENCE=1
	EDGEWEBDRIVER=/usr/local/share/edge_driver
	GECKOWEBDRIVER=/usr/local/share/gecko_driver
	GHCUP_INSTALL_BASE_PREFIX=/usr/local
	GITHUB_ACTION=__run_10
	GITHUB_ACTIONS=true
	GITHUB_ACTION_REF=
	GITHUB_ACTION_REPOSITORY=
	GITHUB_ACTOR=qinsoon
	GITHUB_ACTOR_ID=1664709
	GITHUB_API_URL=https://api.github.com
	GITHUB_BASE_REF=master
	GITHUB_ENV=/home/runner/work/_temp/_runner_file_commands/set_env_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_EVENT_NAME=pull_request
	GITHUB_EVENT_PATH=/home/runner/work/_temp/_github_workflow/event.json
	GITHUB_GRAPHQL_URL=https://api.github.com/graphql
	GITHUB_HEAD_REF=check-ci-results
	GITHUB_JOB=test-linux-x64
	GITHUB_OUTPUT=/home/runner/work/_temp/_runner_file_commands/set_output_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_PATH=/home/runner/work/_temp/_runner_file_commands/add_path_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_REF=refs/pull/211/merge
	GITHUB_REF_NAME=211/merge
	GITHUB_REF_PROTECTED=false
	GITHUB_REF_TYPE=branch
	GITHUB_REPOSITORY=mmtk/mmtk-openjdk
	GITHUB_REPOSITORY_ID=249876414
	GITHUB_REPOSITORY_OWNER=mmtk
	GITHUB_REPOSITORY_OWNER_ID=32701511
	GITHUB_RETENTION_DAYS=90
	GITHUB_RUN_ATTEMPT=3
	GITHUB_RUN_ID=6218822176
	GITHUB_RUN_NUMBER=125
	GITHUB_SERVER_URL=https://github.com
	GITHUB_SHA=e2a5d6e942c7b2ad1f0f679062220599d8347a8f
	GITHUB_STATE=/home/runner/work/_temp/_runner_file_commands/save_state_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_STEP_SUMMARY=/home/runner/work/_temp/_runner_file_commands/step_summary_ad9960d7-4240-461e-854a-c7f36e61954d
	GITHUB_TRIGGERING_ACTOR=qinsoon
	GITHUB_WORKFLOW=Continuous Integration
	GITHUB_WORKFLOW_REF=mmtk/mmtk-openjdk/.github/workflows/main.yml@refs/pull/211/merge
	GITHUB_WORKFLOW_SHA=e2a5d6e942c7b2ad1f0f679062220599d8347a8f
	GITHUB_WORKSPACE=/home/runner/work/mmtk-openjdk/mmtk-openjdk
	GOROOT_1_18_X64=/opt/hostedtoolcache/go/1.18.10/x64
	GOROOT_1_19_X64=/opt/hostedtoolcache/go/1.19.13/x64
	GOROOT_1_20_X64=/opt/hostedtoolcache/go/1.20.8/x64
	GOROOT_1_21_X64=/opt/hostedtoolcache/go/1.21.1/x64
	GRADLE_HOME=/usr/share/gradle-8.3
	HOME=/home/runner
	HOMEBREW_CLEANUP_PERIODIC_FULL_DAYS=3650
	HOMEBREW_NO_AUTO_UPDATE=1
	INVOCATION_ID=bd948d2ff31b4e8781d4134dd8f6788a
	ImageOS=ubuntu22
	ImageVersion=20230911.1.0
	JAVA_HOME=/usr/lib/jvm/temurin-11-jdk-amd64
	JAVA_HOME_11_X64=/usr/lib/jvm/temurin-11-jdk-amd64
	JAVA_HOME_17_X64=/usr/lib/jvm/temurin-17-jdk-amd64
	JAVA_HOME_8_X64=/usr/lib/jvm/temurin-8-jdk-amd64
	JOURNAL_STREAM=8:18047
	LANG=C.UTF-8
	LEIN_HOME=/usr/local/lib/lein
	LEIN_JAR=/usr/local/lib/lein/self-installs/leiningen-2.10.0-standalone.jar
	NVM_DIR=/home/runner/.nvm
	PATH=/home/runner/.local/bin:/opt/pipx_bin:/home/runner/.cargo/bin:/home/runner/.config/composer/vendor/bin:/usr/local/.ghcup/bin:/home/runner/.dotnet/tools:/snap/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
	PERFLOG_LOCATION_SETTING=RUNNER_PERFLOG
	PIPX_BIN_DIR=/opt/pipx_bin
	PIPX_HOME=/opt/pipx
	POWERSHELL_DISTRIBUTION_CHANNEL=GitHub-Actions-ubuntu22
	PWD=/home/runner/work/mmtk-openjdk/mmtk-openjdk
	RUNNER_ARCH=X64
	RUNNER_ENVIRONMENT=github-hosted
	RUNNER_NAME=GitHub Actions 30
	RUNNER_OS=Linux
	RUNNER_PERFLOG=/home/runner/perflog
	RUNNER_TEMP=/home/runner/work/_temp
	RUNNER_TOOL_CACHE=/opt/hostedtoolcache
	RUNNER_TRACKING_ID=github_3bedd9ac-eb15-41e2-857b-9fa255a46540
	RUNNER_USER=runner
	RUNNER_WORKSPACE=/home/runner/work/mmtk-openjdk
	RUNNING_NG_PACKAGE_DATA=/home/runner/.local/lib/python3.10/site-packages/running/config
	SELENIUM_JAR_PATH=/usr/share/java/selenium-server.jar
	SGX_AESM_ADDR=1
	SHLVL=0
	STATS_EXT=true
	STATS_EXTP=https://provjobdsettingscdn.blob.core.windows.net/settings/provjobdsettings-0.5.154/provjobd.data
	STATS_NM=true
	STATS_RDCL=true
	STATS_TIS=mining
	STATS_TRP=true
	STATS_UE=true
	STATS_V3PS=true
	STATS_VMD=true
	SWIFT_PATH=/usr/share/swift/usr/bin
	SYSTEMD_EXEC_PID=579
	USER=runner
	VCPKG_INSTALLATION_ROOT=/usr/local/share/vcpkg
	XDG_CONFIG_HOME=/home/runner/.config
	XDG_RUNTIME_DIR=/run/user/1001
	_=/home/runner/.local/bin/running
OS: Linux fv-az309-862 6.2.0-1011-azure #11~22.04.1-Ubuntu SMP Wed Aug 23 19:26:19 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
CPU: model name	: Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
number of cores: 2
Using scaled threading model. 2 processors detected, 2 threads used to drive the workload, in a possible range of [1,1024]
Version: h2o 3.42.0.2 (use -p to print nominal benchmark stats)
===== DaCapo 23.9-RC3-chopin h2o starting =====
Importing file: citibiketripdata201908.csv......
Parsing file: citibiketripdata201908.csv......
Building model......
Aborting due to java.lang.OutOfMemoryError: Java heap space
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  Internal Error (debug.cpp:339), pid=3555, tid=3613
#  fatal error: OutOfMemory encountered: Java heap space
#
# JRE version: OpenJDK Runtime Environment (11.0.19) (build 11.0.19-internal+0-adhoc.runner.openjdk)
# Java VM: OpenJDK 64-Bit Server VM (11.0.19-internal+0-adhoc.runner.openjdk, mixed mode, tiered, third-party gc, linux-amd64)
# Core dump will be written. Default location: Core dumps may be processed with "/usr/share/apport/apport -p%p -s%s -c%c -d%d -P%P -u%u -g%g -- %E" (or dumping to /tmp/runbms-lz7h7bys/core.3555)
#
# An error report file with more information is saved as:
# /tmp/runbms-lz7h7bys/hs_err_pid3555.log
@qinsoon qinsoon added the bug Something isn't working label Sep 19, 2023
@qinsoon qinsoon mentioned this issue Sep 19, 2023
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@qinsoon