Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bus error (core dumped) #340

Open
hallow-cn opened this issue Nov 11, 2024 · 1 comment
Open

Bus error (core dumped) #340

hallow-cn opened this issue Nov 11, 2024 · 1 comment

Comments

@hallow-cn
Copy link

marker /Literature_Lib/lit_data/ /Literature_Lib/output/ --workers 1 --max 2
Loaded detection model vikp/surya_det3 on device cpu with dtype torch.float32
Loaded detection model vikp/surya_layout3 on device cpu with dtype torch.float32
Loaded reading order model vikp/surya_order on device cpu with dtype torch.float32
Loaded recognition model vikp/surya_rec2 on device cpu with dtype torch.float32
Loaded texify model to cpu with torch.float32 dtype
Bus error (core dumped)

Convert a single file runs correctly, but converting multiple files produces the above error.

I am using the CPU mode and 128GB of RAM.

@haobogao
Copy link

haobo@WS:~$ docker run -itd -v /home/haobo:/home/haobo --shm-size=20gb --name doc_marker doc_marker:1.0 /bin/bash

try to add --shm-size to what ever size you want , based on flowing note:

--workers is the number of pdfs to convert at once. This is set to 1 by default, but you can increase it to increase throughput, at the cost of more CPU/GPU usage. Marker will use 5GB of VRAM per worker at the peak, and 3.5GB average.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants