Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Import fails half-way: thumbsnails are shown for selection, but pictures are blank after import #240

Open
Zeitverschreib opened this issue Sep 9, 2023 · 15 comments
Open

Import fails half-way: thumbsnails are shown for selection, but pictures are blank after import #240

Zeitverschreib opened this issue Sep 9, 2023 · 15 comments

Comments

@Zeitverschreib
Copy link

Pixelfed 0.11.9~ynh2
Yunohost 11.2.4

I tried to import an Instagram zip. All pictures are shown for selection, but after import the file/s are blank, "No Preview Available".

Dates and additional info texts are imported correctly.
@lapineige
Copy link
Member

lapineige commented Sep 10, 2023 •
edited
Loading

For reference, this is a known issue : https://forum.yunohost.org/t/pixelfed-0-11-9-instagram-import-no-preview-after-import/26071/

We are waiting for advices from Pixelfed projet on how to solve this : pixelfed/pixelfed#4275 (comment)

A temporary workaround is to force an upgrade to the same version: yunohost app upgrade pixelfed --force.

Before doing that, can you share the result of :
ls -l /var/www/pixelfed/public/storage/m/_v2/*
namei -l /var/www/pixelfed/public/storage/m/_v2/
cat /etc/php/8.2/fpm/pool.d/pixelfed.conf

@Zeitverschreib
Copy link
Author

The forced upgrade did not solve the problem.

Here are the results of the three commands:

root@zwoelfdreifuenfundvierzig:/home/admin# ls -l /var/www/pixelfed/public/storage/m/_v2/*

/var/www/pixelfed/public/storage/m/_v2/428947132208586753:

insgesamt 60

drwxr-x--- 16 pixelfed www-data 4096 24. Feb 2023 0fca8ea69-e1c06b

drwxr-x--- 27 pixelfed www-data 4096 29. Mai 2022 135f62a6c-a5d387

drwxr-x--- 29 pixelfed www-data 4096 30. Jun 19:22 186f813ba-297a89

drwxr-x--- 32 pixelfed www-data 4096 30. Jun 2022 2f76a232a-f08599

drwxr-x--- 19 pixelfed www-data 4096 29. Jan 2023 3079cad20-917577

drwxr-x--- 5 pixelfed www-data 4096 11. Aug 2022 3c6c7d1ab-ede048

drwxr-x--- 9 pixelfed www-data 4096 19. Mär 15:54 42a8ecf32-5a8865

drwxr-x--- 7 pixelfed www-data 4096 3. Jul 2022 7a6475c83-a44db4

drwxr-x--- 3 pixelfed www-data 4096 26. Dez 2022 8d46c944c-26de5d

drwxr-x--- 8 pixelfed www-data 4096 23. Sep 2022 95653d066-30298e

drwxr-x--- 12 pixelfed www-data 4096 30. Apr 20:52 9e2db7367-e375b7

drwxr-x--- 15 pixelfed www-data 4096 30. Jul 15:58 bf0f52ff2-92677b

drwxr-x--- 112 pixelfed www-data 4096 24. Aug 22:20 c51ea9690-856390

drwxr-x--- 35 pixelfed www-data 4096 29. Mai 14:50 c537ce87c-f5971d

drwxr-x--- 9 pixelfed www-data 4096 9. Sep 11:44 ea59ea880-d2aad0

/var/www/pixelfed/public/storage/m/_v2/557608242228323015:

insgesamt 8

drwxr-x--- 4 pixelfed www-data 4096 29. Apr 19:47 9e2db7367-e375b7

drwxr-x--- 10 pixelfed www-data 4096 22. Mai 20:15 c537ce87c-f5971d

/var/www/pixelfed/public/storage/m/_v2/571411042980422652:

insgesamt 12

drwxr-x--- 13 pixelfed www-data 4096 12. Jun 19:13 186f813ba-297a89

drwxr-x--- 6 pixelfed www-data 4096 24. Jul 15:17 bf0f52ff2-92677b

drwxr-x--- 5 pixelfed www-data 4096 2. Aug 17:35 c51ea9690-856390

root@zwoelfdreifuenfundvierzig:/home/admin# namei -l /var/www/pixelfed/public/storage/m/_v2/

f: /var/www/pixelfed/public/storage/m/_v2/

drwxr-xr-x root root /

drwxr-xr-x root root var

drwxr-xr-x root root www

drwxr-x--- pixelfed www-data pixelfed

drwxrwx--- pixelfed www-data public

lrwxrwxrwx pixelfed www-data storage -> /var/www/pixelfed/storage/app/public

drwxr-xr-x root root /

drwxr-xr-x root root var

drwxr-xr-x root root www

drwxr-x--- pixelfed www-data pixelfed

drwxrwx--- pixelfed www-data storage

drwxrwx--- pixelfed www-data app

drwxrwx--- pixelfed www-data public

drwxrwx--- pixelfed www-data m

drwxrwx--- pixelfed www-data _v2

root@zwoelfdreifuenfundvierzig:/home/admin# cat /etc/php/8.2/fpm/pool.d/pixelfed.conf

[pixelfed]

user = pixelfed

group = www-data

chdir = /var/www/pixelfed

listen = /var/run/php/php8.2-fpm-pixelfed.sock

listen.owner = www-data

listen.group = www-data

pm = ondemand

pm.max_children = 16

pm.max_requests = 500

request_terminate_timeout = 1d

pm.process_idle_timeout = 10s

; Additional php.ini defines, specific to this pool of workers.

php_admin_value[upload_max_filesize] = 100M

php_admin_value[post_max_size] = 100M

@lapineige
Copy link
Member

The forced upgrade did not solve the problem.

Ok that means we have a new problem…

Here are the results of the three commands

Before or after the upgrade ?

They seems ok…
Except there is no "september 2023" or similar, so no new picture created recently ? 🤔

@Zeitverschreib
Copy link
Author

Before the upgrade.

The latest post was on 09/09:

https://pixelfed.zwoelfdreifuenfundvierzig.net/i/web/post/606059709323246978

This is the result of today's import attempt:

https://pixelfed.zwoelfdreifuenfundvierzig.net/i/web/post/1000002120701220

@lapineige
Copy link
Member

Before the upgrade.

Ok, so at least the permission issue didn't reappear.

The latest post was on 09/09:

My bad, I didn't read it correctly.

Can you share the result of ls -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/* please ?

@Zeitverschreib
Copy link
Author 

root@zwoelfdreifuenfundvierzig:/home/admin# ls -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/*
/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh:
insgesamt 120
-rw-r--r-- 1 pixelfed www-data 119069 11. Sep 19:00 bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/BpwmGqqQ63kr:
insgesamt 520
-rwxr-x--- 1 pixelfed www-data 442529  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp.jpg
-rwxr-x--- 1 pixelfed www-data  82358  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/dIKte5MiNgnr:
insgesamt 1316
-rwxr-x--- 1 pixelfed www-data 1095621  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj.jpg
-rwxr-x--- 1 pixelfed www-data  249582  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/DQ6A7QpuV5Oh:
insgesamt 840
-rwxr-x--- 1 pixelfed www-data 615820  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO.jpg
-rwxr-x--- 1 pixelfed www-data 241578  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ibCLTLeuezBA:
insgesamt 1416
-rwxr-x--- 1 pixelfed www-data 1074732  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks.jpg
-rwxr-x--- 1 pixelfed www-data  368745  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ihi6kukMhtqQ:
insgesamt 0

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/mIB5E9tiTsus:
insgesamt 1656
-rwxr-x--- 1 pixelfed www-data 1383136  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg.jpg
-rwxr-x--- 1 pixelfed www-data  310518  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/NWFk2btcLjw3:
insgesamt 904
-rwxr-x--- 1 pixelfed www-data 736558  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ.jpg
-rwxr-x--- 1 pixelfed www-data 185085  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ_thumb.jpg

@lapineige
Copy link
Member

Can you chmod 750 /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg, reload php8.2-fpm service and tell me if the broken picture works ?

@Zeitverschreib
Copy link
Author

No luck.

root@zwoelfdreifuenfundvierzig:/home/admin# chmod 750 /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
root@zwoelfdreifuenfundvierzig:/home/admin# ls -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/*
/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh:
insgesamt 120
-rwxr-x--- 1 pixelfed www-data 119069 11. Sep 19:00 bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/BpwmGqqQ63kr:
insgesamt 520
-rwxr-x--- 1 pixelfed www-data 442529  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp.jpg
-rwxr-x--- 1 pixelfed www-data  82358  9. Sep 11:44 MDMU2mc504y58pxG1GHrjg7MBktCMzf1kWGupsHp_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/dIKte5MiNgnr:
insgesamt 1316
-rwxr-x--- 1 pixelfed www-data 1095621  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj.jpg
-rwxr-x--- 1 pixelfed www-data  249582  2. Sep 18:39 pgb5LJT2iKJLGKkZtNfe3pXqxK0sTcmxkW5SHIDj_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/DQ6A7QpuV5Oh:
insgesamt 840
-rwxr-x--- 1 pixelfed www-data 615820  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO.jpg
-rwxr-x--- 1 pixelfed www-data 241578  2. Sep 18:39 GsLyE7jNTYPoc8jictWvVPSsa6J74LpgBvh1IITO_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ibCLTLeuezBA:
insgesamt 1416
-rwxr-x--- 1 pixelfed www-data 1074732  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks.jpg
-rwxr-x--- 1 pixelfed www-data  368745  2. Sep 18:38 2ZQQ3Piiub7gAu1O253sXKM3hoLhaQ7v3a9ok2ks_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/ihi6kukMhtqQ:
insgesamt 0

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/mIB5E9tiTsus:
insgesamt 1656
-rwxr-x--- 1 pixelfed www-data 1383136  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg.jpg
-rwxr-x--- 1 pixelfed www-data  310518  2. Sep 18:39 ym5fERZVyShlsqC5QJrxQ1JOvrPAlZv1uubqArcg_thumb.jpg

/var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/NWFk2btcLjw3:
insgesamt 904
-rwxr-x--- 1 pixelfed www-data 736558  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ.jpg
-rwxr-x--- 1 pixelfed www-data 185085  2. Sep 18:39 Q59viEAYoBesBpo0mxs70SiuDpz9unqGXaDmz7qJ_thumb.jpg

The image still shows "No Preview Available".

@lapineige
Copy link
Member

I forgot to look at the directory…

namei /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg ?

You may try the same chmod command but with the directory instead.

@Zeitverschreib
Copy link
Author

You mean

chmod 750 /var/www/pixelfed/public/storage/m/_v2/428947132208586753/

?

After chmod and restart:

root@zwoelfdreifuenfundvierzig:/home/admin# namei /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
f: /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
 d /
 d var
 d www
 d pixelfed
 d public
 l storage -> /var/www/pixelfed/storage/app/public
   d /
   d var
   d www
   d pixelfed
   d storage
   d app
   d public
 d m
 d _v2
 d 428947132208586753
 d ea59ea880-d2aad0
 d AbCr2yiJSBWh
 - bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg

@lapineige
Copy link
Member

It was namei -l, sorry…

@Zeitverschreib
Copy link
Author 

root@zwoelfdreifuenfundvierzig:/home/admin# namei -l /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
f: /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh/bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg
drwxr-xr-x root     root     /
drwxr-xr-x root     root     var
drwxr-xr-x root     root     www
drwxr-x--- pixelfed www-data pixelfed
drwxrwx--- pixelfed www-data public
lrwxrwxrwx pixelfed www-data storage -> /var/www/pixelfed/storage/app/public
drwxr-xr-x root     root       /
drwxr-xr-x root     root       var
drwxr-xr-x root     root       www
drwxr-x--- pixelfed www-data   pixelfed
drwxrwx--- pixelfed www-data   storage
drwxrwx--- pixelfed www-data   app
drwxrwx--- pixelfed www-data   public
drwxrwx--- pixelfed www-data m
drwxrwx--- pixelfed www-data _v2
drwxr-x--- pixelfed www-data 428947132208586753
drwxr-x--- pixelfed www-data ea59ea880-d2aad0
drwxr-x--- pixelfed pixelfed AbCr2yiJSBWh
-rwxr-x--- pixelfed www-data bTfm7qDWsom68NsZZBLAs2Pn5pIerLj89BjAyAcH.jpg

@lapineige
Copy link
Member

That's it !
drwxr-x--- pixelfed pixelfed AbCr2yiJSBWh

→ chown pixelfed:www-data /var/www/pixelfed/public/storage/m/_v2/428947132208586753/ea59ea880-d2aad0/AbCr2yiJSBWh

@Zeitverschreib
Copy link
Author

Yes, that solved the problem. The imported post is ok now.

@lapineige
Copy link
Member

Ok so there seems to be another process (than php ?) that handle the file creation… it should have been fixed by the import fix.

Thanks for sharing this, it helps !

So that's the workaround for now…

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lapineige @Zeitverschreib