~mediagoblin/mediagoblin#49: 
Having to run a separate task queue is unnecessarily complicated

Running and managing a separate media-processing process is too complicated for typical small-scale uses of MediaGoblin.

There needs to be a simpler way to run MediaGoblin so that you run one program which provides the web interface as well as asynchronous media processing in the background.

Status
REPORTED
Submitter
~sturm
Assigned to
No-one
Submitted
28 days ago
Updated
28 days ago
Labels
No labels applied.

~shtrom 28 days ago

Isn't this what the lazyserver does?

In my experience, running a separate processing server allows to not hold up the HTTP request while the processing is done. However, if the web server (I think it's werkzeug) can spin off parallel tasks for the processing as needed, then it might be sufficient.

-- Olivier Mehani shtrom+mediagoblin@ssji.net PGP fingerprint: 4435 CF6A 7C8D DD9B E2DE F5F9 F012 A6E2 98C6 6655 Confidentiality cannot be guaranteed on emails sent or received unencrypted.

~sturm 28 days ago

"~shtrom" outgoing@sr.ht writes:

Isn't this what the lazyserver does?

Nah, lazyserver runs a single web application process with CELERY_ALWAYS_EAGER=true, causing the web application to block while the transcoding occurs in the same process.

In my experience, running a separate processing server allows to not hold up the HTTP request while the processing is done. However, if the web server (I think it's werkzeug) can spin off parallel tasks for the processing as needed, then it might be sufficient.

Yes, that's what I'm imagining - some kind of subprocess that run in the background while the web application continues to serve HTTP requests.

The key is that we would manage that automatically, rather than making that the user's problem to coordinate. From their perspective, they run one command and the system is ready to go.

~shtrom 28 days ago

On Thu 27 Jun 2024 at 03:38:53 +0000, ~sturm wrote:

The key is that we would manage that automatically, rather than making that the user's problem to coordinate. From their perspective, they run one command and the system is ready to go.

Yep, that's be great! gmg serve

-- Olivier Mehani shtrom+mediagoblin@ssji.net PGP fingerprint: 4435 CF6A 7C8D DD9B E2DE F5F9 F012 A6E2 98C6 6655 Confidentiality cannot be guaranteed on emails sent or received unencrypted.

Register here or Log in to comment, or comment via email.