Skip to content

NC33: text2image_stablediffusion2 ExApp is enabled and polling tasks, but Assistant does not register any image generation provider #489

@derjp87

Description

@derjp87

Which version of assistant are you using?

Assistant version: 3.3.0

Which version of Nextcloud are you using?

Nextcloud version: 33.0.0.16

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

chrome

Describe the Bug

I set up Nextcloud Assistant image generation with AppAPI, Docker Socket Proxy and HaRP on an Unraid host. The ExApp text2image_stablediffusion2 is deployed, enabled, and actively polling /ocs/v2.php/taskprocessing/tasks_provider/next, but Assistant does not expose it as an image generation provider.

In the Assistant admin settings:

  • with integration_openai enabled, only ollama appears for image generation
  • with integration_openai disabled, Assistant shows: “None of your currently installed apps provide image generation functionality”

So the ExApp appears to be running, but it is not registered/usable as an Assistant image provider.

Environment

  • Nextcloud version: 33.0.0.16
  • Assistant version: 3.3.0
  • AppAPI version: 33.0.0
  • integration_openai version: 4.3.0
  • ExApp: text2image_stablediffusion2 1.3.0
  • Deployment: Docker / HaRP
  • Host OS: Unraid
  • Docker network for ExApps: custom bridge network
  • Docker engine version: 27.5.1

What works

  • Docker Socket Proxy works
  • HaRP daemon registration works
  • HaRP connection test succeeds
  • ExApp is deployed and enabled
  • app_api:daemon:list shows the daemon correctly
  • app_api:app:list shows:
    text2image_stablediffusion2 (Local Image Generation: Stable Diffusion): 1.3.0 [enabled]
  • assistant.text_to_image_picker_enabled is set to 1
  • taskprocessing:task-type:set-enabled core:text2image 1 succeeds

What does not work

  • Assistant does not show the Stable Diffusion ExApp as a selectable image generation backend
  • When I ask Assistant to generate an image, only core:text2text:chat tasks are created, not image tasks
  • Assistant either routes the request to Ollama/chat, or shows no image provider at all

Expected Behavior

text2image_stablediffusion2 should appear as a valid image generation provider in Assistant and image requests should create image-related taskprocessing jobs.

Actual behavior
The ExApp is enabled and polling taskprocessing endpoints, but Assistant does not register any usable image provider from it.

Relevant OCC output

  • php occ app_api:app:list
    shows:
    text2image_stablediffusion2 (Local Image Generation: Stable Diffusion): 1.3.0 [enabled]

  • php occ app_api:daemon:list
    shows both my DSP daemon and HaRP daemon, with HaRP active

  • php occ config:list assistant
    shows:
    text_to_image_picker_enabled: "1"

  • php occ config:app:get app_api default_daemon_config
    returns:
    harp_proxy_docker

  • php occ app:list | grep -iE "assistant|app_api|openai|ollama|text2image"
    returns:

    • app_api: 33.0.0
    • assistant: 3.3.0
    • integration_openai: 4.3.0
  • php occ taskprocessing:task:stats
    shows existing tasks

  • php occ taskprocessing:task:list
    only shows tasks like:

    • type: core:text2text:chat
    • appId: assistant:chatty-llm

Relevant logs
The ExApp repeatedly polls:
GET /ocs/v2.php/taskprocessing/tasks_provider/next?format=json

The most suspicious log entry is:
The loading of lazy AppConfig values have been triggered by app "core"

Stack trace points into:

  • OC\TaskProcessing\Manager->getPreferredProvider()
  • OC\Core\Controller\TaskProcessingApiController->intersectTaskTypesAndProviders()

I also see repeated deprecated alias warnings such as:

  • OCP\IServerContainer
  • Request

But those look secondary and not like the root cause.

Additional notes
Disabling integration_openai removes the visible ollama entry from Assistant, but Assistant still does not recognize text2image_stablediffusion2 as an image provider. Instead it reports that no installed app provides image generation.

This suggests a registration/provider-selection problem between Assistant, AppAPI and the ExApp on NC33.

To Reproduce

  1. Install and configure Nextcloud 33 with the following apps enabled:

    • Assistant
    • AppAPI
    • text2image_stablediffusion2
    • integration_openai (optional, used here with Ollama)
  2. Configure AppAPI with a working Docker Socket Proxy daemon and a working HaRP daemon.

  3. Verify that:

    • php occ app_api:app:list shows text2image_stablediffusion2 as enabled
    • php occ app_api:daemon:list shows the configured daemon(s)
    • php occ taskprocessing:task-type:set-enabled core:text2image 1 succeeds
    • assistant.text_to_image_picker_enabled is set to 1
  4. Open Assistant administration settings in Nextcloud.

  5. Go to the image generation section / unified task processing settings.

  6. Observe the provider selection:

    • with integration_openai enabled, only ollama is shown
    • with integration_openai disabled, Nextcloud reports that no installed app provides image generation
  7. Try to generate an image in Assistant with a prompt such as:
    Create an image of a farm at sunset

  8. Check the created tasks with:

    • php occ taskprocessing:task:list
  9. Observe that only core:text2text:chat tasks are created, and no image generation provider is used.

  10. Check the Nextcloud log and observe repeated requests to /ocs/v2.php/taskprocessing/tasks_provider/next and exceptions related to getPreferredProvider().

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions