Skip to content

Panic/Crash during model download/installation #8569

@bdgmb2

Description

@bdgmb2

LocalAI version:
3.11.0 (944874d)

Environment, CPU architecture, OS, and Version:
Docker on Windows 10 Pro 19045, WSL2 driver. CUDA13 capability

Describe the bug
When downloading any model and attempting to install from the Web UI, a panic occurs in the Go backend crashing the container:

panic: reflect.Value.MapIndex: value of type interface {} is not assignable to type string

Stack trace below.

To Reproduce
Attempt to install any model from the Model Gallery. Bug report was made with nanbeige4.1-3b-q4_k_m.

Expected behavior
No container crash.

Logs
Starting from the last INFO log message:

Feb 14 21:46:20 INFO  File downloaded and verified file="/models/nanbeige4.1-3b-q4_k_m.gguf" caller={caller.file="/build/pkg/downloader/uri.go"  caller.L=490 } 

panic: reflect.Value.MapIndex: value of type interface {} is not assignable to type string


goroutine 14 [running]:

reflect.Value.assignTo({0x1d930e0?, 0xc000d91d30?, 0xc0012186d8?}, {0x21b055a, 0x16}, 0x1cffac0, 0x0)

	/usr/local/go/src/reflect/value.go:3146 +0x28b

reflect.Value.MapIndex({0x1e45040?, 0xc00084e000?, 0x3d600c8?}, {0x1d930e0, 0xc000d91d30, 0x94})

	/usr/local/go/src/reflect/map_swiss.go:163 +0xe8

dario.cat/mergo.deepMerge({0x1e45040?, 0xc00084e000?, 0xcc0082e47e8?}, {0x1e45fa0?, 0xc001210450?, 0x98?}, 0xc00077b138, 0x1, 0xc000cd5c38)

	/root/go/pkg/mod/dario.cat/mergo@v1.0.2/merge.go:125 +0x1896

dario.cat/mergo.deepMerge({0x1e45040?, 0xc0007b3168?, 0x1e45040?}, {0x1e45040?, 0xc001210390?, 0x82881c?}, 0xc00077b138, 0x0, 0xc000cd5c38)

	/root/go/pkg/mod/dario.cat/mergo@v1.0.2/merge.go:153 +0x1bef

dario.cat/mergo.merge({0x1cc0cc0, 0xc0007b3168}, {0x1e45040, 0xc001210390}, {0xc00077b3c0, 0x1, 0xc001e0a000?})

	/root/go/pkg/mod/dario.cat/mergo@v1.0.2/merge.go:395 +0x2ef

dario.cat/mergo.Merge(...)

	/root/go/pkg/mod/dario.cat/mergo@v1.0.2/merge.go:319

github.com/mudler/LocalAI/core/gallery.InstallModel({0x3d0afd0, 0xc000eff1d0}, 0x0?, {0xc000612390, 0x11}, 0xc0012646e0, 0xc001210390, 0xc001216078, 0x1)

	/build/core/gallery/models.go:251 +0xc51

github.com/mudler/LocalAI/core/gallery.InstallModelFromGallery.func1(0xc00121e340)

	/build/core/gallery/models.go:132 +0x8be

github.com/mudler/LocalAI/core/gallery.InstallModelFromGallery({_, _}, {_, _, _}, {_, _, _}, _, 0xc000efe8c0, ...)

	/build/core/gallery/models.go:158 +0x129

github.com/mudler/LocalAI/core/services.processModelOperation(0xc00095e300, 0xc0004f6140, 0xc000efe8c0, 0x1, 0x1, 0xc001216078)

	/build/core/services/models.go:221 +0x1c5

github.com/mudler/LocalAI/core/services.(*GalleryService).modelHandler(0xc000497d80, 0xc00095e300, 0xc00019e480, 0xc0004f6140)

	/build/core/services/models.go:57 +0x18c

github.com/mudler/LocalAI/core/services.(*GalleryService).Start.func3()

	/build/core/services/gallery.go:156 +0x3f8

created by github.com/mudler/LocalAI/core/services.(*GalleryService).Start in goroutine 1

	/build/core/services/gallery.go:129 +0x13c

Additional context
N/A

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions