TrueCharts Bot dc571cf23f chore(deps): update container image docker.io/localai/localai to v2.16.0 by renovate (#22420)
This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.15.0-cublas-cuda11-ffmpeg-core` ->
`v2.16.0-cublas-cuda11-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.15.0-cublas-cuda11-core` -> `v2.16.0-cublas-cuda11-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.15.0-cublas-cuda12-ffmpeg-core` ->
`v2.16.0-cublas-cuda12-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.15.0-cublas-cuda12-core` -> `v2.16.0-cublas-cuda12-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.15.0-ffmpeg-core` -> `v2.16.0-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.15.0` -> `v2.16.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>mudler/LocalAI (docker.io/localai/localai)</summary>

###
[`v2.16.0`](https://togithub.com/mudler/LocalAI/releases/tag/v2.16.0)

[Compare
Source](https://togithub.com/mudler/LocalAI/compare/v2.15.0...v2.16.0)

![local-ai-release-2
16](https://togithub.com/mudler/LocalAI/assets/2420543/bd3a6ace-8aec-4ac7-b457-b3e8cb5bb29e)

##### Welcome to LocalAI's latest update!

##### 🎉🎉🎉 woot woot! So excited to share this release, a lot of new
features are landing in LocalAI!!!!! 🎉🎉🎉


![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExZ2cycjRqbXFld2toenpqcjcyN3E3eWw1NHI5cm12Njc3Y2lzZWtyZyZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/AR92HqL0HcenC/giphy.gif)

##### 🌟  Introducing Distributed Llama.cpp Inferencing

Now it is possible to distribute the inferencing workload across
different workers with llama.cpp models !

This feature has landed with
[https://github.com/mudler/LocalAI/pull/2324](https://togithub.com/mudler/LocalAI/pull/2324)
and is based on the upstream work of
[@&#8203;rgerganov](https://togithub.com/rgerganov) in
[https://github.com/ggerganov/llama.cpp/pull/6829](https://togithub.com/ggerganov/llama.cpp/pull/6829).

**How it works:** a front-end server manages the requests compatible
with the OpenAI API (LocalAI) and workers (llama.cpp) are used to
distribute the workload. This makes possible to run larger models split
across different nodes!

##### How to use it

To start workers to offload the computation you can run:

    local-ai llamacpp-worker <listening_address> <listening_port>

However, you can also follow the llama.cpp README and building the
rpc-server
(https://github.com/ggerganov/llama.cpp/blob/master/examples/rpc/README.md),
which is still compatible with LocalAI.

When starting the LocalAI server, which is going to accept the API
requests, you can set a list of workers IP/address by specifying the
addresses with `LLAMACPP_GRPC_SERVERS`:

```bash
LLAMACPP_GRPC_SERVERS="address1:port,address2:port" local-ai run
```

At this point the workload hitting in the LocalAI server should be
distributed across the nodes!

##### 🤖 Peer2Peer llama.cpp

LocalAI is the **first** AI Free, Open source project offering complete,
decentralized, peer2peer while private, LLM inferencing on top of the
libp2p protocol. There is no "public swarm" to offload the computation,
but rather empowers you to build your own cluster of local and remote
machines to distribute LLM computation.


![](https://media.giphy.com/media/v1.Y2lkPTc5MGI3NjExZTdrZW9rc3hrMWxoZTV1OGo0ajF3d2MwMHFmeXVoMThqOGg1eHR4ZCZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/q0KrtRcr10Bhu/giphy.gif)

This feature leverages the ability of llama.cpp to distribute the
workload explained just above and features from one of my other
projects, https://github.com/mudler/edgevpn.

LocalAI builds on top of the twos, and allows to create a private
peer2peer network between nodes, without the need of centralizing
connections or manually configuring IP addresses: it unlocks totally
decentralized, private, peer-to-peer inferencing capabilities. Works
also behind different NAT-ted networks (uses DHT and mDNS as discovery
mechanism).

**How it works:** A pre-shared token can be generated and shared between
workers and the server to form a private, decentralized, p2p network.

You can see the feature in action here:


![output](https://togithub.com/mudler/LocalAI/assets/2420543/8ca277cf-c208-4562-8929-808b2324b584)

##### How to use it

1.  Start the server with `--p2p`:

```bash
./local-ai run --p2p

##### 1:02AM INF loading environment variables from file envFile=.env
##### 1:02AM INF Setting logging to info

##### 1:02AM INF P2P mode enabled
##### 1:02AM INF No token provided, generating one

##### 1:02AM INF Generated Token:
##### XXXXXXXXXXX

##### 1:02AM INF Press a button to proceed
```

A token is displayed, copy it and press enter.

You can re-use the same token later restarting the server with
`--p2ptoken` (or `P2P_TOKEN`).

2. Start the workers. Now you can copy the local-ai binary in other
hosts, and run as many workers with that token:

```bash
TOKEN=XXX ./local-ai  p2p-llama-cpp-rpc

##### 1:06AM INF loading environment variables from file envFile=.env
##### 1:06AM INF Setting logging to info

##### {"level":"INFO","time":"2024-05-19T01:06:01.794+0200","caller":"config/config.go:288","message":"connmanager disabled\n"}
##### {"level":"INFO","time":"2024-05-19T01:06:01.794+0200","caller":"config/config.go:295","message":" go-libp2p resource manager protection enabled"}

##### {"level":"INFO","time":"2024-05-19T01:06:01.794+0200","caller":"config/config.go:409","message":"max connections: 100\n"}
##### 1:06AM INF Starting llama-cpp-rpc-server on '127.0.0.1:34371'

##### {"level":"INFO","time":"2024-05-19T01:06:01.794+0200","caller":"node/node.go:118","message":" Starting EdgeVPN network"}
##### create_backend: using CPU backend

##### Starting RPC server on 127.0.0.1:34371, backend memory: 31913 MB
##### 2024/05/19 01:06:01 failed to sufficiently increase receive buffer size (was: 208 kiB, wanted: 2048 kiB, got: 416 kiB). # See https://github.com/quic-go/quic-go/wiki/UDP-Buffer-Sizes for details.

##### {"level":"INFO","time":"2024-05-19T01:06:01.805+0200","caller":"node/node.go:172","message":" Node ID: 12D3KooWJ7WQAbCWKfJgjw2oMMGGss9diw3Sov5hVWi8t4DMgx92"}
##### {"level":"INFO","time":"2024-05-19T01:06:01.806+0200","caller":"node/node.go:173","message":" Node Addresses: [/ip4/127.0.0.1/tcp/44931 /ip4/127.0.0.1/udp/33251/quic-v1/webtransport/certhash/uEiAWAhZ-W9yx2ZHnKQm3BE_ft5jjoc468z5-Rgr9XdfjeQ/certhash/uEiB8Uwn0M2TQBELaV2m4lqypIAY2S-2ZMf7lt_N5LS6ojw /ip4/127.0.0.1/udp/35660/quic-v1 /ip4/192.168.68.110/tcp/44931 /ip4/192.168.68.110/udp/33251/quic-v1/webtransport/certhash/uEiAWAhZ-W9yx2ZHnKQm3BE_ft5jjoc468z5-Rgr9XdfjeQ/certhash/uEiB8Uwn0M2TQBELaV2m4lqypIAY2S-2ZMf7lt_N5LS6ojw /ip4/192.168.68.110/udp/35660/quic-v1 /ip6/::1/tcp/41289 /ip6/::1/udp/33160/quic-v1/webtransport/certhash/uEiAWAhZ-W9yx2ZHnKQm3BE_ft5jjoc468z5-Rgr9XdfjeQ/certhash/uEiB8Uwn0M2TQBELaV2m4lqypIAY2S-2ZMf7lt_N5LS6ojw /ip6/::1/udp/35701/quic-v1]"}

##### {"level":"INFO","time":"2024-05-19T01:06:01.806+0200","caller":"discovery/dht.go:104","message":" Bootstrapping DHT"}
```

(Note you can also supply the token via args)

At this point, you should see in the server logs messages stating that
new workers are found

3. Now you can start doing inference as usual on the server (the node
used on step 1)

Interested in to try it out? As we are still updating the documentation,
you can read the full instructions here
[https://github.com/mudler/LocalAI/pull/2343](https://togithub.com/mudler/LocalAI/pull/2343)

##### 📜 Advanced Function calling support with Mixed JSON Grammars

LocalAI gets better at function calling with mixed grammars!

With this release, LocalAI introduces a transformative capability:
support for mixed JSON BNF grammars. It allows to specify a grammar for
the LLM that allows to output structured JSON and free text.

**How to use it:**

To enable mixed grammars, you can set in the `YAML` configuration file
`function.mixed_mode = true`, for example:

```yaml
  function:

##### disable injecting the "answer" tool
    disable_no_action: true

    grammar:

##### This allows the grammar to also return messages
      mixed_mode: true
```

This feature significantly enhances LocalAI's ability to interpret and
manipulate JSON data coming from the LLM through a more flexible and
powerful grammar system. Users can now combine multiple grammar types
within a single JSON structure, allowing for dynamic parsing and
validation scenarios.

Grammars can also turned off entirely and leave the user to determine
how the data is parsed from the LLM to be correctly interpretated by
LocalAI to be still compliant to the OpenAI REST spec.

For example, to interpret Hermes results, one can just annotate regexes
in `function.json_regex_match` to extract the LLM response:

```yaml
  function:
    grammar:
      disable: true

##### disable injecting the "answer" tool
    disable_no_action: true
    return_name_in_function_response: true

    json_regex_match:
    - "(?s)<tool_call>(.*?)</tool_call>"
    - "(?s)<tool_call>(.*?)"
  
    replace_llm_results:

##### Drop the scratchpad content from responses
    - key: "(?s)<scratchpad>.*</scratchpad>"
      value: ""
    replace_function_results:

##### Replace everything that is not JSON array or object, just in case.
    - key: '(?s)^[^{\[]*'
      value: ""
    - key: '(?s)[^}\]]*$'
      value: ""

##### Drop the scratchpad content from responses
    - key: "(?s)<scratchpad>.*</scratchpad>"
      value: ""
```

Note that regex can still be used when enabling mixed grammars is
enabled.

This is especially important for models which does not support grammars
- such as transformers or OpenVINO models, that now can support as well
function calling. As we update the docs, further documentation can be
found in the PRs that you can find in the changelog below.

##### 🚀 New Model Additions and Updates


![local-ai-yi-updates](https://togithub.com/mudler/LocalAI/assets/2420543/5d646703-0c64-4299-b551-a39074f63c2d)

Our model gallery continues to grow with exciting new additions like
Aya-35b, Mistral-0.3, Hermes-Theta and updates to existing models
ensuring they remain at the cutting edge.

This release is having major enhancements on tool calling support.
Besides working on making our default models in AIO images more
performant - now you can try an enhanced out-of-the-box experience with
function calling in the Hermes model family (
[Hermes-2-Pro-Mistral](https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B-GGUF)
and
[Hermes-2-Theta-Llama-3](https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-8B-GGUF))

##### Our LocalAI function model!


![local-ai-functioncall-model](https://togithub.com/mudler/LocalAI/assets/2420543/b2955459-49b6-4a57-96e8-242966ccef12)

I have fine-tuned a function call model specific to leverage entirely
the grammar support of LocalAI, you can find it in the model gallery
already and on
[huggingface](https://huggingface.co/mudler/LocalAI-Llama3-8b-Function-Call-v0.2)

##### 🔄 Single Binary Release: Simplified Deployment and Management

In our continuous effort to streamline the user experience and
deployment process, LocalAI v2.16.0 proudly introduces a single binary
release. This enhancement, thanks to
[@&#8203;sozercan](https://togithub.com/sozercan)'s contributions,
consolidates all variants (CUDA and non-cuda releases) and dependencies
into one compact executable file.

This change simplifies the installation and update processes, reduces
compatibility issues, and speeds up the setup for new users and existing
deployments as now binary releases are even more portable than ever!

##### 🔧 Bug Fixes and Improvements

A host of bug fixes have been implemented to ensure smoother operation
and integration. Key fixes include enhancements to the Intel build
process, stability adjustments for setuptools in Python backends, and
critical updates ensuring the successful build of p2p configurations.

##### Migrating Python Backends: From Conda to UV

LocalAI has migrated its Python backends from Conda to UV. This
transition, thanks to [@&#8203;cryptk](https://togithub.com/cryptk)
contributions, enhances the efficiency and scalability of our backend
operations. Users will experience faster setup times and reduced
complexity, streamlining the development process and making it easier to
manage dependencies across different environments.

##### 📣 Let's Make Some Noise!

A gigantic THANK YOU to everyone who’s contributed—your feedback, bug
squashing, and feature suggestions are what make LocalAI shine. To all
our heroes out there supporting other users and sharing their expertise,
you’re the real MVPs!

Remember, LocalAI thrives on community support—not big corporate bucks.
If you love what we're building, show some love! A shoutout on social
(@&#8203;LocalAI_OSS and @&#8203;mudler_it on twitter/X), joining our
sponsors, or simply starring us on GitHub makes all the difference.

Also, if you haven't yet joined our Discord, come on over! Here's the
link: https://discord.gg/uJAeKSAGDy

Thanks a ton, and.. enjoy this release!

##### What's Changed

##### Bug fixes 🐛

- build: do not specify a BUILD_ID by default by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2284](https://togithub.com/mudler/LocalAI/pull/2284)
- fix: add missing openvino/optimum/etc libraries for Intel, fixes
[#&#8203;2289](https://togithub.com/mudler/LocalAI/issues/2289) by
[@&#8203;cryptk](https://togithub.com/cryptk) in
[https://github.com/mudler/LocalAI/pull/2292](https://togithub.com/mudler/LocalAI/pull/2292)
- add setuptools for openvino by
[@&#8203;fakezeta](https://togithub.com/fakezeta) in
[https://github.com/mudler/LocalAI/pull/2301](https://togithub.com/mudler/LocalAI/pull/2301)
- fix: add setuptools to all requirements-intel.txt files for python
backends by [@&#8203;cryptk](https://togithub.com/cryptk) in
[https://github.com/mudler/LocalAI/pull/2333](https://togithub.com/mudler/LocalAI/pull/2333)
- ci: correctly build p2p in GO_TAGS by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2369](https://togithub.com/mudler/LocalAI/pull/2369)
- ci: generate specific image for intel builds by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2374](https://togithub.com/mudler/LocalAI/pull/2374)
- fix: stablediffusion binary by
[@&#8203;sozercan](https://togithub.com/sozercan) in
[https://github.com/mudler/LocalAI/pull/2385](https://togithub.com/mudler/LocalAI/pull/2385)

##### Exciting New Features 🎉

- feat: migrate python backends from conda to uv by
[@&#8203;cryptk](https://togithub.com/cryptk) in
[https://github.com/mudler/LocalAI/pull/2215](https://togithub.com/mudler/LocalAI/pull/2215)
- feat: create bash library to handle install/run/test of python
backends by [@&#8203;cryptk](https://togithub.com/cryptk) in
[https://github.com/mudler/LocalAI/pull/2286](https://togithub.com/mudler/LocalAI/pull/2286)
- feat(grammar): support models with specific construct by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2291](https://togithub.com/mudler/LocalAI/pull/2291)
- feat(ui): display number of available models for installation by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2298](https://togithub.com/mudler/LocalAI/pull/2298)
- feat: auto select llama-cpp cpu variant by
[@&#8203;sozercan](https://togithub.com/sozercan) in
[https://github.com/mudler/LocalAI/pull/2305](https://togithub.com/mudler/LocalAI/pull/2305)
- feat(llama.cpp): add `flash_attention` and `no_kv_offloading` by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2310](https://togithub.com/mudler/LocalAI/pull/2310)
- feat(functions): support models with no grammar and no regex by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2315](https://togithub.com/mudler/LocalAI/pull/2315)
- feat(functions): allow to set JSON matcher by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2319](https://togithub.com/mudler/LocalAI/pull/2319)
- feat: auto select llama-cpp cuda runtime by
[@&#8203;sozercan](https://togithub.com/sozercan) in
[https://github.com/mudler/LocalAI/pull/2306](https://togithub.com/mudler/LocalAI/pull/2306)
- feat(llama.cpp): add distributed llama.cpp inferencing by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2324](https://togithub.com/mudler/LocalAI/pull/2324)
- feat(functions): mixed JSON BNF grammars by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2328](https://togithub.com/mudler/LocalAI/pull/2328)
- feat(functions): simplify parsing, read functions as list by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2340](https://togithub.com/mudler/LocalAI/pull/2340)
- feat(functions): Enable true regex replacement for the
regexReplacement option by
[@&#8203;lenaxia](https://togithub.com/lenaxia) in
[https://github.com/mudler/LocalAI/pull/2341](https://togithub.com/mudler/LocalAI/pull/2341)
- feat(backends): add openvoice backend by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2334](https://togithub.com/mudler/LocalAI/pull/2334)
- feat(webui): statically embed js/css assets by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2348](https://togithub.com/mudler/LocalAI/pull/2348)
- feat(functions): allow to use JSONRegexMatch unconditionally by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2349](https://togithub.com/mudler/LocalAI/pull/2349)
- feat(functions): don't use yaml.MapSlice by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2354](https://togithub.com/mudler/LocalAI/pull/2354)
- build: add sha by [@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2356](https://togithub.com/mudler/LocalAI/pull/2356)
- feat(llama.cpp): Totally decentralized, private, distributed, p2p
inference by [@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2343](https://togithub.com/mudler/LocalAI/pull/2343)
- feat(functions): relax mixedgrammars by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2365](https://togithub.com/mudler/LocalAI/pull/2365)
- models(gallery): add mistral-0.3 and command-r, update functions by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2388](https://togithub.com/mudler/LocalAI/pull/2388)

##### 🧠 Models

- models(gallery): add aloe by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2283](https://togithub.com/mudler/LocalAI/pull/2283)
- models(gallery): add Llama-3-8B-Instruct-abliterated by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2288](https://togithub.com/mudler/LocalAI/pull/2288)
- models(gallery): add l3-chaoticsoliloquy-v1.5-4x8b by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2295](https://togithub.com/mudler/LocalAI/pull/2295)
- models(gallery): add jsl-medllama-3-8b-v2.0 by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2296](https://togithub.com/mudler/LocalAI/pull/2296)
- models(gallery): add llama-3-refueled by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2297](https://togithub.com/mudler/LocalAI/pull/2297)
- models(gallery): add aura-llama-Abliterated by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2309](https://togithub.com/mudler/LocalAI/pull/2309)
- models(gallery): add Bunny-llama by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2311](https://togithub.com/mudler/LocalAI/pull/2311)
- models(gallery): add lumimaidv2 by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2312](https://togithub.com/mudler/LocalAI/pull/2312)
- models(gallery): add orthocopter by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2313](https://togithub.com/mudler/LocalAI/pull/2313)
- fix(gallery) Correct llama3-8b-instruct model file by
[@&#8203;tannisroot](https://togithub.com/tannisroot) in
[https://github.com/mudler/LocalAI/pull/2330](https://togithub.com/mudler/LocalAI/pull/2330)
- models(gallery): add hermes-2-theta-llama-3-8b by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2331](https://togithub.com/mudler/LocalAI/pull/2331)
- models(gallery): add yi 6/9b, sqlcoder, sfr-iterative-dpo by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2335](https://togithub.com/mudler/LocalAI/pull/2335)
- models(gallery): add anita by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2344](https://togithub.com/mudler/LocalAI/pull/2344)
- models(gallery): add master-yi by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2345](https://togithub.com/mudler/LocalAI/pull/2345)
- models(gallery): update poppy porpoise mmproj by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2346](https://togithub.com/mudler/LocalAI/pull/2346)
- models(gallery): add LocalAI-Llama3-8b-Function-Call-v0.2-GGUF by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2355](https://togithub.com/mudler/LocalAI/pull/2355)
- models(gallery): add stheno by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2358](https://togithub.com/mudler/LocalAI/pull/2358)
- fix(gallery): checksum Meta-Llama-3-70B-Instruct.Q4\_K_M.gguf -
[#&#8203;2364](https://togithub.com/mudler/LocalAI/issues/2364) by
[@&#8203;Nold360](https://togithub.com/Nold360) in
[https://github.com/mudler/LocalAI/pull/2366](https://togithub.com/mudler/LocalAI/pull/2366)
- models(gallery): add phi-3-medium-4k-instruct by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2367](https://togithub.com/mudler/LocalAI/pull/2367)
- models(gallery): add hercules and helpingAI by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2376](https://togithub.com/mudler/LocalAI/pull/2376)
- ci(checksum_checker): do get sha from hf API when available by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2380](https://togithub.com/mudler/LocalAI/pull/2380)
- models(gallery): ⬆️ update checksum by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2383](https://togithub.com/mudler/LocalAI/pull/2383)
- models(gallery): ⬆️ update checksum by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2386](https://togithub.com/mudler/LocalAI/pull/2386)
- models(gallery): add aya-35b by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2391](https://togithub.com/mudler/LocalAI/pull/2391)

##### 📖 Documentation and examples

- docs: Update semantic-todo/README.md by
[@&#8203;eltociear](https://togithub.com/eltociear) in
[https://github.com/mudler/LocalAI/pull/2294](https://togithub.com/mudler/LocalAI/pull/2294)
- Add Home Assistant Integration by
[@&#8203;valentinfrlch](https://togithub.com/valentinfrlch) in
[https://github.com/mudler/LocalAI/pull/2387](https://togithub.com/mudler/LocalAI/pull/2387)
- Add warning for running the binary on MacOS by
[@&#8203;mauromorales](https://togithub.com/mauromorales) in
[https://github.com/mudler/LocalAI/pull/2389](https://togithub.com/mudler/LocalAI/pull/2389)

##### 👒 Dependencies

- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2281](https://togithub.com/mudler/LocalAI/pull/2281)
- ⬆️ Update docs version mudler/LocalAI by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2280](https://togithub.com/mudler/LocalAI/pull/2280)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2285](https://togithub.com/mudler/LocalAI/pull/2285)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2290](https://togithub.com/mudler/LocalAI/pull/2290)
- feat(swagger): update swagger by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2302](https://togithub.com/mudler/LocalAI/pull/2302)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2303](https://togithub.com/mudler/LocalAI/pull/2303)
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2317](https://togithub.com/mudler/LocalAI/pull/2317)
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2326](https://togithub.com/mudler/LocalAI/pull/2326)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2316](https://togithub.com/mudler/LocalAI/pull/2316)
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2329](https://togithub.com/mudler/LocalAI/pull/2329)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2337](https://togithub.com/mudler/LocalAI/pull/2337)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2339](https://togithub.com/mudler/LocalAI/pull/2339)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2342](https://togithub.com/mudler/LocalAI/pull/2342)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2351](https://togithub.com/mudler/LocalAI/pull/2351)
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2352](https://togithub.com/mudler/LocalAI/pull/2352)
- dependencies(grpcio): bump to fix CI issues by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2362](https://togithub.com/mudler/LocalAI/pull/2362)
- deps(llama.cpp): update and adapt API changes by
[@&#8203;mudler](https://togithub.com/mudler) in
[https://github.com/mudler/LocalAI/pull/2381](https://togithub.com/mudler/LocalAI/pull/2381)
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2361](https://togithub.com/mudler/LocalAI/pull/2361)
- ⬆️ Update go-skynet/go-bert.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/1225](https://togithub.com/mudler/LocalAI/pull/1225)
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[https://github.com/mudler/LocalAI/pull/2360](https://togithub.com/mudler/LocalAI/pull/2360)

##### Other Changes

- refactor: Minor improvements to BackendConfigLoader by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[https://github.com/mudler/LocalAI/pull/2353](https://togithub.com/mudler/LocalAI/pull/2353)

##### New Contributors

- [@&#8203;tannisroot](https://togithub.com/tannisroot) made their first
contribution in
[https://github.com/mudler/LocalAI/pull/2330](https://togithub.com/mudler/LocalAI/pull/2330)
- [@&#8203;lenaxia](https://togithub.com/lenaxia) made their first
contribution in
[https://github.com/mudler/LocalAI/pull/2341](https://togithub.com/mudler/LocalAI/pull/2341)
- [@&#8203;valentinfrlch](https://togithub.com/valentinfrlch) made their
first contribution in
[https://github.com/mudler/LocalAI/pull/2387](https://togithub.com/mudler/LocalAI/pull/2387)

**Full Changelog**:
https://github.com/mudler/LocalAI/compare/v2.15.0...v2.16.0

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Enabled.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4zNzcuNCIsInVwZGF0ZWRJblZlciI6IjM3LjM3Ny40IiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbImF1dG9tZXJnZSIsInVwZGF0ZS9kb2NrZXIvZ2VuZXJhbC9ub24tbWFqb3IiXX0=-->
2024-05-25 02:48:41 +02:00

title
title
TrueCharts

Community Chart Catalog for TrueNAS SCALE

docs Discord GitHub last commit


TrueCharts is a catalog of highly optimised Helm Charts and TrueNAS SCALE Apps. Made for the community, By the community!

All our charts are supposed to work together, be easy to setup using both Helm and the TrueNAS UI and, above all, give the average user more than enough options to tune things to their liking.


Getting started using TrueCharts

docs


Installing TrueCharts within TrueNAS SCALE, is possible using the TrueNAS SCALE Catalog list.

Check TrueCharts Quick-Start Guides for more information.

For installing TrueCharts using helm:

Just add the repository and call it a day!

Support

Please check our FAQ, manual and Issue tracker There is a significant chance your issue has been reported before!

Still something not working as expected? Contact us! and we'll figure it out together!

Development

pre-commit renovate GitHub last commit


Our development process is fully distributed and agile, so every chart-maintainer is free to set their own roadmap and development speed and does not have to comply to a centralised roadmap. This ensures freedom and flexibility for everyone involved and makes sure you, the end user, always has the latest and greatest of every Chart installed.

Getting into creating Charts

For more information check the website: https://truecharts.org

Contact and Support

Discord


To contact the TrueCharts project:



A lot of our work is based on the great effort of others. We would love to extend special thanks to these projects we owe a lot to:

truenas logo k8s@home logo traefik logo authelia logo
TrueNAS SCALE Traefik Authelia

Contributors

All Contributors

Thanks goes to these wonderful people (emoji key):


Kjeld Schouten-Lebbing
Kjeld Schouten-Lebbing

💻 🚇 📖 👀 💵
Justin Clift
Justin Clift

📖
whiskerz007
whiskerz007

💻
Stavros Kois
Stavros Kois

💻 📖 🐛 👀 💵
allen-4
allen-4

💻
Troy Prelog
Troy Prelog

💻 📖 💵
Dan Sheridan
Dan Sheridan

💻
Sebastien Dupont
Sebastien Dupont

📖 💵
Vegetto
Vegetto

👀
Ellie Nieuwdorp
Ellie Nieuwdorp

💻
Nate Walck
Nate Walck

💻
Lloyd
Lloyd

💻 💵
Dave Withnall
Dave Withnall

📖
ksimm1
ksimm1

📖 🐛 💵 🧑‍🏫
Aaron Johnson
Aaron Johnson

📖
Ralph
Ralph

💻
Joachim Baten
Joachim Baten

💻 🐛
Michael Yang
Michael Yang

💻
Ciaran Farley
Ciaran Farley

📖
Heavybullets8
Heavybullets8

📖 💻 🐛 📹 🧑‍🏫 💵
662
662

💻
alex171
alex171

📖
Techno Tim
Techno Tim

📖
Mingyao Liu
Mingyao Liu

💻 🐛
NightShaman
NightShaman

💻 📖 🐛 💵 🧑‍🏫
Andrew Smith
Andrew Smith

📖 ⚠️
Bob Klosinski
Bob Klosinski

💻
Sukarn
Sukarn

💻 📖
sebs
sebs

💻
Dyllan Tinoco
Dyllan Tinoco

💻
StevenMcElligott
StevenMcElligott

💻 💵 📖 🐛 🧑‍🏫
brothergomez
brothergomez

💻 🐛
sagit
sagit

💻 🐛 📹 📖 🧑‍🏫
Nevan Chow
Nevan Chow

💻
Daniel Carlsson
Daniel Carlsson

🐛
Devon Louie
Devon Louie

🐛
Alex-Orsholits
Alex-Orsholits

🐛
Tails32
Tails32

🐛
Menaxerius
Menaxerius

🐛
hidefog
hidefog

🐛
Darren Gibbard
Darren Gibbard

🐛
Barti
Barti

🐛
Sunii
Sunii

🐛
trbmchs
trbmchs

🐛
Light
Light

🐛
Boostflow
Boostflow

🐛
Trigardon
Trigardon

🐛
dbb12345
dbb12345

🐛 💻
karypid
karypid

🐛
Philipp
Philipp

🐛
John
John

🐛 📖
John Parton
John Parton

🐛
Marc
Marc

🐛
fdzaebel
fdzaebel

🐛
kloeckwerx
kloeckwerx

🐛
Bradley Bare
Bradley Bare

🐛
Alexander Thamm
Alexander Thamm

🐛
rexit1982
rexit1982

🐛
iaxx
iaxx

🐛
Xstar97
Xstar97

💻 🐛 🧑‍🏫
ornias
ornias

📹
Josh Asplund
Josh Asplund

💵
midnight33233
midnight33233

💵
kbftech
kbftech

💵
hogenf
hogenf

💵
Hawks
Hawks

💵
Jim Russell
Jim Russell

💵
TheGovnah
TheGovnah

💵
famewolf
famewolf

💵 🐛
Konrad Bujak
Konrad Bujak

📖
190n
190n

💻 📖
Alexej Kubarev
Alexej Kubarev

📖
r-vanooyen
r-vanooyen

📖
shadofall
shadofall

📖 🧑‍🏫
agreppin
agreppin

💻
Stavros Ntentos
Stavros Ntentos

💻 🤔
Vlad-Florin Ilie
Vlad-Florin Ilie

💻
huma2000
huma2000

🐛
hugalafutro
hugalafutro

🐛 💵
yehia Amer
yehia Amer

📖
Tyler Stransky
Tyler Stransky

🐛
juggie
juggie

🐛
Ben Tilford
Ben Tilford

🐛 💻
I-nebukad-I
I-nebukad-I

🐛 💻
Ethan Leisinger
Ethan Leisinger

💻 📖
Cullen Murphy
Cullen Murphy

💻 🐛
Jason Thatcher
Jason Thatcher

💻 🐛 📖
Stefan Schramek
Stefan Schramek

🐛
nokaka
nokaka

🐛
Gal Szkolnik
Gal Szkolnik

🐛
Evgeny Stepanovych
Evgeny Stepanovych

🐛
Waqar Ahmed
Waqar Ahmed

🐛
DrSKiZZ
DrSKiZZ

💵
Jan Puciłowski
Jan Puciłowski

💻 ⚠️
Shaun Coyne
Shaun Coyne

💵
Christoph
Christoph

💵
Brandon Rutledge
Brandon Rutledge

🐛
Michael Bestas
Michael Bestas

🐛
Jurģis Rudaks
Jurģis Rudaks

🐛
brunofatia
brunofatia

💵
TopicsLP
TopicsLP

📖
Michael Schnerring
Michael Schnerring

🐛 💻
Tamas Nagy
Tamas Nagy

🐛
OpenSpeedTest™️
OpenSpeedTest™️

💻
Richard James Acton
Richard James Acton

📖
lps-rocks
lps-rocks

🐛
Faust
Faust

🐛
uranderu
uranderu

🐛
Tom Cassady
Tom Cassady

🐛
Huftierchen
Huftierchen

🐛
ZasX
ZasX

📖 🧑‍🏫 💻
Kevin T.
Kevin T.

🐛
Steven Scott
Steven Scott

📖
Watteel Pascal
Watteel Pascal

💻
JamesOsborn-SE
JamesOsborn-SE

💻 📖
NeoToxic
NeoToxic

🧑‍🏫 🐛
jab416171
jab416171

📖
Anna
Anna

📖
ChaosBlades
ChaosBlades

🐛
Patric Stout
Patric Stout

💻
Ben Kochie
Ben Kochie

💻
Jeff Bachtel
Jeff Bachtel

📖
Ben Woods
Ben Woods

💻
Karl Shea
Karl Shea

🐛
Balakumaran MN
Balakumaran MN

📖
Jesperbelt
Jesperbelt

📖
cccs31
cccs31

🐛
Sam Smucny
Sam Smucny

💻
Keith Cirkel
Keith Cirkel

💻
mgale456
mgale456

💻
Alec Fenichel
Alec Fenichel

💻
John Dorman
John Dorman

💻
Dan
Dan

💻
u4ium
u4ium

📖
ErroneousBosch
ErroneousBosch

🐛
MaverickD650
MaverickD650

💻 🐛
Grogdor
Grogdor

📖
Ryan Gooler
Ryan Gooler

📖
Rob Herley
Rob Herley

📖
Christian Heimlich
Christian Heimlich

📖
l-moon-git
l-moon-git

💻
hughes5
hughes5

📖
sdimovv
sdimovv

💻
AllieQpzm
AllieQpzm

💻
Dominik
Dominik

🐛
renovate[bot]
renovate[bot]

🔧
allcontributors[bot]
allcontributors[bot]

🔧
dependabot[bot]
dependabot[bot]

🔧
TrueCharts Bot
TrueCharts Bot

🔧 🚇 💻
Mend Renovate
Mend Renovate

🔧
Simone
Simone

💻
Jean-François Roy
Jean-François Roy

💻
Whiskey24
Whiskey24

💻
inmanturbo
inmanturbo

📖
Alex
Alex

💻
Brian Semrad
Brian Semrad

💻
Christopher
Christopher

💻 📖
Csaba Engedi
Csaba Engedi

💻
Cyb3rzombie
Cyb3rzombie

💻
Eric Cavalcanti
Eric Cavalcanti

💻
Gavin Chappell
Gavin Chappell

💻 🐛
raynay-r
raynay-r

💻
Jip-Hop
Jip-Hop

📖
Jonas Wrede
Jonas Wrede

💻
SilentNyte
SilentNyte

📖
Stan
Stan

💻
Tiago Gaspar
Tiago Gaspar

💻
gismo2004
gismo2004

💻
jsegaert
jsegaert

📖
Miguel Angel Nubla
Miguel Angel Nubla

💻
xal3xhx
xal3xhx

💻
jeremybox
jeremybox

📖
Cameron Sabuda
Cameron Sabuda

📖
Jeroen Schepens
Jeroen Schepens

🐛
James Wright
James Wright

📖
Malpractis
Malpractis

🐛
CommanderStarhump
CommanderStarhump

🐛
Vianchiel
Vianchiel

🐛
Maximilian Ehlers
Maximilian Ehlers

🐛
nautilus7
nautilus7

🐛 💻
kqmaverick
kqmaverick

🐛
ccalby
ccalby

🐛
kofeyh
kofeyh

🐛
imjustleaving
imjustleaving

🐛
Cristian Torres
Cristian Torres

🐛
schopenhauer
schopenhauer

🐛
Zackptg5
Zackptg5

🐛
Brad Ackerman
Brad Ackerman

🐛
mcspiff313
mcspiff313

🐛
Fletcher Nichol
Fletcher Nichol

💻 🐛
Marco Faggian
Marco Faggian

💻
John P
John P

📖
kryojenik
kryojenik

💻
Malcolm
Malcolm

📖
depasseg
depasseg

📖
j1mbl3s
j1mbl3s

📖
VictorienXP
VictorienXP

💻
yelhouti
yelhouti

💻
Jaroslav Lichtblau
Jaroslav Lichtblau

📖
MaximilianS
MaximilianS

📖
Dion Larson
Dion Larson

💻 📖
Physics-Dude
Physics-Dude

📖
waflint
waflint

💻
Henry Wilkinson
Henry Wilkinson

💻 📖
cedstrom
cedstrom

💻
v3DJG6GL
v3DJG6GL

🐛 💻
polarstack
polarstack

💻
Keyvan
Keyvan

💻
MickaelFontes
MickaelFontes

💻
David CM
David CM

💻
Aamir Azad
Aamir Azad

📖
Jordan Woyak
Jordan Woyak

💻
Simon Hofman
Simon Hofman

💻
notyouraveragegamer
notyouraveragegamer

📖
Varac
Varac

💻
tuxsudo
tuxsudo

💻
TylerRudie
TylerRudie

📖
qnb59bny5x
qnb59bny5x

💻
Filip Bednárik
Filip Bednárik

🐛
Serhii Shcherbinin
Serhii Shcherbinin

💻
Quentin Raynaud
Quentin Raynaud

🐛
Felix Schäfer
Felix Schäfer

📖
Julien Nicolas de Verteuil
Julien Nicolas de Verteuil

💻
Gabriel Donadel Dall'Agnol
Gabriel Donadel Dall'Agnol

📖
Jon S. Stumpf
Jon S. Stumpf

📖
Tanguille
Tanguille

📖
Dennis
Dennis

🐛 📖
TheIceCreamTroll
TheIceCreamTroll

💻
Atanas Pamukchiev
Atanas Pamukchiev

💻
Boemeltrein
Boemeltrein

📖
Yiannis Marangos
Yiannis Marangos

💻
Michael Ruoss
Michael Ruoss

💻
Aron Kahrs
Aron Kahrs

💻
nemesis1982
nemesis1982

📖
Ed P
Ed P

💻
Frédéric Nadeau
Frédéric Nadeau

📖
frapbod
frapbod

💻
Max Bachhuber
Max Bachhuber

💻
zierbeek
zierbeek

💻
Ac1dburn
Ac1dburn

💻
Antoine Saget
Antoine Saget

📖
Ben Bodenmiller
Ben Bodenmiller

🐛
felixfon
felixfon

📖
adtwomey
adtwomey

📖
alfi0812
alfi0812

💻
Agassi
Agassi

💻
Artur
Artur

💻
Morgan Hunter
Morgan Hunter

💻
Aleksandr Oleinikov
Aleksandr Oleinikov

💻
Jamie
Jamie

💻
David Gries
David Gries

🐛 💻
Phreeman33
Phreeman33

💻 🐛
Jens Wolvers
Jens Wolvers

💻

This project follows the all-contributors specification. Contributions of any kind welcome!

Licence

License


Truecharts, is primarily based on a AGPL-v3 license, this ensures almost everyone can use and modify our charts. Licences can vary on a per-Chart basis. This can easily be seen by the presence of a "LICENSE" file in said folder.

An exception to this, has been made for every document inside folders labeled as docs or doc and their subfolders: those folders are not licensed under AGPL-v3 and are considered "all rights reserved". Said content can be modified and changes submitted per PR, in accordance to the github End User License Agreement.

SPDX-License-Identifier: AGPL-3.0


built-with-resentment contains-technical-debt

Languages
Smarty 98.4%
MDX 1.6%