0056GitHub
laya_ex: native Nx/Bumblebee runtime for Laya in Elixir
Elixir library that downloads the official checkpoint on first load and answers typed choice and noul questions; pick EMLX on Apple Silicon or EXLA for CPU/NVIDIA.
ChristianAlexander/laya_exREADME ↗
# Laya
Native Nx/Bumblebee runtime for [Laya](https://laya.convaiinnovations.com/) by
Convai Innovations. It downloads the
[official model checkpoint](https://huggingface.co/convaiinnovations/laya) on
first load.
```elixir
{:ok, model} = Laya.load()
Laya.predict(model, "Please refund the duplicate invoice.", %{
"department" => %{
type: :choice,
instructions: "Which team should handle this request?",
criteria: [
{"billing", "invoices, payments, and refunds"},
{"technical", "bugs and outages"},
{"other", "everything else"}
]
},
"refund_requested" => %{
type: :noul,
instructions: "Does the customer explicitly request a refund?"
}
})
```
`choice.criteria` is an ordered list of `{label, description}` tuples.
```sh
mix run bench/laya_bench.exs
```
The English checkpoint downloads on first load.
The package does not select an Nx backend. Configure one in the host app, for
example `EMLX.Backend` on Apple Silicon or `EXLA.Backend` on CPU/NVIDIA.