-
Notifications
You must be signed in to change notification settings - Fork 55
Expand file tree
/
Copy pathNOTICE
More file actions
255 lines (199 loc) · 12.9 KB
/
Copy pathNOTICE
File metadata and controls
255 lines (199 loc) · 12.9 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
mlxcel
Copyright 2025-2026 Lablup Inc. and contributors.
This product includes software developed at Lablup Inc.
------------------------------------------------------------------------
Third-party attributions
------------------------------------------------------------------------
turboquant_plus
---------------
Portions of the TurboQuant KV cache implementation, under
src/lib/mlxcel-core/src/cache/turbo/, are derived from turboquant_plus
(https://github.com/TheTom/turboquant_plus), Copyright 2026 Tom Turney,
licensed under the Apache License, Version 2.0.
The following notice is carried forward verbatim from the turboquant_plus
NOTICE file, as required by Apache License 2.0 Section 4(d):
turboquant_plus
Copyright 2026 Tom Turney
This product includes software developed by Tom Turney
(https://github.com/TheTom/turboquant_plus).
mlx-lm, mlx-vlm, and mlx-audio
------------------------------
Portions of mlxcel's model architectures, tokenizer handling, batch
scheduler, and server API translators are ported from or mirror mlx-lm
(https://github.com/ml-explore/mlx-lm), Copyright 2023 Apple Inc., and
mlx-vlm (https://github.com/Blaizzy/mlx-vlm), Copyright 2025 Prince Canuma.
Portions of mlxcel's audio model coverage and DSP (text-to-speech and
speech-to-text feature extraction) are ported from or mirror mlx-audio
(https://github.com/Blaizzy/mlx-audio), Copyright 2024 Prince Canuma.
All three are licensed under the MIT License. The MIT License requires that
the copyright and permission notices be retained in substantial portions, so
they are reproduced below:
MIT License
Copyright © 2023 Apple Inc. (mlx-lm)
Copyright © 2025 Prince Canuma (mlx-vlm)
Copyright © 2024 Prince Canuma (mlx-audio)
Permission is hereby granted, free of charge, to any person obtaining a
copy of this software and associated documentation files (the
"Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to
permit persons to whom the Software is furnished to do so, subject to
the following conditions:
The above copyright notice and this permission notice shall be included
in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS
OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.
IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY
CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT,
TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE
SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
mlx (expm1f device routine)
---------------------------
The fused xIELU Metal kernel in
src/lib/mlxcel-core/cpp/mlx_cxx_kernels.cpp reproduces the device-side
expm1f routine from mlx/backend/metal/kernels/expm1f.h in MLX
(https://github.com/ml-explore/mlx), Copyright (c) Apple Inc., licensed
under the MIT License. The JIT metal_kernel preamble does not pull that
header in and Metal's <metal_math> provides no expm1, so the routine is
inlined verbatim (renamed) to keep the fused activation byte-identical to
the elementwise path that calls mlx::core::expm1. The MIT License text in
the section above (Copyright © 2023 Apple Inc.) covers this reuse.
That routine is itself derived work carried in MLX under the following
BSD 2-Clause license, reproduced verbatim as required:
Copyright (c) 2015-2023 Norbert Juffa
All rights reserved.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions
are met:
1. Redistributions of source code must retain the above copyright
notice, this list of conditions and the following disclaimer.
2. Redistributions in binary form must reproduce the above copyright
notice, this list of conditions and the following disclaimer in the
documentation and/or other materials provided with the distribution.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
mlxcel WebUI browser runtime
-----------------------------
The bundled WebUI assets under src/webui/assets/ include production runtime code from React, React DOM, and Scheduler (https://react.dev/), Copyright (c) Meta Platforms, Inc. and affiliates, licensed under the MIT License. The same license text is shipped inside the offline WebUI bundle as third-party-licenses.txt so relocated binaries retain the required notice with the embedded JavaScript.
MIT License
Copyright (c) Meta Platforms, Inc. and affiliates.
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
backend.ai-go (WebUI glass theme)
---------------------------------
Portions of the WebUI glass theme in
webui/src/design-system/themes/glass.css (its system-color palette, the
filled-button highlight gradients, and the translucent surface, fill and
chrome-highlight values) are derived from the glass theme tokens of
backend.ai-go (https://github.com/lablup/backend.ai-go), Copyright 2025-2026
Lablup Inc., licensed under the Apache License, Version 2.0. Colors were
adjusted where needed to meet WCAG 2.2 AA against mlxcel's own surfaces. The
theme is compiled into the bundled WebUI assets under src/webui/assets/.
backend.ai-go ships no NOTICE file, so there is no upstream notice text to
carry forward under Section 4(d); the Apache License, Version 2.0 text is in
this repository's LICENSE.
mlx ROCm backend (NripeshN/mlx, rocm-support branch)
----------------------------------------------------
The AMD GPU (ROCm/HIP) backend under src/lib/mlx-cpp/patches-rocm/, the
ROCm part of mlxcelverse, is vendored from the rocm-support branch of
NripeshN/mlx (https://github.com/NripeshN/mlx), a fork of MLX
(https://github.com/ml-explore/mlx), at the commit recorded in
src/lib/mlx-cpp/patches-rocm/UPSTREAM, with the local changes listed in
src/lib/mlx-cpp/patches-rocm/LOCAL_FIXES.md. It is licensed under the MIT
License, Copyright © 2023 Apple Inc. and the MLX and NripeshN/mlx
contributors; the MIT License text in the mlx-lm section above covers it.
Vendored files keep their original headers.
IREE and StableHLO (OpenXLA backend, `xla-iree` feature only)
------------------------------------------------------------
No IREE or StableHLO source is vendored in this tree. The optional OpenXLA
backend emits StableHLO (https://github.com/openxla/stablehlo) graphs, and
under the off-by-default `xla-iree` cargo feature the C shim in
src/lib/mlxcel-xla/csrc/xla_iree.c is compiled against the IREE runtime
headers and linked against a prebuilt or source-built IREE runtime
(https://github.com/iree-org/iree), Copyright The IREE Authors, licensed
under the Apache License, Version 2.0 with LLVM Exceptions. `iree-compile`
from the same distribution lowers the emitted graphs ahead of time.
Release builds do not enable that feature, so shipped binaries contain no
IREE code. A locally built `xla-iree` binary statically links the IREE
runtime; the LLVM Exception to the Apache 2.0 License covers that Object
form embedding without the Section 4(a), 4(b), and 4(d) obligations, and
IREE ships a LICENSE with no NOTICE file, so nothing is carried forward
here. This section records the dependency.
moonshotai/Kimi-K3 (tokenizer pattern and XTML chat grammar)
-----------------------------------------------------------
The Kimi K3 pre-tokenization pattern and control-token block in
src/tokenizer/tiktoken.rs, and the XTML chat grammar in
src/server/kimi_k3_chat.rs, are ported from tokenization_kimi.py and
encoding_k3.py in moonshotai/Kimi-K3
(https://huggingface.co/moonshotai/Kimi-K3), Copyright (c) 2026 Moonshot AI,
licensed under the Kimi K3 License. No weights and no upstream source files
are vendored; only the format definitions are reimplemented in Rust.
The Kimi K3 License requires that its copyright notice and permission notice
be included in substantial portions of the Software, so it is reproduced
below:
Kimi K3 License
Copyright (c) 2026 Moonshot AI
Permission is hereby granted, free of charge, to any person (the "Licensee")
obtaining a copy of this software — including the model weights, parameters,
configuration files, inference and training code, and associated documentation
(collectively, the "Software") — to deal in the Software without restriction.
This includes, without limitation, the rights to use, copy, modify, merge,
publish, distribute, sublicense, and/or sell copies of the Software; to run,
deploy, fine-tune, or otherwise modify the Software and create derivative works
from it; and to permit persons to whom the Software is furnished to do so, in
each case subject to the following conditions:
1. The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software. Licensee's use of the
Software must comply with applicable laws and regulations.
2. "Model as a Service" means giving a third party access to language model
inference or fine-tuning (e.g., via API) in a manner that allows such third
party to exercise meaningful control over the inputs, parameters, or training
data. This does not include (a) end-user products with model capabilities solely
embedded within specific features or harnesses, or (b) mere relaying of requests
to models hosted by others.
If the Licensee or any of its affiliates operates a Model as a Service business,
and the aggregate revenue of the Licensee and its affiliates exceeds 20 million
US dollars (or the equivalent in other currencies) in total over any consecutive
12 months, the Licensee must enter into a separate agreement with Moonshot AI
before using the Software or its derivative works for any commercial purpose.
3. If the Software (or any derivative works thereof) is used for any of the
Licensee's commercial products or services that have more than 100 million
monthly active users, or more than 20 million US dollars (or equivalent in other
currencies) in monthly revenue, "Kimi K3" must be prominently displayed on the
user interface of such product or service.
4. The requirements set forth in Sections 2 and 3 do not apply to: (a) internal
use of the Software, defined as any use that does not make the Software, its
outputs, or its underlying capabilities available to third parties; or (b) any
use of the Software accessed through Moonshot AI's official products or
certified inference partners.
5. THE SOFTWARE AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS”
BASIS, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT
LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE
AND NONINFRINGEMENT. IN NO EVENT SHALL MOONSHOT AI OR ITS AFFILIATES OR
COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER
IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN
CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
For any questions regarding this license, please contact <license@moonshot.ai>.