A collection of models that are able to be run using onnxruntime-genai and can be served through embeddedllm library.
AI & ML interests
None defined yet.
Recent Activity
View all activity
Model Powered by Onnxruntime CPU GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 11 -
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 10 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 11 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 9
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 346k • • 1.47k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 150k • 1.71k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 18.7k • 225 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 12.7k • 389
A collection of model that can be hosted using OpenVINO Model Server
Model Powered by Onnxruntime DirectML GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-directml
Text Generation • Updated • 22 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-directml
Text Generation • Updated • 8 -
EmbeddedLLM/Phi-3-medium-4k-instruct-onnx-directml
Text Generation • Updated • 13 -
EmbeddedLLM/Phi-3-medium-128k-instruct-onnx-directml
Text Generation • Updated • 10
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 346k • • 1.47k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 150k • 1.71k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 18.7k • 225 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 12.7k • 389
A collection of models that are able to be run using onnxruntime-genai and can be served through embeddedllm library.
Model Powered by Onnxruntime DirectML GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-directml
Text Generation • Updated • 22 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-directml
Text Generation • Updated • 8 -
EmbeddedLLM/Phi-3-medium-4k-instruct-onnx-directml
Text Generation • Updated • 13 -
EmbeddedLLM/Phi-3-medium-128k-instruct-onnx-directml
Text Generation • Updated • 10
Model Powered by Onnxruntime CPU GenAI
-
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 11 -
EmbeddedLLM/Phi-3-mini-4k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 10 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32
Text Generation • Updated • 11 -
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Text Generation • Updated • 9
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 346k • • 1.47k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 150k • 1.71k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 18.7k • 225 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 12.7k • 389
-
microsoft/Phi-3-mini-4k-instruct
Text Generation • 4B • Updated • 346k • • 1.47k -
microsoft/Phi-3-mini-128k-instruct
Text Generation • 4B • Updated • 150k • 1.71k -
microsoft/Phi-3-medium-4k-instruct
Text Generation • 14B • Updated • 18.7k • 225 -
microsoft/Phi-3-medium-128k-instruct
Text Generation • 14B • Updated • 12.7k • 389
A collection of model that can be hosted using OpenVINO Model Server