Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf skywolf46/ignition-singularity-prototype# Run inference directly in the terminal:
llama cli -hf skywolf46/ignition-singularity-prototypeUse pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf skywolf46/ignition-singularity-prototype# Run inference directly in the terminal:
./llama-cli -hf skywolf46/ignition-singularity-prototypeBuild from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf skywolf46/ignition-singularity-prototype# Run inference directly in the terminal:
./build/bin/llama-cli -hf skywolf46/ignition-singularity-prototypeUse Docker
docker model run hf.co/skywolf46/ignition-singularity-prototypeIgnition Singularity
λ°ν νΉμ΄μ νλ‘μ νΈλ AIμ 컨ν μ€νΈ 보쑰λ₯Ό μν΄ μ΅λν μλ³Έμ κ°μ κ³Ό λλμ λμ΄λ¦΄ μ μλλ‘ ν둬ννΈλ₯Ό μμΆμ μλνλ μμ±ν λͺ¨λΈ νλ‘μ νΈμ λλ€.
νμ΅ μ 보
λ°ν νΉμ΄μ νλ‘μ νΈλ 6GB κ°λμ ShareGPTμ CC0, νΉμ μ μκΆμ΄ λ§λ£λ κ³ μ μμ€ λ°μ΄ν°λ₯Ό Qwen 3.8 27B λ° Gemma 4 31Bλ₯Ό ν΅ν΄ μ μ νκ³ , λΆλ₯ν λ°μ΄ν°μ μ ν΅ν΄ νμ΅λμμ΅λλ€.
μ΄ μ 보λ λ³κ²½λ μ μμΌλ©°, νμμ κ³μνμ¬ μ‘°κ±΄μ λ°κΏ νμ΅μ μλνκ³ μμ΅λλ€.
ν΄λΉ λ ν¬μ§ν 리λ μλνλ νλ‘ν νμ λ§μ΄ 곡κ°λμ΄ μμ΅λλ€.
μ¬μ© λ°©λ²
λ°ν νΉμ΄μ νλ‘ν νμ λͺ¨λΈμ Qwen 3.5 4B λͺ¨λΈμ κΈ°λ°μΌλ‘ νμΈ νλνμμ΅λλ€.
μ±λ₯μ΄ ν¬κ² μ’μ§λ μμΌλ, μ μ λ κ³ μ μμ€μ ν΅ν νμΈ νλμ μ§νν μμ λͺ¨λΈμ λν΄ κ΅μ°¨ κ²μ¦, νΉμ μ€νμ΄ νμν κ²½μ° λμμ§ μμ μ νμ§κ° λ μ μμ΅λλ€.
μ΄ νλ‘μ νΈλ IGX νμμ μ§ννλ λ°ν νΉμ΄μ νλ‘μ νΈμ μΌλΆμ λλ€.
- Downloads last month
- 21
We're not able to determine the quantization variants.
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf skywolf46/ignition-singularity-prototype# Run inference directly in the terminal: llama cli -hf skywolf46/ignition-singularity-prototype