Instructions to use Akhrots/LAM8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Akhrots/LAM8B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Akhrots/LAM8B", trust_remote_code=True) messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Akhrots/LAM8B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Akhrots/LAM8B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Akhrots/LAM8B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Akhrots/LAM8B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Akhrots/LAM8B
- SGLang
How to use Akhrots/LAM8B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Akhrots/LAM8B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Akhrots/LAM8B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Akhrots/LAM8B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Akhrots/LAM8B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Akhrots/LAM8B with Docker Model Runner:
docker model run hf.co/Akhrots/LAM8B
LAM β Large Akhrots Model (8B)
LAM is a long-term memory model by Tronocity Labs. It does two jobs:
- Store β decides what's worth remembering from a conversation and how it should enter memory (insert / update / merge / skip).
- Recall β answers a question from the user's stored memories, combining and time-ordering them when needed β and says "I don't have that in your memory." when the answer genuinely isn't there, instead of making something up.
Grounded refusal instead of hallucination is the point of a dedicated memory model.
Benchmarks
Scored on the model's answering ability given retrieved memories (token-F1):
| Benchmark | LAM |
|---|---|
| LOCOMO (394) | 0.66 |
| LongMemEval-reserved (150, held out) | 0.48 |
| LOCOMO abstention F1 | 0.85 |
LAM roughly doubles LOCOMO answer quality over its un-tuned starting point and sharply reduces over-refusal.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("atharvalepse0129/LAM8B")
model = AutoModelForCausalLM.from_pretrained(
"atharvalepse0129/LAM8B", trust_remote_code=True, device_map="auto")
trust_remote_code=True is required β LAM registers its own model class.
Intended use
LAM sits behind a retrieval pipeline: your system retrieves candidate memories and LAM reads them to answer or abstain. It is not a general chat model.
Limitations
- Scores measure answering given retrieved memories, not the retrieval step β end-to-end quality also depends on your retriever.
- Multi-hop (chained) reasoning is the weakest ability.
- This release was trained at 1024-token context.
License
Apache-2.0. LAM is built by fine-tuning open, Apache-2.0-licensed model weights; the derivative is released under the same license.
- Downloads last month
- 79