Note: Transformer Lab is actively being developed. Please join our Discord or follow us on Twitter for updates. Questions, feedback and contributions are highly valued!
Transformer Lab is an app that allows anyone to experiment with Large Language Models.
Transformer Lab is proud to be supported by Mozilla through the Mozilla Builders Program
Transformer Lab allows you to:
- 💕 One-click Download Hundreds of Popular Models:
- DeepSeek, Llama3, Qwen, Phi4, Gemma, Mistral, Mixtral, Command-R, and dozens more
- ⬇ Download any LLM from Huggingface
- 🎶 Finetune / Train Across Different Hardware
- Finetune using MLX on Apple Silicon
- Finetune using Huggingface on GPU
- ⚖️ RLHF and Preference Optimization
- DPO
- ORPO
- SIMPO
- Reward Modeling
- 💻 Work with LLMs Across Operating Systems:
- Windows App
- MacOS App
- Linux
- 💬 Chat with Models
- Chat
- Completions
- Preset (Templated) Prompts
- Chat History
- Tweak generation parameters
- Batched Inference
- Tool Use / Function Calling (in alpha)
- 🚂 Use Different Inference Engines
- MLX on Apple Silicon
- Huggingface Transformers
- vLLM
- Llama CPP
- 🧑🎓 Evaluate models
- 📖 RAG (Retreival Augmented Generation)
- Drag and Drop File UI
- Works on Apple MLX, Transformers, and other engines
- 📓 Build Datasets for Training
- Pull from hundreds of common datasets available on HuggingFace
- Provide your own dataset using drag and drop
- 🔢 Calculate Embeddings
- 💁 Full REST API
- 🌩 Run in the Cloud
- You can run the user interface on your desktop/laptop while the engine runs on a remote or cloud machine
- Or you can run everything locally on a single machine
- 🔀 Convert Models Across
15 Comments
anonymous_llama
This looks pretty cool! Does it support the new Deepseek model as well?
RandomSid
Looks interesting!
abhimazu1006
I tried the tool, works flawlessly on mac. Finetuning was quick, do you support model conversion as well ? To TensorRT ?
quantum_aggie
[dead]
quantum_aggie
[dead]
cvanvlack
Love that you can pull in other open source plugins. Super cool!
mbcool
Runs great on Apple Silicon. Impressed with one-click downloads and its flexible fine-tuning suite.
wooderson_iv
Who is this for? I get it for hobbyists, but do you imagine it being used for…startups that…what, self-host AI? Where's support for the rest of OpenAI functionality? Where's assistants?
sacckey
Such a cool GUI!
debadyutirc
Really cool project! Look forward to trying this out. I have been using the copilot extensions with local docs toRAG augmentation. This seems to be a step up.
misslivirose
The plugin for doing RAG and being able to quickly test different parameters for chunking made it really easy to see how I could make improvements to my local embeddings workflow. Already seeing better results.
dominiclau18
Much needed product today – awesome product and thanks for sharing this with us!
ktko
I tried this out last night, and the UI is so intuitive! Have tested a few other tools in the space, and this by far, was the most user-friendly and made with developers in mind :)
Excited for more features to support enterprise functionality and deployment, but overall impressed with what the team has built so far. Well done!
Waterloo_Frank
Definitely needed, great idea!
MayuriNair
Interesting!