Routes that fit your apps.
Give each app a model name that you control. Map it to your choice of provider and model. Change the route when your needs change.
Connect your toolsAn open-source connection for your AI tools
Connect your apps to the providers, subscriptions, and local models you choose. Set the routes. Keep your context.
uv tool install ppmlxlocalhost:6767code.ppmlxUse your preferred accountKeep one model name in your coding app. Choose the provider order behind it.
fast.ppmlxPut a lower-cost model firstStart with a smaller model. Select a fallback for the errors your policy permits.
private.ppmlxKeep inference on your MacUse a local-only route for sensitive work. The policy does not permit a remote fallback.
Your app keeps its model name. You control the candidates and fallback rules.
Illustrative routes. Provider, model, and subscription support depends on the configured connection.
Give each app a model name that you control. Map it to your choice of provider and model. Change the route when your needs change.
Connect your toolsPut a lower-cost model or supported subscription first. Set fallback rules for unavailable providers. Your policies decide the order.
Explore route policiesRun MLX models directly on Apple Silicon. Use local inference as your first choice or keep a local route for private work.
Run a local modelKeep useful facts and connections in a lightweight graph on your Mac. Make selected context available across your tools and models.
How memory worksPrivate memory, shared by choice
Your project context should not belong to one provider. ppmlx keeps facts, relationships, and their sources in a lightweight local graph.
Apps can read selected context with an explicit grant. You control which tools can read it and which project they can read.
Explore the memory graphExplicit read access
Experimental. Memory capture is off by default.
Install ppmlx, connect your tools, and set your first route. Add provider credentials or download a local model.
macOS on Apple Silicon. Python 3.11–3.12.
# Connect your apps
ppmlx onboard
# Configure your model routes
ppmlx route
# Start your endpoint
ppmlx serveBuilt in the open. Yours to inspect, change, and run.