An open-source connection for your AI tools

All your models.
One connection.

Connect your apps to the providers, subscriptions, and local models you choose. Set the routes. Keep your context.

uv tool install ppmlx
Get started

v0.11.0 developmentApple SiliconMIT license

ppmlx / routes

Policy examples
One endpoint for your toolslocalhost:6767
code.ppmlxUse your preferred account

Keep one model name in your coding app. Choose the provider order behind it.

  1. Claude CodeSubscription
  2. OpenAIAPI
  3. MLXLocal model
fast.ppmlxPut a lower-cost model first

Start with a smaller model. Select a fallback for the errors your policy permits.

  1. OpenRouterSmall model
  2. GrokFallback model
  3. MLXLocal model
private.ppmlxKeep inference on your Mac

Use a local-only route for sensitive work. The policy does not permit a remote fallback.

  1. MLXApple Silicon · local only

Your app keeps its model name. You control the candidates and fallback rules.

Illustrative routes. Provider, model, and subscription support depends on the configured connection.

Routes that fit your apps.

Give each app a model name that you control. Map it to your choice of provider and model. Change the route when your needs change.

Connect your tools

More from what you pay for.

Put a lower-cost model or supported subscription first. Set fallback rules for unavailable providers. Your policies decide the order.

Explore route policies

Local is built in.

Run MLX models directly on Apple Silicon. Use local inference as your first choice or keep a local route for private work.

Run a local model

Context beyond one provider.

Keep useful facts and connections in a lightweight graph on your Mac. Make selected context available across your tools and models.

How memory works

Change the model.
Keep the useful context.

Your project context should not belong to one provider. ppmlx keeps facts, relationships, and their sources in a lightweight local graph.

Apps can read selected context with an explicit grant. You control which tools can read it and which project they can read.

Explore the memory graph
Coding agentChat app

Explicit read access

Your context graphStored on your Mac

Experimental. Memory capture is off by default.

Make it your own.

Install ppmlx, connect your tools, and set your first route. Add provider credentials or download a local model.

macOS on Apple Silicon. Python 3.11–3.12.

After installation
# Connect your apps
ppmlx onboard

# Configure your model routes
ppmlx route

# Start your endpoint
ppmlx serve

Built in the open. Yours to inspect, change, and run.

ChangelogIssuesExperiments