One local router.
All your models.

Use the models and subscriptions you choose. Set the routes. Keep your context on your Mac.

Get started

v0.11.0 developmentApple Silicon

A small layer.
More choice.

Routes you control

Give each app a custom model name. Map it to a configured provider and model. Change the route when your needs change.

Connect your tools

A policy for every request

Put a supported subscription or lower-cost model first. Use fallback rules when a provider is unavailable.

Explore route policies

Local from the start

Run MLX models directly on Apple Silicon. Keep a local route for private work.

Run a local model

Change the model.
Keep the context.

Your project context should not belong to one provider. ppmlx keeps useful facts and connections in a lightweight graph on your Mac.

You choose which apps can read it, and which project they can read.

Explore the memory graph

Experimental. Memory capture is off by default.

Make it your own.

Install ppmlx. Connect a provider or download a local model. Set your first route.

Read the setup guide

macOS on Apple Silicon. Python 3.11–3.12.

# Connect your apps
ppmlx onboard

# Set your model routes
ppmlx route

# Start your endpoint
ppmlx serve

Open source. Yours to inspect, change, and run.

ChangelogIssuesExperiments