Skip to content

Simple proxy worker for using ollama in cursor

License

Notifications You must be signed in to change notification settings

ryoppippi/curxy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

curxy

cursor + proxy = curxy

JSR JSR

An proxy worker for using ollama in cursor

What is this?

This is a proxy worker for using ollama in cursor. It is a simple server that forwards requests to the ollama server and returns the response.

Why do you need this?

When we use llm prediction on cusor editor, the editor sends to the data to the official cursor server, and the server sends the data to the ollama server. Therefore, even if the endpoint is set to localhost in the cursor editor configuration, the cursor server cannot send communication to the local server. So, we need a proxy worker that can forward the data to the ollama server.

requirements

  • deno
  • ollama server

How to use

  1. Launch the ollama server

  2. Launch curxy

    deno run -A jsr:@ryoppippi/curxy

    if you limit the access to the ollama server, you can set OPENAI_API_KEY environment variable.

    OPENAI_API_KEY=your_openai_api_key deno run -A jsr:@ryoppippi/curxy
    
    Listening on http://127.0.0.1:62192/
    ◐ Starting cloudflared tunnel to http://127.0.0.1:62192                                                                                                                                                                                                                                                           5:39:59 PM
    Server running at: https://remaining-chen-composition-dressed.trycloudflare.com

    You can get the public URL hosted by cloudflare.

  3. Enter the URL provided by curxy with /v1 appended to it into the "Override OpenAl Base URL" section of the cursor editor configuration.

cursor

  1. Add model names you want to "Model Names" section of the cursor editor configuration.

Screenshot 2024-08-22 at 23 42 33

  1. (Optional): Additionally, if you want to restrict access to this Proxy Server for security reasons, you can set the OPENAI_API_KEY as an environment variable, which will enable access restrictions based on the key.

  2. Enjoy!

Also, you can see help message by deno run -A jsr:@ryoppippi/curxy --help

Related

Japanese Article

License

MIT