Menu

Subscribe

Github Copilot and ChatGPT alternatives

There are a growing number of AI coding tools that are alternatives to Copilot. A list of other popular, promising options. Originally published 16 May 2023.

There are plenty of tools to choose from aside from Copilot and ChatGPT. Here are the most promising ones worth checking out, with an emphasis on those with self-hosting as an option. Date of launch is in brackets:

Copilot alternatives on the market

ChatGPT alternatives

One important thing to note about ChatGPT is that, by default, it uses your input via the web interface to train its model. This is how Samsung employees leaked confidential data by asking ChatGPT to generate meeting notes. ChatGPT retains user data, even that of paying users. If you don’t consent to this, you need to opt out.

Below are a couple of ChatGPT alternatives which do not “leak” data like it does, as in making user-entered data part of a training set which can later be accessed by all customers:

  • OpenAI APIs. Curiously, ChatGPT uses data entered via its web interface for training, but not when using its APIs. So an obvious workaround is to use the APIs with a wrapper, like the open source Chatbot UI.
  • Azure OpenAI Service. Fine-tune custom AI models with your company data and hyperparameters.
  • MosaicML. Train large AI models with your company data in a secure environment. Point to an AWS S3 bucket, and that’s it!
  • Glean. AI-powered workplace search across the company’s apps, powered by deep learning-based large language models (LLM.)
  • Aleph Alpha. A company emphasizing that it’s a European AI technology company, which has open sourced its code codebase and doesn’t use customer data to train models.
  • Cohere. A set of LLMs to generate text, summarize it, classify and retrieve it.
  • Writer. A generative AI platform that trains on the company’s data.

Building your own company model instead of using a centralized LLM provider is another alternative, and this approach could be prudent for businesses conscious about not passing sensitive and proprietary data to vendors. Databricks created Dolly, a cheap-to-build LLM which works pretty decently compared to ChatGPT, although the model is more dated. They also open sourced 15,000 records of training data. Read more about Dolly.

A very relevant question in the coming age of LLMs will be “buy, build, or self host?” This is because the usefulness of LLMs depends on two things: the model, and the additional training data. Companies will want to train LLMs using their in-house data to make them most useful for staff. However, trusting a vendor with in-house data is more risky than building and operating an LLM in-house, or self hosting one. But there’s considerable cost in both self-hosting, and especially in building one. Still, it’s early days, so perhaps experimentation like this makes sense?

It feels to me that ChatGPT alternatives are an incredibly hot topic and we’ve likely only skimmed the surface of startups working in this area. For example, there are more than 50 LLMs with 1B+ parameters that can be accessed via open-source checkpoints or proprietary APIs. Here’s a list of them, collated by software engineer Matt Rickard.

This article is an excerpt from The productivity impact of AI coding tools. The full article additionally covers:

  1. The survey. An overview of questions and the profiles of respondents.
  2. Comparable productivity gains. The gains which GitHub Copilot and ChatGPT offer are enticing, but not totally unprecedented within tech. Experienced engineers with decades in the business share examples of previous comparable productivity improvements.
  3. GitHub Copilot. Its most common use cases, where the biggest gains are to be found, and when this tool isn’t so useful.
  4. ChatGPT. Most common use cases and when to proceed with caution.
  5. Copilot vs ChatGPT. How the tools compare. When is one better than the other?
  6. The present and future of AI coding tools. Common observations and interesting predictions from survey respondents.
  7. "Are AI coding tools going to take my job?” A very common question and source of concern for some engineers.

Read the full article here.

Featured Pragmatic Engineer Jobs

  1. Senior DevOps Engineer at Polarsteps. Amsterdam.
  2. Senior Software Engineer at Ladder. $150-175K + equity. Palo Alto (CA) or Remote (US).
  3. Senior Software Engineer at GetYourGuide. Berlin, Germany.
  4. Senior MLOps Engineer at GetYourGuide. Berlin, Germany.
  5. Senior Software Engineer (Reporting) at CAST.AI. €72-96K + equity. Remote (Europe).
  6. Senior Software Engineer (Security) at CAST.AI. €60-90K + equity. Remote (Europe).
  7. Senior Sales Engineer at CAST.AI. Remote (Europe, US).
  8. Senior Frontend Developer at TalentBait. €60-80K + equity. Barcelona, Spain.
  9. Technical Lead at Ably. £95-120K + equity. London or Remote (UK).
  10. Senior Software Engineer, Missions at Ably. £80-100K + equity. Remote (UK).
  11. Software Engineer at Freshpaint. $130-210K + equity. Remote (US).
  12. Senior Software Engineer, Developer Ecosystems at Ably. £80-100K. Remote (UK).
  13. Senior Web Engineer, Activation at Ably. £75-85K. Remote (UK).
  14. Web Engineer at Ably. £70-75K. Remote (UK).
  15. Staff Software Engineer at Onaroll. $170-190K + equity. Remote (US).
  16. Staff Software Engineer at Deepset. Remote (US, Europe).

The above jobs score at least 10/12 on The Pragmatic Engineer Test. Browse more senior engineer and engineering leadership roles with great engineering cultures, or add your own on The Pragmatic Engineer Job board and apply to join The Pragmatic Engineer Talent Collective.

Want to get interesting opportunities from vetted tech companies? Sign up to The Pragmatic Engineer Talent Collective and get sent great opportunities - similar to the ones below without any obligation. You can be public or anonymous, and I’ll be curating the list of companies and people.

Are you hiring senior+ engineers or engineering managers? Apply to join The Pragmatic Engineer Talent Collective to contact world-class senior and above engineers and engineering managers/directors. Get vetted drops twice a month, from software engineers - full-stack, backend, mobile, frontend, data, ML - and managers currently working at Big Tech, high-growth startups, and places with strong engineering cultures. Apply here.