You might think getting an LLM up and running on your own machine would be an insurmountable task, but it's actually been made easy thanks to Ollama.

Here’s the latest installment in the series on working with LLMS: It was only after I deployed the function and used it in three different dashboards that the penny finally dropped. This had …

A chat with friends recently reminded me about pangrams, and what a cute little language curiosity they are. I also remembered that i never got a self-enumerating pangram generator to work. I should give that another try! I thought it would be fun play with ChatGPT and see if it could generate some good ones, expecting it to do quite well on this task. After all, LLMs should be excellent wordcels, right? That is, is there’s one thing they should be very good at, that is verbal intelligence. Yeah, i know this meme of “shape rotators vs. wordcels” can be a bit cringy, but i honestly find these terms ironically endearing. Well, it doesn’t seem so.

When it comes to AI, it seems like the vast majority of people I talk to believe large language models (LLMs) are either going to surpass human intelligence any…

With the surge of LLMs with billions of parameters like GPT4, PaLM-2, and Claude, came the need to steer their behavior in order to align them with tasks. This blog post will cover more complex state-of-the-art methods in prompt engineering including Chains and Agents, along with important concept definitions such as the distinctions between them.

Data licensing deals, scaling, human inputs, and repeating trends in open vs. closed LLMs.

Reversible computing could be critical in the LLM era. We look at how reversible architecture saves energy and what it means for developers.

As the barrier that separates data from not-data fades away, a long-envisioned calendar scenario becomes real with an LLM-backed Datasette plugin.

User-friendly WebUI for LLMs (Formerly Ollama WebUI) - open-webui/open-webui

In the realm of Large Language Models (LLMs), Daniel Miessler’s fabric project is a popular choice for collecting and integrating various LLM prompts. However, its default requirement to access the OpenAI API can lead to unexpected costs. Enter ollama, an alternative solution that allows running LLMs locally on powerful hardware like Apple Silicon chips or […]

I’m a big fan of Llama. Meta releasing their LLM open source is a net benefit for the tech...

All we have to do is get closer to the metal

We will see code interpreters powering even more AI agents and apps as a part of the new ecosystem being built around LLMs, where a code interpreter represents a crucial part of an agent’s brain.

Now that LLMs can retrieve 1 million tokens at once, how long will it be until we don’t need retrieval augmented generation for accurate AI responses?

I have very mixed opinions on LLMs, as they stand. This note won’t be digging into my thoughts there - I don’t want to have that discussion. However, while I’m not exactly doing cutting-edge research here, I do put effort into publishing for humans.

We discover that mapping one domain (publishing) into another (the domain-specific language of SQL) works heavily to an LLM's strengths.

Its data-driven matching algorithms that pair people to positions employs a structured taxonomy to overcome other models’ limitations.

Retrieval-augmented generation facilitates a radical makeover of LLMs and real-time AI environments to produce better, more accurate search results.

The evolution of software development over the past decade has been very frustrating. Little of it seems to makes sense, even to those of us who are right in the middle of it.

When designing a domain-specific enterprise-grade conversational Q&A system to answer customer questions, Conviva found an either/or approach isn’t sufficient.

Oso explains how to use a vector database and retrieval-augmented generation to lock data in LLMs to permissions and decouples authorization data and logic.

WebAssembly makes it quick and easy to download and run a complete LLM on a machine without any major setup.

Release high-quality LLM apps quickly without compromising on testing. Never be held back by the complex and subjective nature of LLM interactions.

Vector databases enable businesses to affordably and sustainably adapt generic large language models for organization-specific use.

Introduction In today’s world, LLMs are everywhere, but what exactly is an LLM and what are they used for? LLM, an acronym for Large Language Model, is an AI model developed to understand and generate human-like language. LLMs are trained on huge data sets (hence “large”) to process and generate meaningful and relevant responses based

Modeling the compute versus performance tradeoff of many open LLMs.