List page: AI, ML and if statements

Detecting text produced by an LLM

LLM’s (large language models) can generate very convincing text, but this text can easily be detected using a not quite so large language model. The easiest way to do this is by looking at the perplexity of the text. This is a number that expresses how good a model (like GPT2) is at predicting a given sample of text. Perplexity is mostly used for measuring how good LLM’s are, but LLM generated texts have a consistently lower perplexity (easier to predict) than text written by a human. This is because generation is simply a process of repeatedly choosing the word predicted to be most likely by the LLM.

Exploring step counts in stable diffusion.

TLDR: The step count has very litle effect on image content, and increasing it has rapidly deminishing returns over 20 steps.

Deep learning, or going beyond linear regression [ML2]

Machine learning using a linear regression model is very simple, but rather underwhelming, as the results are always linear functions. Deep learning allows much more complex models to be created, without adding too much more complexity.

Why does Chat-GPT Lie?

LLM’s (Large Language Models) like Chat-GPT are able to hold extended conversations with humans or generate relatively long runs of text (a few paragraphs), however despite sounding authoritative, they consistently create large amounts of fluent bullshit.

Smooth prompt interpolation with stable diffusion. [SD part 3]

You have probably seen smooth animations made with stable diffusion like this: https://www.youtube.com/watch?v=Bo3VZCjDhGI But how was it done?

The answer is very simple, by running multiple prompts on the same image, the noise predictions can be combined to create an intermediate image. Changing the relative weights of the prompts, but keeping the initial latents (seed value) the same, a series of intermediate images can be created.

Stable diffusion, in code. [SD part 2]

If you have not read the last post, I would highly recommend you read it first.

Full disclosure, I will be using pre-trained models from the internet for unet, CLIP TextEncoder, and vae.

Just how does stable diffusion actually work? [SD part 1]

Stable Diffusion is a newish (Dec 20, 2021) image generation model. It can generate quickly generate highly detailed images with a concise text prompt:

ChatGPT and the future of programming.

ChatGPT is a free preview of OpenAI’s large language model, capable of answering questions, writing short programs or essays, and poetry. The model is set up as chatbot, and displays a remarkable ability to hold conversations or answer technical questions.