Blog

Google hiked the price of Gemini Flash when they released Flash Lite. This is the first time a model provider increased the cost of inference on a model and is a signal of things to come.

Doing any task in bulk with LLMs can quickly become expensive and brittle. Learn why batch LLM APIs offer a cleaner, less expensive, and often faster alternative to synchronous APIs.

Open source LLMs now outperform closed alternatives at 90% lower cost for workhorse tasks. We analyzed benchmarks, pricing, and real-world performance to show exactly which models beat GPT and Claude—and by how much.

We demonstrate a new method for seeding diverse LLM responses, and release an accompanying open-source dataset of 1 million synthetic humans.

An analysis of 40+ million Hacker News posts reveals that 0.62% are aviation-related, with the percentage steadily increasing over time. Using small language models, we classified 10.7B tokens of content to discover aviation's surprising popularity among technologists.

How do you verify open-source AI models aren't Trojan horses? We bombarded Qwen 2.5 Coder with 50,000 diverse programming tasks and used Mistral Codestral as a verifier to check for malicious outputs. Our large-scale inference approach found minimal security concerns, demonstrating a practical framework for evaluating model safety before deployment.