Automatically run Black in PyCharm on Windows

The tech titans provide a variety of large language models. Clients try to balance quality, cost and latency. You generally want fast response, top response quality and minimal cost. Many applications suffer from long response times. Which model do you choose to get better response times? If your choice of model improves response times how does the quality fare? And do you save money? In this short article we focus on response times. We look at Google Gemini⁷ and OpenAI GPT⁸ non-streaming chat completion calls and measure what seems to influence latency. What do the vendors promise? OpenAI doesn’t guarantee anything w.r.t. response […]

Challenge Chatting or searching with the help of generative AI on your own data is popular. The solutions are typically Retrieval Augmented Generation (RAG) Apps⁹ in some form. How to secure these, both with respect to app and data access, confidentiality and inappropriate response content is often a challenge. How to secure these on live data, i.e. things that may have changed just now, is an additional challenge. This series of articles reviews common solutions and offers practical ways to plug the holes. Consider the common need to chat or search across multiple private data sources. “How do we make sure the chat […]

All I’m asking is for a little respect — the license version You use a lot of code someone else has written. Cody copied from StackOverflow, external dependencies, dependencies of your dependencies, the underlying operating system, the infrastructure components, and so on. If you, the reader, like me are a software developer, you know that creating software is a lot of work, especially if it is hardened and well-carved enough so that others use it to solve their needs. The process consists of many steps, from idea through design, specification, coding, testing, and documenting to releasing and maintaining. Most times, a product is created […]