Hugging Face pitches HUGS as an alternative to Nvidia’s NIM for open models
HUGS supports 13 models: Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Llama-3.1-405B-Instruct-FP8, Hermes-3-Llama-3.1-8B, Hermes-3-Llama-3.1-70B, Hermes-3-Llama-3.1-405B-FP8, Nous-Hermes-2-Mixtral-8x7B-DPO, Mixtral-8x7B-Instruct-v0.1, Mistral-7B-Instruct-v0.3, Mixtral-8x22B-Instruct-v0.1, Gemma-2-27b-it, Gemma-2-9b-it, and Alibaba’s Qwen2.5-7B-Instruct. The documentation page on HUGS shows that Hugging Face is expected to add support for models such as Deepseek, T5, Phi, and Command R soon. Other multimodal and embeddings models that are expected to be added […]
Read More
Next.js 15 arrives with faster bundler
Vercel has released Next.js 15, the latest version of the company’s React-based web framework, featuring a stable, production-ready version of the high-performance Turbopack bundler optimized for JavaScript and TypeScript. Written in the Rust language, Turbopack means an improved iteration velocity for developers, Vercel said. Turbopack is faster than the previous Webpack bundler, according to the […]
Read More
Rust 1.82 brings Cargo info subcommand
Also in Rust 1.82, aarch64-apple-darwin for macOS on 64-bit Arm CPUs now is a tier 1 Rust target, backed by the highest guarantee of working properly. Every change in the Rust repository must pass full tests on every tier 1 target before it can be merged. This target had been introduced as tier 2 in […]
Read More
Is data gravity no longer centered in the cloud?
AI’s capability to optimize resource allocation can identify the best location for workloads. AI-driven insights enable organizations to assess usage patterns, operational costs, and data flow, uncovering opportunities to streamline processes and identify when on-premises solutions might be more advantageous than cloud storage. This analytical prowess assists in creating more informed data management strategies, ultimately […]
Read More
How Kubecost shines a light on GPU efficiency
With GPUs, you don’t have that visibility or the flexibility to request, “I want four gigabytes of that GPU, and I only want one gigahertz of that GPU to go with it.” Instead, the most common setup today is all or nothing—you request the whole GPU or none of it. The transparency challenge is that […]
Read More
How do we fund open source?
Foundations also can help in more indirect ways, like mentorship, recognition, and community support, and by providing metrics to help business owners quantify the impact of projects and direct investments. “Foundations take up a huge portion of project support beyond straightforward funding,” says Brian Proffitt, senior manager of community outreach in the Open Source Program […]
Read More
Secure Azure Kubernetes with Advanced Container Networking Services
The observability tools give you real-time data on network performance inside your AKS clusters, helping spot performance problems early, with visualization tools that show interconnections and how services interact. Meanwhile, the DNS tools work with Azure networking to help deploy a set of networking policies that control who and what has access to your service, […]
Read More
Ktor 3.0 switches to kotlinx.io library
Ktor 3.0, the latest version of the Kotlin-based framework for building asynchronous client- and server-side applications, is now available. Ktor 3.0 switches to the kotlinx.io library for handling data sources. The release also highlights support for server-sent events (SSE). The JetBrains Ktor 3.0 technology, announced October 10, can be accessed from start.ktor.io. The biggest change […]
Read More
How to manage generative AI programs – governance, education, regulation
The CoE police: Leadership, enforcement, and automation Policing new technology initiatives involves creating a small set of common standards that should govern all the teams taking part. For generative AI projects, this could include creating consistent approaches to managing prompt recipes, agent development and testing, and access to developer tools and integrations. These rules should […]
Read More
At the mercy of social media
And I don’t mind ads. In fact, I like that most social networks endeavor to show me ads based on my interests and search history. While ads can often be intrusive and obnoxious, I actually appreciate some of the newer ways that the sites show me ads. Most social media platforms show clearly labeled ads as a normal […]
Read More