Artificial Intelligence
Explore practical insights, research, and benchmarks on artificial intelligence, including generative AI, large language models, RAG, governance frameworks, MLOps practices, and AI hardware. Gain an understanding of key tools, implementation strategies, and enterprise use cases shaping the AI landscape.
Explore Artificial Intelligence
Agentic IT: Can AI Agents Design a Benchmark
We tested 16 models on a benchmark design in text-to-SQL and tool calling. Each model built one benchmark per topic, for a total of 32 submissions. No submission passed every rubric criterion. The agents could build and run tests, but none demonstrated both a blank-answer test and a correct-answer test of their own scorer. Text-to-SQL…
AIM Enterprise: Agentic Enterprise Benchmark
Enterprises use LLMs every day for their regular tasks. To find the most cost-efficient LLMs, we designed AIM Enterprise, an agentic enterprise benchmark, where we used 69 real enterprise tasks across strategy, marketing, HR, sales, and operations. Two judge models scored every file that passed the checks. On 32.7% of the individual scores the two…
The Future of Large Language Models
See the future of large language models by delving into promising approaches, such as self-training, fact-checking, and sparse expertise that could address LLM limitations. Success rate comparison of LLM’s Claude Sonnet 4.6 led the benchmark with an overall score of 0.748, with base and thinking variants tied to three decimal places. Claude Opus 4.8 (0.702),…
DGX Spark alternatives: RTX, Ryzen AI Halo and Mac Studio
We compare published DGX Spark, RTX and Ryzen AI Halo inference benchmarks, covering prompt processing, token generation and longer contexts. Alternatives include Framework Desktop, Mac Studio and GB10 systems from other manufacturers. Decode speed measures output tokens generated per second. Higher values mean faster response generation. All six results use GPT-OSS 20B MXFP4 in Ollama…
Free Cloud GPUs: Models, Limits and Access Requirements
Free cloud GPUs are available through Python notebooks, AI demos and monthly compute credits. Compare GPU hardware, free allowances and access requirements, or check which services suit your workload. Two T4s provide two separate 16 GB memory allocations. Running a model across both requires software that distributes the workload. The combined capacity does not make…
AI Coding Benchmark: Claude Code vs Cursor
In AI coding, the market has fragmented into two categories: Agentic CLI tools and AI code editors embedded in IDEs. Each claims to automate development. Few comparisons show how they differ under identical workloads. We benchmarked each agent across 10 full-stack web development tasks, performing ~600 atomic validation checks per agent and more than 9,600…
Wu Dao 3.0: China's Version of GPT-5
When the US cut off China’s access to advanced chips, the Beijing Academy of Artificial Intelligence faced a choice: complain about restrictions or work around them. They picked the second option. Wu Dao 3.0, launched in July 2023, throws out the playbook. No massive trillion-parameter models competing for headlines. Instead, BAAI now builds compact models…
World Foundation Models: 10 Use Cases
Training robots and autonomous vehicles (AVs) in the physical world can be costly, time-consuming and risky. World Foundation Models offer a scalable alternative by enabling realistic simulations of real-world environments. These models accelerate development and deployment in robotics, AVs, and other domains by reducing reliance on physical testing. Explore how World Foundation Models work, their…
Time Series Foundation Models: Use Cases & Benefits
Time series foundation models (TSFMs) are pre-trained models that forecast, classify, impute, and detect anomalies in time series data without requiring a separate model for every dataset or industry. TSFMs use transformer-based architectures and large-scale time-series datasets to generalize across domains such as finance, retail, energy, and healthcare. Discover the architecture, use cases, adoption in…
Top 20 Sustainability AI Applications & 7 Tools
By applying generative AI to logistics optimization, demand forecasting, and waste reduction, companies can reduce emissions across their operations beyond the AI systems themselves. Discover 7 sustainability AI tools and 20 applications with real-world examples that leverage AI to build a smarter, more efficient, and more sustainable future. Google AI for Sustainability includes a set…