Artificial Intelligence
Explore practical insights, research, and benchmarks on artificial intelligence, including generative AI, large language models, RAG, governance frameworks, MLOps practices, and AI hardware. Gain an understanding of key tools, implementation strategies, and enterprise use cases shaping the AI landscape.
Explore Artificial Intelligence
- AI GovernanceOpen World EvaluationAug 4
Top 20 AI GRC Software & Technologies
As AI systems integrate into business processes, organizations face growing AI governance, risk, and compliance needs. In our prior research, we tested AI risks in practice with an AI bias benchmark, finding persistent bias around race, gender, and socioeconomic assumptions in several models. These findings underscore the importance of AI GRC tools, which help continuously…
- GenAI ApplicationsInsightJul 30
Generative AI ERP Systems: 10 Use Cases & Benefits
Enterprise resource planning (ERP) software helps businesses integrate workflows across finance and operations. Generative AI, alongside technologies like RPA, has the potential to enhance ERP processes. The financial use of Generative AI in ERP systems can cover the automation of entire procure to pay cycle and such as the accounts payable process. Another important element…
- AI CodingOpen World EvaluationJul 29
Top 8 Open Source AI Coding Agents
In prior evaluations, we benchmarked both open-source and proprietary Agentic CLIs, focusing on their performance in web development tasks, and some open-source agents performed as successfully as the paid options. Therefore, we also listed the top open-source coding agents for users with privacy concerns. For methodology, see the AI coding benchmark. For more details about…
- AI in IndustriesInsightJul 24
10+ AI Procurement Use Cases & Case Studies
As the benefits of artificial intelligence (AI) are appreciated by a greater audience, the number of AI use cases in different industries expands daily. AI in the procurement sector is no different. See a comprehensive overview of the AI procurement process, detailing the reasons for its adoption, various use cases, the top 5 AI procurement…
- AIInsightJul 23
AI Rollups: Funding, Investors and Industry Trends
We analyzed 30 investments involving over 130 investors from the past 3 years to understand the current trend for AI rollups. Based on our analysis, we identified investor activity and trends, including the number of investors backing AI rollups, the total funding raised for AI rollups, and the leading industries. See the methodology to learn…
- Vector DBBenchmarkJul 20
Vector Database Sizing and Selection Calculator
The practical question behind a self-hosted vector database for RAG is which engine fits a given server, and which one the workload rules out. The calculator below answers both, from our benchmark of seven self-hosted vector databases run at matched recall on identical embeddings. Five checkboxes at the top of the calculator name five common…
- AI HardwareBenchmarkJul 1
LLM Inference Engines: vLLM vs LMDeploy vs SGLang
We benchmarked 3 leading LLM inference engines on NVIDIA H100: vLLM, LMDeploy, and SGLang. Each engine processed identical workloads: 1,000 ShareGPT prompts using Llama 3.1 8B-Instruct to isolate the true performance impact of their architectural choices and optimization strategies. We measured offline batch throughput across 10,000 total inference operations (1,000 prompts × 10 runs per…
- AIOpen World EvaluationJul 1
Top 15 Open Source AI Platforms & Libraries
Deploying your own AI model or, in some cases, fine-tuning pre-existing models comes with several challenges: Open-source platforms that offer unified APIs help address these challenges by enabling multi-cloud deployment and optimizing GPU resource management. Below, we list 15 examples of open source platforms/libraries: When choosing these platforms, we focused mainly on how well they…