AI
Explore practical insights, research, and benchmarks on artificial intelligence, including generative AI, large language models, RAG, governance frameworks, MLOps practices, and AI hardware. Gain an understanding of key tools, implementation strategies, and enterprise use cases shaping the AI landscape.
Explore AI
Text-to-SQL: Comparison of LLM Accuracy
I have relied on SQL for data analysis for 18 years, beginning in my days as a consultant. Translating natural-language questions into SQL makes data more accessible, allowing anyone, even those without technical skills, to work directly with databases. We used our text-to-SQL benchmark methodology on 35+ large language models (LLMs) to assess their performance…
Sentiment Analysis Benchmark Testing: ChatGPT, Claude & Qwen
Achieving precise labeling of emotions and sentiments, as well as detecting irony, hatefulness, and offensiveness, remains a challenge, requiring further testing and refinement. We tested 10 large language models across five sentiment tasks: emotion, hatefulness, irony, offensiveness, and sentiment. We ranked them by average accuracy across all five. The results highlight clear distinctions between the…
Wu Dao 3.0: China's Version of GPT-5
When the US cut off China’s access to advanced chips, the Beijing Academy of Artificial Intelligence faced a choice: complain about restrictions or work around them. They picked the second option. Wu Dao 3.0, launched in July 2023, throws out the playbook. No massive trillion-parameter models competing for headlines. Instead, BAAI now builds compact models…
Best 10 Serverless GPU Clouds & 14 Cost-Effective GPUs
Serverless GPU can provide easy-to-scale computing services for AI workloads. However, their costs can be substantial for large-scale projects. Navigate to sections based on your needs: Find the most cost-effective providers by tokens per dollar Compare hourly rates across all major providers Performance data for inference and fine-tuning throughput Serverless GPU price per throughput Serverless…
LLM Automation: Top 7 Tools & 8 Case Studies
LLM automation refers to shift to intelligent automation tools that leverage LLMs, including AI agents, fine-tuned LLMs and RAG models to automate and coordinate tasks. Explore our comprehensive coverage for what LLM automation is, its top real-life applications and major tools. What is LLM automation? Large language models in automation is a systematic approach that…
Top 125 Generative AI Applications
Based on our analysis of 30+ case studies and 10 benchmarks, where we tested and compared over 40 products, we identified 125 generative AI use cases across the following categories: General genAI applications Industry-specific genAI applications Business-function-specific genAI applications For other applications of AI for requests where there is a single correct answer (e.g., prediction…
Enterprise Generative AI: 11 Use Cases & Best Practices
Generative AI (GenAI) presents novel opportunities for enterprises compared to middle-market companies or startups, including: Enterprise generative AI use cases. The opportunity to build your company’s models without exposing private data to 3rd parties. However, generative AI brings challenges unique to large organizations. For example: 36% of enterprises cite concerns about proprietary data exposure when…
AI Hallucination Detection Tools: W&B Weave & Comet
We benchmarked three hallucination detection tools: Weights & Biases (W&B) Weave HallucinationFree Scorer, Arize Phoenix HallucinationEvaluator, and Comet Opik Hallucination Metric, across 100 test cases. Each tool was evaluated on accuracy, precision, recall, and latency. AI hallucination detection tools benchmark We tested 100 responses (50 correct, 50 hallucinated) from factual Q&A scenarios against their source…
Best RAG Tools, Frameworks, and Libraries
RAG improves LLM responses by grounding them in external data instead of just what the model memorized in training. We benchmarked the components a RAG system is built from and gathered the results in one place, with a practical guide to choosing each part of the stack. See our benchmark results for each RAG component,…
Top AI Document Generator Tools
AI document generators promise to create documents, presentations, and even websites from a short prompt. We tested how well several popular tools can generate different types of outputs, including: structured AI-generated documents, excel sheets, word documents, presentations, social media posts. AI document generation tools ToolsOutputBest for AI Doc MakerPDF, Word, PPT, Excel, Google Sheet, Audio,…