Services
Contact Us
Ekrem Sarı

Ekrem Sarı

AI Researcher
32 Articles
Stay up-to-date on B2B Tech

Ekrem is an AI Researcher and Data Analyst at AIMultiple. He designs and runs hands-on benchmarks for AI and LLM systems.

Professional Experience

At AIMultiple, Ekrem benchmarks end-to-end AI systems and builds the data workflows and dashboards used to track benchmark and product metrics. His benchmarks cover embedding and reranker models, vector and graph databases, inference engines, quantization, GPU concurrency and multi-GPU scaling, cloud GPU pricing and providers, text-to-SQL, and RAG and agentic RAG frameworks.

Before AIMultiple, he worked as an Assessor at Yandex, where he evaluated search quality and labeled large volumes of data against detailed guidelines to support ranking and model quality.

Research Interest

Ekrem's work focuses on the MLOps and LLMOps lifecycle and on measuring the performance of AI systems. He compares models, frameworks, and infrastructure on metrics such as accuracy, throughput, API cost, and scalability, across the stack from embedding models and vector databases to GPU and cloud infrastructure. His MSc thesis automates systematic literature reviews with a RAG-based pipeline.

Education

Ekrem holds a BA from Hacettepe University and is completing an MSc at Başkent University.

Latest Articles from Ekrem

AI
Open World Evaluation
Jul 23

Top 60+ Cloud GPU Providers in 2026

Cloud GPU providers fall into three tiers. Hyperscalers run broad cloud platforms with GPU rental as one product among many. Specialist neoclouds focus on GPU and AI infrastructure as their core product. Community marketplaces aggregate inventory from many small operators, often at the floor of the published price spread. We track 71 cloud GPU providers…

AI
Open World Evaluation
Jul 23

Comparison of Top 6 Free Cloud GPU Services

The best free GPU tier is worth about $19 a month at rental rates, and eight platforms give a real GPU with no credit card. Six of them cap free usage by the month, and we priced those at the cheapest current on-demand rate for each GPU in our cloud GPU pricing data. Each bar…

Cybersecurity
Benchmark
Jul 21

Backup software benchmark: Acronis vs NinjaOne vs Comet vs MSP360

We benchmarked NinjaOne Backup, Acronis Cyber Protect Cloud Backup, Comet Backup, and MSP360 Managed Backup on identical AWS infrastructure. Each vendor ran a file-mode backup of the same 625,946-file / 50 GB workload and a full image backup of the system disk, then restored the 15 GB medium subdirectory. Here are the four backup products…

AI
Benchmark
Jul 20

Vector Database Sizing and Selection Calculator

The practical question behind a self-hosted vector database for RAG is which engine fits a given server, and which one the workload rules out. The calculator below answers both, from our benchmark of seven self-hosted vector databases run at matched recall on identical embeddings. Five checkboxes at the top of the calculator name five common…

Cybersecurity
Open World Evaluation
Jul 20

Disaster Recovery Benchmark: Acronis vs Comet vs MSP360

We benchmarked Acronis Cyber Protect Cloud, Comet Backup, and MSP360 Managed Backup on disaster recovery. Each vendor imaged a live Windows Server 2022 and a live Ubuntu 24.04 server carrying the same deterministic workload, a web service, a 10,000-row database, and 50 files, then recovered the whole machine onto a separate server after a ransomware-style…

Data
Benchmark
Jul 19

E-Commerce Scraper: 6 Providers Benchmarked

We benchmarked five web data providers across 100 e-commerce domains, fetching 65,000 product and search pages each at 5 to 5,000 concurrent requests. Averaged across concurrency levels, Decodo recorded the fastest median response, about 7 seconds, at a 59% success rate, while Bright Data reached the highest success rate (76%) at a 16-second median. Apify…

AI
Benchmark
Jul 18

Best RAG Tools, Frameworks, and Libraries

RAG improves LLM responses by grounding them in external data instead of just what the model memorized in training. We benchmarked the components a RAG system is built from and gathered the results in one place, with a practical guide to choosing each part of the stack. See our benchmark results for each RAG component,…

AI
Benchmark
Jul 18

Vector Database Benchmark: 7 Open-Source Engines for RAG

We benchmarked seven open-source, self-hosted vector databases as the retrieval layer of a RAG pipeline, each run one at a time on identical bge-m3 embeddings and real medical and technical queries, so the database index was the sole variable. The workload spanned MedRAG-50k, TechQA-28k, and a 2.25M-vector corpus across eight dimensions, from accuracy and retrieval…

AI
Benchmark
Jul 18

GPU Concurrency Benchmark: H100 vs H200 vs B200 vs MI300X

I have spent the last 20 years focusing on system-level computational performance optimization. We benchmarked the latest NVIDIA GPUs, including the NVIDIA’s H100, H200, and B200, and AMD’s MI300X, for concurrency scaling analysis. Using the vLLM framework with the gpt-oss-20b model, we tested how these GPUs handle concurrent requests, from 1 to 512. By measuring…

AI
Benchmark
Jul 17

Text-to-SQL: Comparison of LLM Accuracy

I have relied on SQL for data analysis for 18 years, beginning in my days as a consultant. Translating natural-language questions into SQL makes data more accessible, allowing anyone, even those without technical skills, to work directly with databases. We used our text-to-SQL benchmark methodology on 35+ large language models (LLMs) to assess their performance…