Services
Contact Us
Ekrem Sarı

Ekrem Sarı

AI Researcher
35 Articles
Stay up-to-date on B2B Tech

Ekrem is an AI Researcher and Data Analyst at AIMultiple. He designs and runs hands-on benchmarks for AI and LLM systems.

Professional Experience

At AIMultiple, Ekrem benchmarks end-to-end AI systems and builds the data workflows and dashboards used to track benchmark and product metrics. His benchmarks cover embedding and reranker models, vector and graph databases, inference engines, quantization, GPU concurrency and multi-GPU scaling, cloud GPU pricing and providers, text-to-SQL, and RAG and agentic RAG frameworks.

Before AIMultiple, he worked as an Assessor at Yandex, where he evaluated search quality and labeled large volumes of data against detailed guidelines to support ranking and model quality.

Research Interest

Ekrem's work focuses on the MLOps and LLMOps lifecycle and on measuring the performance of AI systems. He compares models, frameworks, and infrastructure on metrics such as accuracy, throughput, API cost, and scalability, across the stack from embedding models and vector databases to GPU and cloud infrastructure. His MSc thesis automates systematic literature reviews with a RAG-based pipeline.

Education

Ekrem holds a BA from Hacettepe University and is completing an MSc at Başkent University.

Latest Articles from Ekrem

Data
Benchmark
Jul 30

Large-Scale Web Scraping: 7 Providers Benchmarked

We ran two benchmarks against live websites, from 5 to 5,000 concurrent requests. The first sent 260,000 requests through four web unblockers across the Tranco top 10,000 domains, plus a markdown extraction test on 10,000 URLs. The second fetched 65,000 product and search pages from each of five scraping providers across 100 e-commerce domains. Metrics…

AI
Open World Evaluation
Jul 23

Comparison of Top 6 Free Cloud GPU Services

The best free GPU tier is worth about $19 a month at rental rates, and eight platforms give a real GPU with no credit card. Six of them cap free usage by the month, and we priced those at the cheapest current on-demand rate for each GPU in our cloud GPU pricing data. Each bar…

AI
Benchmark
Jul 20

Vector Database Sizing and Selection Calculator

The practical question behind a self-hosted vector database for RAG is which engine fits a given server, and which one the workload rules out. The calculator below answers both, from our benchmark of seven self-hosted vector databases run at matched recall on identical embeddings. Five checkboxes at the top of the calculator name five common…

AI
Benchmark
Jul 18

Best RAG Tools, Frameworks, and Libraries

RAG improves LLM responses by grounding them in external data instead of just what the model memorized in training. We benchmarked the components a RAG system is built from and gathered the results in one place, with a practical guide to choosing each part of the stack. See our benchmark results for each RAG component,…

AI
Benchmark
Jul 18

Vector Database Benchmark: 7 Open-Source Engines for RAG

We benchmarked seven open-source, self-hosted vector databases as the retrieval layer of a RAG pipeline, each run one at a time on identical bge-m3 embeddings and real medical and technical queries, so the database index was the sole variable. The workload spanned MedRAG-50k, TechQA-28k, and a 2.25M-vector corpus across eight dimensions, from accuracy and retrieval…

AI
Benchmark
Jul 16

Cloud GPU Pricing, Performance & Provider Comparison

Cloud GPU list prices for the same model can differ several times over from one provider to another. We curated the lowest rate, provider, market range, and median for 40+ GPU configurations across all three pricing tiers, plus a throughput-per-dollar benchmark on 10 models. See the most cost-effective GPU for your workload across 13 hyperscaler…

AI
Feature Comparison
Jul 16

Cloud GPU Rental Price Index

On-demand rates for the newest-generation cloud GPUs (B200, B300, MI300X, RTX 5090) roughly doubled over the past year, while mainstream cards (H100, H200, A100) held a tight band. We compile the GPU index monthly from 67 providers and 17 GPU models, covering on-demand, spot, and 1-year reserved tiers. The chart shows the monthly median posted…

AI
Insight
Jul 12

LLM VRAM Calculator for Self-Hosting

Self-hosting an LLM means running inference on hardware the operator controls rather than via a third-party API, which changes the cost, data control, and privacy profile. Whether a model runs at all depends on memory. The calculator estimates the VRAM or unified memory a model needs to run locally, based on the model, its precision,…

Enterprise Software
Benchmark
Jul 2

Top Serverless Functions: Vercel vs Azure vs AWS

Serverless functions enable developers to run code without having to manage a server. This allows them to focus on writing and deploying applications while infrastructure scaling and maintenance are handled automatically in the background. In this benchmark, we evaluated 7 popular cloud service providers following our methodology to test their serverless function performance. We measured…

AI
Benchmark
Jul 2

RAG Evaluation Tools: Weights & Biases vs Ragas vs DeepEval

When a RAG pipeline retrieves the wrong context, the LLM confidently generates the wrong answer. Context relevance scorers are the primary defense. We benchmarked five tools across 1,460 questions and 14,600+ scored contexts under identical conditions: same judge model (GPT-4o), default configurations, and no custom prompts. Under standard conditions, WandB, TruLens, and Ragas emerged as…